{"release":{"tag":{"name":"v3.0-20250930-master","path":"/aisbench/benchmark/tags/v3.0-20250930-master","tree_path":"/aisbench/benchmark/tree/v3.0-20250930-master","message":"AISBench-3.0-benchmark-20250930-master","commit":{"id":"f8588e00465b39e503a4879d2f2950773a6abf30","short_id":"f8588e0","title":"!179 上线工具readthedocs主页","title_markdown":"\u003Ca title=\"Pull Request: 上线工具readthedocs主页\" class=\"gfm gfm-pull_request\" href=\"/aisbench/benchmark/pulls/179\"\u003E!179\u003C/a\u003E上线工具readthedocs主页","description":"* doc loc to gitee readme top pos\n* add readthedocs website","description_markdown":"* doc loc to gitee readme top pos\n* add readthedocs website","message":"!179 上线工具readthedocs主页\n* doc loc to gitee readme top pos\n* add readthedocs website\n","message_markdown":"\u003Ca title=\"Pull Request: 上线工具readthedocs主页\" class=\"gfm gfm-pull_request\" href=\"/aisbench/benchmark/pulls/179\"\u003E!179\u003C/a\u003E上线工具readthedocs主页 \u003Cul\u003E\n\u003Cli\u003Edoc loc to gitee readme top pos\u003C/li\u003E\n\u003Cli\u003Eadd readthedocs website\u003C/li\u003E\n\u003C/ul\u003E","detail_path":"/aisbench/benchmark/commit/f8588e00465b39e503a4879d2f2950773a6abf30","commits_path":"/aisbench/benchmark/commits/f8588e00465b39e503a4879d2f2950773a6abf30","tree_path":"/aisbench/benchmark/tree/f8588e00465b39e503a4879d2f2950773a6abf30","author":{"name":"Hanye","email":"yh_silence@alumni.sjtu.edu.cn","username":"yh_silence","user_path":"/yh_silence","enterprise_user_path":null,"image_path":"https://foruda.gitee.com/avatar/1760519500852094739/14098946_yh_silence_1760519500.png!avatar30","is_gitee_user":true,"is_enterprise_user":null,"widget_url":""},"committer":{"name":"Hanye","email":"yh_silence@alumni.sjtu.edu.cn","username":"yh_silence","user_path":"/yh_silence","enterprise_user_path":null,"image_path":"https://foruda.gitee.com/avatar/1760519500852094739/14098946_yh_silence_1760519500.png!avatar30","is_gitee_user":true,"is_enterprise_user":null,"widget_url":""},"authored_date":"2025-10-09T01:24:31+00:00","committed_date":"2025-10-09T01:24:31+00:00","signature":null,"build_state":null},"archive_path":"/aisbench/benchmark/repository/archive/v3.0-20250930-master","signature":null},"operating":{"edit":false,"download":true,"destroy":false,"enterprise_forbid_zip":false},"release":{"title":"AISBench-3.0-benchmark-20250930-master","path":"/aisbench/benchmark/releases/tag/v3.0-20250930-master","tag_path":"/aisbench/benchmark/tree/v3.0-20250930-master","project_id":33485504,"created_at":"2025-10-09T09:50:02+08:00","is_prerelease":false,"description":"1. 支持📚[模拟真实业务流量](https://gitee.com/aisbench/benchmark/tree/v3.0-20250930-master/doc/users_guide/rps_distribution.md)：通过控制请求发送速率波动，感知在模拟真实场景下服务化的性能测评结果！🔥🔥🔥\r\n\r\n2. 支持📚[多次独立重复推理精度场景](https://gitee.com/aisbench/benchmark/tree/v3.0-20250930-master/doc/users_guide/accuracy_benchmark.md#多次独立重复推理)，计算pass@k/cons@k/avg@n等不同维度的精度指标！🔬🔬🔬\r\n\r\n3. 新增Function Call专用模型配置 [vllm_api_function_call_chat](https://gitee.com/aisbench/benchmark/tree/v3.0-20250930-master/ais_bench/benchmark/configs/models/vllm_api/vllm_api_function_call_chat.py)，支持 [BFCL 函数调用能力评估](https://gitee.com/aisbench/benchmark/tree/v3.0-20250930-master/ais_bench/benchmark/configs/datasets/BFCL/README.md) 🔥🔥🔥\r\n\r\n4. 提供工具支持的[性能测试规格说明](https://gitee.com/aisbench/benchmark/tree/v3.0-20250930-master/doc/users_guide/performance_benchmark.md#服务化性能测试规格说明)，优化推理集群场景工具内存占用及性能计算。最大规格场景（250K条请求，输入/输出token 4K/4K）内存占用下降低60%，内存占用小于64GB；性能结果计算效率提升20倍。🚀🚀🚀","author":{"name":"Hanye","username":"yh_silence","path":"/yh_silence","avatar_url":"https://foruda.gitee.com/avatar/1760519500852094739/14098946_yh_silence_1760519500.png!avatar30"},"attach_files":[],"zip_download_url":"/aisbench/benchmark/releases/tag/v3.0-20250930-master.zip","tar_download_url":"/aisbench/benchmark/releases/tag/v3.0-20250930-master.tar.gz"}}}