Search results

[Bug]测试结果无TPOT，且E2EL与TTFT结果相同

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#113 In AISBench/benchmark;

· LZZhang-HW opened on Jan 17, 2026

[疑问] aisbench支持使用带prompt的测试数据集吗

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#112 In AISBench/benchmark;

· hxwhou opened on Jan 16, 2026

[Bug] predictions提取错误

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#111 In AISBench/benchmark;

· InSec opened on Jan 15, 2026

[疑问] ais_bench 评测qwen3-14B 量化模型时耗时过久

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#109 In AISBench/benchmark;

· ilovexsir opened on Jan 14, 2026

[疑问] AISbench在纯模型使用DeepSeekV3.1测试mmlu数据集时出现模型只回答结尾符的情况end_of_sentence

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#107 In AISBench/benchmark;

· Jiawen9 opened on Jan 13, 2026

[疑问] 数据集测试中需要有curl 里有role角色、content内容引导AI回答进行测试，如何配置

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#105 In AISBench/benchmark;

· Sfeching opened on Jan 12, 2026

[疑问] ais_bench如何生成自定义多轮数据集，并进行测试

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#102 In AISBench/benchmark;

· ivan-zouming opened on Jan 9, 2026

[需求] --search功能希望能够支持模糊匹配

content_check_passedissue content check passedissue content check passed

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

Feature

#101 In AISBench/benchmark;

· SJTUyh opened on Jan 9, 2026

[疑问] ais_bench是否支持自定义QA数据集做精度测试，如何配置？测试命令是什么？

content_check_passedissue content check passedissue content check passed

questionFurther information is requestedFurther information is requested

Status: Open.

#99 In AISBench/benchmark;

· ivan-zouming opened on Jan 8, 2026

[Bug] 自定义数据集中直接指定路径和mm_custom_gen的方式测试结果有差异

bugSomething isn't workingSomething isn't working

content_check_passedissue content check passedissue content check passed

Status: Open.

#91 In AISBench/benchmark;

· Gonewiththewuyue opened on Jan 6, 2026

[Request] models中retry值的含义有歧义

content_check_passedissue content check passedissue content check passed

enhancementNew feature or requestNew feature or request

Status: Open.

#81 In AISBench/benchmark;

· yejj710 opened on Dec 26, 2025

[Bug] AttributeError: 'dict' object has no attribute 'model_type'

bugSomething isn't workingSomething isn't working

content_check_failedissue content check failedissue content check failed

Status: Open.

#76 In AISBench/benchmark;

· GaoHuaZhang opened on Dec 19, 2025