Skip to content

[疑问] ais_bench 评测qwen3-14B 量化模型时耗时过久 #109

@ilovexsir

Description

@ilovexsir

疑问描述

如题,使用ais_bench工具评测qwen3-14b的量化后的模型时耗时过久,使用的数据集是:
http://opencompass.oss-cn-shanghai.aliyuncs.com/datasets/data/aime.zip
如下图:只有一个task
Image

查看日志耗时如下:

Image 服务运行终端: Image

前置检查

  • 我已读懂主页文档的快速入门,无法解答我的疑惑

Metadata

Metadata

Assignees

No one assigned

    Labels

    content_check_passedissue content check passedquestionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions