-
Notifications
You must be signed in to change notification settings - Fork 10
Closed
Labels
bugSomething isn't workingSomething isn't workingcontent_check_passedissue content check passedissue content check passed
Description
操作系统及版本
ubuntu 22.04
安装工具的python环境
在anaconda/miniconda创建的python虚拟环境
python版本
3.10
AISBench工具版本
3.0.20251219
AISBench执行命令
ais_bench --models vllm_api_stream_chat --datasets mbpp_passk_gen_3_shot_chat_prompt --mode eval --debug --reuse 20260119_113305
模型配置文件或自定义配置文件内容
此bug与配置文件内容无关,为代码内部bug
预期行为
正常执行无错误码外报错
实际行为
出现报错:
[2026-01-19 11:45:20,622] [ais_bench] [INFO] Debug mode, print progress directly
Traceback (most recent call last):
File "/home/y30044005/yh_dev/benchmark/ais_bench/benchmark/tasks/openicl_eval.py", line 521, in <module>
raise e
File "/home/y30044005/yh_dev/benchmark/ais_bench/benchmark/tasks/openicl_eval.py", line 518, in <module>
evaluator.run()
File "/home/y30044005/yh_dev/benchmark/ais_bench/benchmark/tasks/openicl_eval.py", line 98, in run
self._score()
File "/home/y30044005/yh_dev/benchmark/ais_bench/benchmark/tasks/openicl_eval.py", line 283, in _score
result = icl_evaluator.evaluate(k, n, copy.deepcopy(test_set), **preds)
File "/home/y30044005/yh_dev/benchmark/ais_bench/benchmark/openicl/icl_evaluator/icl_base_evaluator.py", line 276, in evaluate
self.logger.info(f'Running {i+1}-th replica of evaluation')
AttributeError: 'MBPPPassKEvaluator' object has no attribute 'logger'
前置检查
- 我已读懂主页文档的快速入门,无法解决问题
- 我已检索过FAQ,无重复问题
- 我已搜索过现有Issue,无重复问题
- 我已更新到最新版本,问题仍存在
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't workingcontent_check_passedissue content check passedissue content check passed