Skip to content

[Bug] 测试mbpp数据集精度时报错找不到logger #114

@SJTUyh

Description

@SJTUyh

操作系统及版本

ubuntu 22.04

安装工具的python环境

在anaconda/miniconda创建的python虚拟环境

python版本

3.10

AISBench工具版本

3.0.20251219

AISBench执行命令

ais_bench --models vllm_api_stream_chat --datasets mbpp_passk_gen_3_shot_chat_prompt --mode eval --debug --reuse 20260119_113305

模型配置文件或自定义配置文件内容

此bug与配置文件内容无关,为代码内部bug

预期行为

正常执行无错误码外报错

实际行为

出现报错:

[2026-01-19 11:45:20,622] [ais_bench] [INFO] Debug mode, print progress directly
Traceback (most recent call last):
  File "/home/y30044005/yh_dev/benchmark/ais_bench/benchmark/tasks/openicl_eval.py", line 521, in <module>
    raise e
  File "/home/y30044005/yh_dev/benchmark/ais_bench/benchmark/tasks/openicl_eval.py", line 518, in <module>
    evaluator.run()
  File "/home/y30044005/yh_dev/benchmark/ais_bench/benchmark/tasks/openicl_eval.py", line 98, in run
    self._score()
  File "/home/y30044005/yh_dev/benchmark/ais_bench/benchmark/tasks/openicl_eval.py", line 283, in _score
    result = icl_evaluator.evaluate(k, n, copy.deepcopy(test_set), **preds)
  File "/home/y30044005/yh_dev/benchmark/ais_bench/benchmark/openicl/icl_evaluator/icl_base_evaluator.py", line 276, in evaluate
    self.logger.info(f'Running {i+1}-th replica of evaluation')
AttributeError: 'MBPPPassKEvaluator' object has no attribute 'logger'

前置检查

  • 我已读懂主页文档的快速入门,无法解决问题
  • 我已检索过FAQ,无重复问题
  • 我已搜索过现有Issue,无重复问题
  • 我已更新到最新版本,问题仍存在

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingcontent_check_passedissue content check passed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions