Skip to content

[Request] models中retry值的含义有歧义 #81

@yejj710

Description

@yejj710

Problem/Pain Point Description

背景

配置了vllm_api_general_stream,其中retry设置为0,期望aisbench不进行重发,实测发现请求未发送,定位后发现直接使用了retry的值进行了循环发送

代码路径: base_api.py line 218

Proposed Solution

retry字面意思是重试,默认理解aisbench应该会发送一次,然后根据retry决定重试多少次。因此改为range(self.retry+1)更合理

Alternative Solutions

No response

Expected Value

mini feature,易用性提升

Contribution Intent

  • I am willing to participate in the development or testing of this feature

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions