-
Notifications
You must be signed in to change notification settings - Fork 10
Open
Labels
content_check_passedissue content check passedissue content check passedenhancementNew feature or requestNew feature or request
Description
Problem/Pain Point Description
背景
配置了vllm_api_general_stream,其中retry设置为0,期望aisbench不进行重发,实测发现请求未发送,定位后发现直接使用了retry的值进行了循环发送
代码路径: base_api.py line 218
Proposed Solution
retry字面意思是重试,默认理解aisbench应该会发送一次,然后根据retry决定重试多少次。因此改为range(self.retry+1)更合理
Alternative Solutions
No response
Expected Value
mini feature,易用性提升
Contribution Intent
- I am willing to participate in the development or testing of this feature
Metadata
Metadata
Assignees
Labels
content_check_passedissue content check passedissue content check passedenhancementNew feature or requestNew feature or request