Skip to content

feat: support model-service proxy #166

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
BCeZn wants to merge 1 commit into
base: master
Choose a base branch
from
Draft

feat: support model-service proxy #166

BCeZn wants to merge 1 commit into from

Conversation

@BCeZn
Copy link
Collaborator

@BCeZn BCeZn commented Dec 18, 2025

closes #165

@BCeZn BCeZn requested a review from StephenRi December 18, 2025 07:14
@BCeZn BCeZn force-pushed the feature/xinshi/proxy-model-service branch from 2f4d0dc to b1d713f Compare December 18, 2025 07:18
StephenRi
StephenRi reviewed Dec 18, 2025
View reviewed changes
rock/env_vars.py

# Model Service Config
ROCK_MODEL_SERVICE_DATA_DIR: str
ROCK_MODEL_SERVICE_PROXY_TARGET_URL: str
Copy link
Collaborator

@StephenRi StephenRi Dec 18, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这里至少得是个map<model_name, base_url>。一个agent可能得调用多个模型，不同的模型可能是不同的服务商。

@BCeZn BCeZn marked this pull request as draft December 18, 2025 09:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@StephenRi StephenRi StephenRi left review comments

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[Feature] Impl Proxy Model Service

3 participants

@BCeZn @StephenRi