Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mistral codestral FIM model endpoint #5469

Open
archiewood opened this issue Mar 31, 2025 · 0 comments
Open

Mistral codestral FIM model endpoint #5469

archiewood opened this issue Mar 31, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@archiewood
Copy link
Contributor

archiewood commented Mar 31, 2025

Feature Description

Firstly, thank you for developing this excellent SDK.

I'm using the mistral FIM endpoint https://docs.mistral.ai/capabilities/code_generation/#fill-in-the-middle-endpoint for code completion in the context of a code editor.

It would be nice to be able to wrap this in the vercel SDK to make it more agnostic.

At the moment there appear to be issues:

  • there is no way to change the mistral api endpoint from eg /chat/completions to /fim/completions
  • the mistral provider does not implement the completions function similar to OpenAI (just chat)
  • the codestral-latest model is not explicitly exposed/documented - (but I think this is fine, and i can just use the model id anyway)

Use Cases

One tool I'd like to offer, in certain circumstances is the ability to complete or correct code inline, from the user's current position

Additional context

I am currently planning to work around this by calling out to a separate endpoint and using the mistral API directly.
I am open to contributing this if it is of interest the the project.

@archiewood archiewood added the enhancement New feature or request label Mar 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant