Skip to content

Conversation

mmende
Copy link

@mmende mmende commented Feb 4, 2025

When playing around with the tool-call-stream example in combination with mistral's API I encountered a strange bug where the arguments where duplicated (e.g. instead of { "city": "Berlin" } I would always get { "city": "Berlin" }{ "city": "Berlin" }).

This issue is caused by mistral's API streaming the arguments together with the tool call id and function name which in the example results in the ChatCompletionMessageToolCall being inserted including arguments and then the arguments would be concatenated to itself again.

The adjusted example in this PR fixes this issue.

@b0xtch
Copy link

b0xtch commented Feb 18, 2025

Yeah noticed that same with groq mistral model as well

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants