Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Usage not returned when streaming with Images #48578

Open
jmurkothintel opened this issue Mar 5, 2025 · 1 comment
Open

[BUG] Usage not returned when streaming with Images #48578

jmurkothintel opened this issue Mar 5, 2025 · 1 comment
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention Workflow: This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention Workflow: This issue is responsible by Azure service team.

Comments

@jmurkothintel
Copy link

Library name and version

Azure.AI.OpenAI 2.1.0 , Azure.AI.OpenAI 2.2.0-beta.2

Describe the bug

When the chat message contains an image and we are streaming the response, the usage information is missing when the call is made through the library even though the azure open ai api is returning the usage chunk. Please find below a git repo with a sample project to reproduce the issue
https://github.com/jmurkothintel/OpenAIClientTest

Expected behavior

The library should bubble the usage information to the caller as the underlying api is returning the information

Actual behavior

The library does not return the usage information

Reproduction Steps

Please run the sample project that has been provided

Environment

No response
@github-actions github-actions bot added Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention Workflow: This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention Workflow: This issue is responsible by Azure service team. labels Mar 5, 2025
@github-actions GitHub Actions
Copy link

github-actions bot commented Mar 5, 2025

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @jpalvarezl @ralph-msft @trrwilson.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-attention Workflow: This issue needs attention from Azure service team or SDK team OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that Service Attention Workflow: This issue is responsible by Azure service team.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jmurkothintel