Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Async client for AWS Bedrock? #645

Closed
ldorigo opened this issue Jan 29, 2025 · 1 comment
Closed

Async client for AWS Bedrock? #645

ldorigo opened this issue Jan 29, 2025 · 1 comment

Comments

@ldorigo
Copy link

ldorigo commented Jan 29, 2025

Could you provide an async version of the Bedrock/AWS client? We would like to swap to the bedrock version but it seems like only the sync client is available for that.

Sidenote - what's the intended way to use the sync clients/why are they the first-class citizen? Seems to me like in most production scenarios requests are handled in an async environment rather than sequentially in a synchronous fashion? 🤔 (Legitimately curious - seems a bit backwards to me so probably there's something I'm missing/don't know?)

@billytrend-cohere
Copy link
Collaborator

Hey unfortunately I'd have the same advice for you this related issue #625 (comment)

That's a great question but it follows the same pattern as other python SDKs, including openai and anthropic. In python it is relatively difficult to support both sync and async with a single implementation.

Please reopen if I can help any further :) thanks for filing the issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants