You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Could you provide an async version of the Bedrock/AWS client? We would like to swap to the bedrock version but it seems like only the sync client is available for that.
Sidenote - what's the intended way to use the sync clients/why are they the first-class citizen? Seems to me like in most production scenarios requests are handled in an async environment rather than sequentially in a synchronous fashion? 🤔 (Legitimately curious - seems a bit backwards to me so probably there's something I'm missing/don't know?)
The text was updated successfully, but these errors were encountered:
Hey unfortunately I'd have the same advice for you this related issue #625 (comment)
That's a great question but it follows the same pattern as other python SDKs, including openai and anthropic. In python it is relatively difficult to support both sync and async with a single implementation.
Please reopen if I can help any further :) thanks for filing the issue
Could you provide an async version of the Bedrock/AWS client? We would like to swap to the bedrock version but it seems like only the sync client is available for that.
Sidenote - what's the intended way to use the sync clients/why are they the first-class citizen? Seems to me like in most production scenarios requests are handled in an async environment rather than sequentially in a synchronous fashion? 🤔 (Legitimately curious - seems a bit backwards to me so probably there's something I'm missing/don't know?)
The text was updated successfully, but these errors were encountered: