Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: support exponential backoff #8

Merged
merged 3 commits into from
Mar 25, 2025

Conversation

zoedsoupe
Copy link
Owner

Problem

The project lacks a retry mechanism with exponential backoff for handling failed
structured output requests.

Solution

Added exponential backoff support with configurable parameters when retrying failed
requests, implementing a system that increases wait time between retry attempts.

Rationale

Exponential backoff provides a more efficient approach to retry logic by gradually
increasing wait times, reducing server load while improving success rates.
Implementation allows customization of max backoff time and base backoff values.

@zoedsoupe zoedsoupe linked an issue Mar 25, 2025 that may be closed by this pull request
@zoedsoupe zoedsoupe merged commit c4a4f64 into main Mar 25, 2025
3 checks passed
@zoedsoupe zoedsoupe deleted the feat/support-exponential-backoff branch March 25, 2025 18:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Adapter] Exponential backoff
1 participant