forked from opensearch-project/ml-commons
-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Labels
Amazon Q development agentGenerate new features or iterate code based on issue descriptions and comments.Generate new features or iterate code based on issue descriptions and comments.
Description
Is your feature request related to a problem?
At the moment, Streaming requests do not apply connector retry configurations. This is because in RemoteConnectorExecutor, when a retry policy is configured, invokeRemoteServiceWithRetry (non-streaming handler) will be invoked even for stream requests, causing stream to freeze.
In a past PR, we have switched the order of the if statements so that stream evaluation is performed first, ensuring that stream requests get handled correctly when retry policy is configured. However, this means stream requests do not get retried.
What solution would you like?
We should also support retry policy for stream requests.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
Amazon Q development agentGenerate new features or iterate code based on issue descriptions and comments.Generate new features or iterate code based on issue descriptions and comments.