Skip to content

[FEATURE] Support connector retry policy for streaming requests #1

@jiapingzeng

Description

@jiapingzeng

Is your feature request related to a problem?
At the moment, Streaming requests do not apply connector retry configurations. This is because in RemoteConnectorExecutor, when a retry policy is configured, invokeRemoteServiceWithRetry (non-streaming handler) will be invoked even for stream requests, causing stream to freeze.

In a past PR, we have switched the order of the if statements so that stream evaluation is performed first, ensuring that stream requests get handled correctly when retry policy is configured. However, this means stream requests do not get retried.

What solution would you like?
We should also support retry policy for stream requests.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Amazon Q development agentGenerate new features or iterate code based on issue descriptions and comments.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions