Skip to content

fix: normalize multi-round gateway streaming#129

Closed
harivilasp wants to merge 1 commit into
vllm-project:mainfrom
harivilasp:agent/issue-119-gateway-accumulator
Closed

fix: normalize multi-round gateway streaming#129
harivilasp wants to merge 1 commit into
vllm-project:mainfrom
harivilasp:agent/issue-119-gateway-accumulator

Conversation

@harivilasp

Copy link
Copy Markdown
Contributor

Closes #119.

Summary

  • Add a gateway stream accumulator that owns client-visible SSE lifecycle de-duping, sequence_number assignment, and output_index rebasing across gateway rounds.
  • Route upstream forwarded frames, synthetic web_search/MCP frames, and the terminal response event through the same stream accumulator.
  • Add a multi-round streaming regression test covering a gateway tool round followed by a final text round.

Test Plan

  • cargo fmt --check
  • cargo test -p agentic-server-core --test web_search_tool_test multi_round_stream_has_single_lifecycle_and_monotonic_public_sequence
  • cargo test -p agentic-server-core --test web_search_tool_test
  • cargo test -p agentic-server-core
  • cargo clippy --all-targets -- -D warnings
  • cargo test

Signed-off-by: harivilasp <harivilasp@gmail.com>
@harivilasp

Copy link
Copy Markdown
Contributor Author

Cancelling this pickup; #121 has the broader test-coverage scope and this PR should not proceed separately.

@harivilasp harivilasp closed this Jul 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[SSE Completion - Issue 1] Unify the client-visible stream across gateway rounds (GatewayAccumulator)

1 participant