Skip to content

Skip and redact network-burst-throttled throughput data#96

Open
jage wants to merge 1 commit into
mainfrom
issue-90-network-burst-limits
Open

Skip and redact network-burst-throttled throughput data#96
jage wants to merge 1 commit into
mainfrom
issue-90-network-burst-limits

Conversation

@jage

@jage jage commented Jun 17, 2026

Copy link
Copy Markdown
Member

AWS network burst limits make some throughput combos unreliable. Define the unreliable combos once and apply them in two places:

  • scripts/throughput_skip_sizes.json: sizes that throttle to the network baseline (t4g.micro and r7g.medium at 65536 B). The throughput workflow skips them on new runs; build_data.py redacts them from the website JSON.
  • scripts/website_hidden_instances.json: z1d.large is still benchmarked but hidden from all charts (its large-message throughput is bandwidth-bound).

README documents both.

Close #90

AWS network burst limits make some throughput combos unreliable. Define the
unreliable combos once and apply them in two places:

- scripts/throughput_skip_sizes.json: sizes that throttle to the network
  baseline (t4g.micro and r7g.medium at 65536 B). The throughput workflow
  skips them on new runs; build_data.py redacts them from the website JSON.
- scripts/website_hidden_instances.json: z1d.large is still benchmarked but
  hidden from all charts (its large-message throughput is bandwidth-bound).

README documents both.

Close #90
@jage jage requested a review from a team as a code owner June 17, 2026 16:16
@jage jage requested a review from tbroden84 June 17, 2026 16:17
@jage

jage commented Jun 23, 2026

Copy link
Copy Markdown
Member Author

@tbroden84 WDYT?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Handle network burst limitations

1 participant