Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Oct 22, 2025

This PR contains the following updates:

Package Change Age Confidence
bun (source) 1.3.0 -> 1.3.1 age confidence

Release Notes

oven-sh/bun (bun)

v1.3.1

Compare Source


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Oct 22, 2025
@github-actions
Copy link

💻 Website Preview

The latest changes are available as preview in: https://2d6c6c2f.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1759 106016 total, 0 failed avg: 28ms, p95: 51ms
grafbase 1610 97146 total, 0 failed avg: 31ms, p95: 54ms
cosmo 674 40735 total, 0 failed avg: 73ms, p95: 107ms
apollo-router 388 23609 total, 0 failed avg: 127ms, p95: 165ms
hive-gateway 296 18110 total, 0 failed avg: 165ms, p95: 243ms
hive-gateway-bun 296 18162 total, 0 failed avg: 165ms, p95: 344ms
apollo-gateway 121 7431 total, 0 failed avg: 404ms, p95: 476ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 317748      ✗ 0     
     data_received..................: 9.3 GB  154 MB/s
     data_sent......................: 123 MB  2.0 MB/s
     http_req_blocked...............: avg=5.2µs    min=1.17µs  med=2.58µs  max=8.99ms   p(90)=3.83µs   p(95)=4.57µs   p(99.9)=93.56µs
     http_req_connecting............: avg=2.14µs   min=0s      med=0s      max=8.96ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=28.04ms  min=1.94ms  med=25.11ms max=426.77ms p(90)=44.45ms  p(95)=51.03ms  p(99.9)=87.03ms
       { expected_response:true }...: avg=28.04ms  min=1.94ms  med=25.11ms max=426.77ms p(90)=44.45ms  p(95)=51.03ms  p(99.9)=87.03ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 106016
     http_req_receiving.............: avg=129.76µs min=24.19µs med=43.92µs max=151.48ms p(90)=112.24µs p(95)=351.91µs p(99.9)=15.01ms
     http_req_sending...............: avg=121.38µs min=5.33µs  med=10.17µs max=372.85ms p(90)=29.66µs  p(95)=129.29µs p(99.9)=16.91ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=27.79ms  min=1.89ms  med=24.93ms max=418.27ms p(90)=43.97ms  p(95)=50.5ms   p(99.9)=84.85ms
     http_reqs......................: 106016  1759.594904/s
     iteration_duration.............: avg=28.31ms  min=4.09ms  med=25.35ms max=452.02ms p(90)=44.7ms   p(95)=51.29ms  p(99.9)=87.68ms
     iterations.....................: 105916  1757.93516/s
     success_rate...................: 100.00% ✓ 105916      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 291138      ✗ 0    
     data_received..................: 8.5 GB  142 MB/s
     data_sent......................: 113 MB  1.9 MB/s
     http_req_blocked...............: avg=5.83µs   min=1.18µs  med=2.91µs  max=9.04ms   p(90)=4.04µs   p(95)=4.8µs    p(99.9)=112.95µs
     http_req_connecting............: avg=2.35µs   min=0s      med=0s      max=9.01ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=30.6ms   min=2.6ms   med=27.31ms max=455.69ms p(90)=47.26ms  p(95)=54.06ms  p(99.9)=89.48ms 
       { expected_response:true }...: avg=30.6ms   min=2.6ms   med=27.31ms max=455.69ms p(90)=47.26ms  p(95)=54.06ms  p(99.9)=89.48ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 97146
     http_req_receiving.............: avg=143.93µs min=26.81µs med=47.02µs max=40.24ms  p(90)=127.41µs p(95)=379.7µs  p(99.9)=16ms    
     http_req_sending...............: avg=117.55µs min=5.16µs  med=11.43µs max=390.31ms p(90)=35.66µs  p(95)=132.83µs p(99.9)=16.06ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=30.34ms  min=2.55ms  med=27.12ms max=454.29ms p(90)=46.78ms  p(95)=53.57ms  p(99.9)=85.69ms 
     http_reqs......................: 97146   1610.352174/s
     iteration_duration.............: avg=30.9ms   min=5.97ms  med=27.6ms  max=494.69ms p(90)=47.55ms  p(95)=54.34ms  p(99.9)=89.82ms 
     iterations.....................: 97046   1608.694513/s
     success_rate...................: 100.00% ✓ 97046       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 121905     ✗ 0    
     data_received..................: 3.6 GB  59 MB/s
     data_sent......................: 47 MB   784 kB/s
     http_req_blocked...............: avg=9.31µs   min=1.34µs  med=2.89µs  max=9.2ms    p(90)=4.06µs   p(95)=4.95µs   p(99.9)=1.7ms   
     http_req_connecting............: avg=5.63µs   min=0s      med=0s      max=9.17ms   p(90)=0s       p(95)=0s       p(99.9)=1.51ms  
     http_req_duration..............: avg=73.37ms  min=2.81ms  med=72.44ms max=518.33ms p(90)=99.38ms  p(95)=107.25ms p(99.9)=304.34ms
       { expected_response:true }...: avg=73.37ms  min=2.81ms  med=72.44ms max=518.33ms p(90)=99.38ms  p(95)=107.25ms p(99.9)=304.34ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 40735
     http_req_receiving.............: avg=172.75µs min=30.85µs med=78.07µs max=200.14ms p(90)=153.26µs p(95)=402.98µs p(99.9)=14.49ms 
     http_req_sending...............: avg=65.5µs   min=5.83µs  med=11.11µs max=354.83ms p(90)=29.23µs  p(95)=124.98µs p(99.9)=3.9ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=73.13ms  min=2.72ms  med=72.21ms max=493.92ms p(90)=99.18ms  p(95)=107.04ms p(99.9)=293.27ms
     http_reqs......................: 40735   674.373182/s
     iteration_duration.............: avg=73.83ms  min=4.41ms  med=72.77ms max=560.84ms p(90)=99.7ms   p(95)=107.56ms p(99.9)=313.21ms
     iterations.....................: 40635   672.717669/s
     success_rate...................: 100.00% ✓ 40635      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 70527      ✗ 0    
     data_received..................: 2.1 GB  34 MB/s
     data_sent......................: 28 MB   452 kB/s
     http_req_blocked...............: avg=13.22µs  min=1.91µs  med=2.97µs   max=9.23ms   p(90)=4.19µs   p(95)=5µs      p(99.9)=4.63ms  
     http_req_connecting............: avg=9.5µs    min=0s      med=0s       max=9.18ms   p(90)=0s       p(95)=0s       p(99.9)=4.61ms  
     http_req_duration..............: avg=126.85ms min=5.92ms  med=126.14ms max=576.99ms p(90)=155.56ms p(95)=164.68ms p(99.9)=405.78ms
       { expected_response:true }...: avg=126.85ms min=5.92ms  med=126.14ms max=576.99ms p(90)=155.56ms p(95)=164.68ms p(99.9)=405.78ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23609
     http_req_receiving.............: avg=78.51µs  min=36.3µs  med=53.11µs  max=10.71ms  p(90)=100.21µs p(95)=128.62µs p(99.9)=1.64ms  
     http_req_sending...............: avg=47.39µs  min=7.62µs  med=11.7µs   max=289.38ms p(90)=18.69µs  p(95)=35.97µs  p(99.9)=2.38ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=126.73ms min=5.87ms  med=126.05ms max=575.33ms p(90)=155.43ms p(95)=164.57ms p(99.9)=404.7ms 
     http_reqs......................: 23609   388.551824/s
     iteration_duration.............: avg=127.7ms  min=23.65ms med=126.53ms max=614.08ms p(90)=155.88ms p(95)=165.04ms p(99.9)=427.57ms
     iterations.....................: 23509   386.906045/s
     success_rate...................: 100.00% ✓ 23509      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54030      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   345 kB/s
     http_req_blocked...............: avg=19.1µs   min=1.26µs  med=2.9µs    max=11.02ms  p(90)=4.75µs   p(95)=5.97µs   p(99.9)=7.04ms
     http_req_connecting............: avg=15.3µs   min=0s      med=0s       max=10.94ms  p(90)=0s       p(95)=0s       p(99.9)=6.99ms
     http_req_duration..............: avg=165.49ms min=6.72ms  med=150.22ms max=1.28s    p(90)=201.09ms p(95)=242.59ms p(99.9)=1.26s 
       { expected_response:true }...: avg=165.49ms min=6.72ms  med=150.22ms max=1.28s    p(90)=201.09ms p(95)=242.59ms p(99.9)=1.26s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 18110
     http_req_receiving.............: avg=98.77µs  min=26.73µs med=48.88µs  max=88.62ms  p(90)=108.27µs p(95)=202.44µs p(99.9)=3.84ms
     http_req_sending...............: avg=66.46µs  min=5.77µs  med=11.38µs  max=124.21ms p(90)=32.56µs  p(95)=131.48µs p(99.9)=4.75ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=165.32ms min=6.66ms  med=150.09ms max=1.28s    p(90)=200.92ms p(95)=242.28ms p(99.9)=1.26s 
     http_reqs......................: 18110   296.916457/s
     iteration_duration.............: avg=166.79ms min=41.09ms med=150.99ms max=1.28s    p(90)=201.59ms p(95)=243.73ms p(99.9)=1.26s 
     iterations.....................: 18010   295.276941/s
     success_rate...................: 100.00% ✓ 18010      ✗ 0    
     vus............................: 3       min=3        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54186      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   345 kB/s
     http_req_blocked...............: avg=20.75µs  min=1.22µs  med=2.9µs    max=11.59ms  p(90)=4.67µs   p(95)=5.87µs   p(99.9)=7.39ms  
     http_req_connecting............: avg=16.6µs   min=0s      med=0s       max=11.56ms  p(90)=0s       p(95)=0s       p(99.9)=7.34ms  
     http_req_duration..............: avg=165.01ms min=7.05ms  med=153.45ms max=665.23ms p(90)=185.83ms p(95)=343.83ms p(99.9)=519.2ms 
       { expected_response:true }...: avg=165.01ms min=7.05ms  med=153.45ms max=665.23ms p(90)=185.83ms p(95)=343.83ms p(99.9)=519.2ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 18162
     http_req_receiving.............: avg=97.87µs  min=27.9µs  med=48.69µs  max=20.8ms   p(90)=105.85µs p(95)=194.5µs  p(99.9)=4.96ms  
     http_req_sending...............: avg=114.35µs min=5.91µs  med=11.48µs  max=275.76ms p(90)=32.87µs  p(95)=127.18µs p(99.9)=7.66ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=164.8ms  min=7ms     med=153.32ms max=664.99ms p(90)=185.57ms p(95)=342.73ms p(99.9)=519.11ms
     http_reqs......................: 18162   296.602317/s
     iteration_duration.............: avg=166.27ms min=30.46ms med=153.87ms max=706.95ms p(90)=186.24ms p(95)=345.7ms  p(99.9)=521.61ms
     iterations.....................: 18062   294.969224/s
     success_rate...................: 100.00% ✓ 18062      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21993      ✗ 0   
     data_received..................: 653 MB  11 MB/s
     data_sent......................: 8.6 MB  141 kB/s
     http_req_blocked...............: avg=41.53µs  min=1.38µs  med=2.87µs   max=11.5ms   p(90)=4.42µs   p(95)=5.17µs   p(99.9)=9.85ms  
     http_req_connecting............: avg=37.8µs   min=0s      med=0s       max=11.47ms  p(90)=0s       p(95)=0s       p(99.9)=9.82ms  
     http_req_duration..............: avg=404.35ms min=7.3ms   med=403.52ms max=864.07ms p(90)=458.8ms  p(95)=475.74ms p(99.9)=744.92ms
       { expected_response:true }...: avg=404.35ms min=7.3ms   med=403.52ms max=864.07ms p(90)=458.8ms  p(95)=475.74ms p(99.9)=744.92ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7431
     http_req_receiving.............: avg=62.25µs  min=30.05µs med=50.49µs  max=1.51ms   p(90)=95.39µs  p(95)=110.19µs p(99.9)=705.39µs
     http_req_sending...............: avg=70.08µs  min=6.43µs  med=11.89µs  max=208.55ms p(90)=18.68µs  p(95)=22.47µs  p(99.9)=2.43ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=404.21ms min=7.25ms  med=403.45ms max=862.44ms p(90)=458.73ms p(95)=475.55ms p(99.9)=743.77ms
     http_reqs......................: 7431    121.585329/s
     iteration_duration.............: avg=410.43ms min=62.3ms  med=404.05ms max=934.23ms p(90)=459.44ms p(95)=476.5ms  p(99.9)=908.87ms
     iterations.....................: 7331    119.949138/s
     success_rate...................: 100.00% ✓ 7331       ✗ 0   
     vus............................: 26      min=26       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1838 114307 total, 0 failed avg: 122ms, p95: 295ms
grafbase 1549 98202 total, 0 failed avg: 142ms, p95: 331ms
cosmo 710 45298 total, 0 failed avg: 310ms, p95: 693ms
apollo-router 397 26627 total, 0 failed avg: 529ms, p95: 1207ms ❌ 24 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway 273 18909 total, 0 failed avg: 743ms, p95: 1622ms
hive-gateway-bun 266 18388 total, 0 failed avg: 763ms, p95: 1647ms
apollo-gateway 159 10933 total, 0 failed avg: 1194ms, p95: 2493ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 339921      ✗ 0     
     data_received..................: 10 GB   161 MB/s
     data_sent......................: 133 MB  2.1 MB/s
     http_req_blocked...............: avg=512.9µs  min=1.13µs  med=2.5µs    max=359.11ms p(90)=3.85µs   p(95)=4.48µs   p(99.9)=180.42ms
     http_req_connecting............: avg=506.17µs min=0s      med=0s       max=359.02ms p(90)=0s       p(95)=0s       p(99.9)=176.17ms
     http_req_duration..............: avg=121.75ms min=1.65ms  med=109.87ms max=426.21ms p(90)=247.87ms p(95)=295.4ms  p(99.9)=384.26ms
       { expected_response:true }...: avg=121.75ms min=1.65ms  med=109.87ms max=426.21ms p(90)=247.87ms p(95)=295.4ms  p(99.9)=384.26ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 114307
     http_req_receiving.............: avg=533.96µs min=21.64µs med=41.96µs  max=125.97ms p(90)=96µs     p(95)=384.2µs  p(99.9)=76.05ms 
     http_req_sending...............: avg=436.8µs  min=5.28µs  med=10.22µs  max=123.99ms p(90)=20.57µs  p(95)=125.2µs  p(99.9)=68.9ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=120.78ms min=1.6ms   med=108.83ms max=402.96ms p(90)=245.57ms p(95)=292.94ms p(99.9)=381.25ms
     http_reqs......................: 114307  1838.781556/s
     iteration_duration.............: avg=123.64ms min=1.82ms  med=111.5ms  max=782.04ms p(90)=250.34ms p(95)=298.41ms p(99.9)=423.41ms
     iterations.....................: 113307  1822.695213/s
     success_rate...................: 100.00% ✓ 113307      ✗ 0     
     vus............................: 68      min=0         max=496 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 291606      ✗ 0    
     data_received..................: 8.6 GB  136 MB/s
     data_sent......................: 114 MB  1.8 MB/s
     http_req_blocked...............: avg=680.92µs min=1.19µs  med=2.96µs   max=401.41ms p(90)=4.28µs   p(95)=5.05µs   p(99.9)=214.88ms
     http_req_connecting............: avg=676.61µs min=0s      med=0s       max=401.36ms p(90)=0s       p(95)=0s       p(99.9)=214.72ms
     http_req_duration..............: avg=141.65ms min=2.55ms  med=130.59ms max=473.69ms p(90)=281.95ms p(95)=330.95ms p(99.9)=416.48ms
       { expected_response:true }...: avg=141.65ms min=2.55ms  med=130.59ms max=473.69ms p(90)=281.95ms p(95)=330.95ms p(99.9)=416.48ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 98202
     http_req_receiving.............: avg=645.1µs  min=24.85µs med=46.87µs  max=268.78ms p(90)=100.25µs p(95)=425.17µs p(99.9)=86.32ms 
     http_req_sending...............: avg=584.83µs min=5.28µs  med=11.61µs  max=161.13ms p(90)=29.33µs  p(95)=137.06µs p(99.9)=84.32ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=140.42ms min=2.5ms   med=129.29ms max=426.26ms p(90)=279.28ms p(95)=328.68ms p(99.9)=411.06ms
     http_reqs......................: 98202   1549.032867/s
     iteration_duration.............: avg=144.17ms min=2.73ms  med=132.71ms max=856.03ms p(90)=285.1ms  p(95)=334.16ms p(99.9)=512.4ms 
     iterations.....................: 97202   1533.258922/s
     success_rate...................: 100.00% ✓ 97202       ✗ 0    
     vus............................: 82      min=0         max=497
     vus_max........................: 500     min=500       max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 132894     ✗ 0    
     data_received..................: 4.0 GB  62 MB/s
     data_sent......................: 53 MB   828 kB/s
     http_req_blocked...............: avg=142.95µs min=1.21µs  med=2.81µs   max=161.51ms p(90)=4.12µs   p(95)=5.6µs    p(99.9)=53ms    
     http_req_connecting............: avg=138.4µs  min=0s      med=0s       max=161.45ms p(90)=0s       p(95)=0s       p(99.9)=52.9ms  
     http_req_duration..............: avg=309.95ms min=2.77ms  med=293.26ms max=1.13s    p(90)=606.44ms p(95)=693.24ms p(99.9)=986.51ms
       { expected_response:true }...: avg=309.95ms min=2.77ms  med=293.26ms max=1.13s    p(90)=606.44ms p(95)=693.24ms p(99.9)=986.51ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 45298
     http_req_receiving.............: avg=575.47µs min=27.57µs med=59.23µs  max=228.61ms p(90)=229.62µs p(95)=451.15µs p(99.9)=91.71ms 
     http_req_sending...............: avg=205.57µs min=5.48µs  med=11.03µs  max=113.02ms p(90)=32.01µs  p(95)=131.42µs p(99.9)=43.64ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=309.17ms min=2.7ms   med=292.36ms max=1.13s    p(90)=605.93ms p(95)=691.76ms p(99.9)=983.92ms
     http_reqs......................: 45298   710.752645/s
     iteration_duration.............: avg=317.56ms min=3.05ms  med=300.64ms max=1.13s    p(90)=610.81ms p(95)=696.44ms p(99.9)=993.13ms
     iterations.....................: 44298   695.062049/s
     success_rate...................: 100.00% ✓ 44298      ✗ 0    
     vus............................: 94      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25603 / ✗ 24
     ✗ valid response structure
      ↳  99% — ✓ 25626 / ✗ 1

     checks.........................: 99.96% ✓ 76856      ✗ 25   
     data_received..................: 2.3 GB 35 MB/s
     data_sent......................: 31 MB  464 kB/s
     http_req_blocked...............: avg=91.33µs  min=1.46µs  med=3.05µs   max=214.13ms p(90)=4.54µs  p(95)=6.51µs   p(99.9)=26.24ms
     http_req_connecting............: avg=85.86µs  min=0s      med=0s       max=214.02ms p(90)=0s      p(95)=0s       p(99.9)=26.12ms
     http_req_duration..............: avg=529.29ms min=5.98ms  med=493.11ms max=1.78s    p(90)=1.07s   p(95)=1.2s     p(99.9)=1.68s  
       { expected_response:true }...: avg=529.29ms min=5.98ms  med=493.11ms max=1.78s    p(90)=1.07s   p(95)=1.2s     p(99.9)=1.68s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26627
     http_req_receiving.............: avg=119.4µs  min=30.37µs med=51.56µs  max=114.09ms p(90)=94.93µs p(95)=171.95µs p(99.9)=10.77ms
     http_req_sending...............: avg=113.55µs min=6.22µs  med=11.64µs  max=76.11ms  p(90)=30.25µs p(95)=119.42µs p(99.9)=21.13ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=529.06ms min=5.93ms  med=492.88ms max=1.78s    p(90)=1.07s   p(95)=1.2s     p(99.9)=1.68s  
     http_reqs......................: 26627  397.682249/s
     iteration_duration.............: avg=550.39ms min=6.46ms  med=517.4ms  max=1.78s    p(90)=1.08s   p(95)=1.21s    p(99.9)=1.68s  
     iterations.....................: 25627  382.746948/s
     success_rate...................: 99.90% ✓ 25603      ✗ 24   
     vus............................: 58     min=0        max=498
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53727      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 22 MB   320 kB/s
     http_req_blocked...............: avg=105.05µs min=1.21µs  med=2.85µs   max=84.26ms  p(90)=4.5µs   p(95)=6.45µs   p(99.9)=27.26ms
     http_req_connecting............: avg=99.59µs  min=0s      med=0s       max=84.22ms  p(90)=0s      p(95)=0s       p(99.9)=26.35ms
     http_req_duration..............: avg=742.73ms min=6.79ms  med=676.58ms max=4.6s     p(90)=1.51s   p(95)=1.62s    p(99.9)=3.67s  
       { expected_response:true }...: avg=742.73ms min=6.79ms  med=676.58ms max=4.6s     p(90)=1.51s   p(95)=1.62s    p(99.9)=3.67s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18909
     http_req_receiving.............: avg=185.35µs min=25.16µs med=43.21µs  max=127.76ms p(90)=88.31µs p(95)=161.61µs p(99.9)=29.57ms
     http_req_sending...............: avg=161.96µs min=6.01µs  med=10.9µs   max=86.76ms  p(90)=28.86µs p(95)=111.54µs p(99.9)=28.54ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=742.38ms min=6.73ms  med=676.41ms max=4.6s     p(90)=1.51s   p(95)=1.62s    p(99.9)=3.65s  
     http_reqs......................: 18909   273.507147/s
     iteration_duration.............: avg=784.57ms min=6.94ms  med=730.77ms max=4.65s    p(90)=1.51s   p(95)=1.62s    p(99.9)=3.71s  
     iterations.....................: 17909   259.042757/s
     success_rate...................: 100.00% ✓ 17909      ✗ 0    
     vus............................: 75      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52164      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 22 MB   313 kB/s
     http_req_blocked...............: avg=105.27µs min=1.2µs   med=2.82µs   max=106.77ms p(90)=4.68µs p(95)=8.48µs   p(99.9)=28.99ms
     http_req_connecting............: avg=99.55µs  min=0s      med=0s       max=106.73ms p(90)=0s     p(95)=0s       p(99.9)=28.94ms
     http_req_duration..............: avg=763.23ms min=6.57ms  med=720.18ms max=5.01s    p(90)=1.52s  p(95)=1.64s    p(99.9)=4.11s  
       { expected_response:true }...: avg=763.23ms min=6.57ms  med=720.18ms max=5.01s    p(90)=1.52s  p(95)=1.64s    p(99.9)=4.11s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18388
     http_req_receiving.............: avg=182.18µs min=26.68µs med=44.27µs  max=93.02ms  p(90)=91.2µs p(95)=173.63µs p(99.9)=27.84ms
     http_req_sending...............: avg=190.75µs min=5.66µs  med=10.96µs  max=107.89ms p(90)=31.6µs p(95)=120.34µs p(99.9)=28.95ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s     p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=762.86ms min=6.52ms  med=720.08ms max=5.01s    p(90)=1.51s  p(95)=1.64s    p(99.9)=4.11s  
     http_reqs......................: 18388   266.836353/s
     iteration_duration.............: avg=807.47ms min=8.35ms  med=770.09ms max=5.04s    p(90)=1.53s  p(95)=1.65s    p(99.9)=4.18s  
     iterations.....................: 17388   252.324914/s
     success_rate...................: 100.00% ✓ 17388      ✗ 0    
     vus............................: 60      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29799      ✗ 0    
     data_received..................: 960 MB  14 MB/s
     data_sent......................: 13 MB   191 kB/s
     http_req_blocked...............: avg=38.14µs min=1.3µs   med=3.06µs  max=40.96ms p(90)=5.13µs  p(95)=10.68µs  p(99.9)=8.02ms
     http_req_connecting............: avg=31.55µs min=0s      med=0s      max=40.88ms p(90)=0s      p(95)=0s       p(99.9)=6.55ms
     http_req_duration..............: avg=1.19s   min=7.23ms  med=1.11s   max=15.44s  p(90)=2.14s   p(95)=2.49s    p(99.9)=13.6s 
       { expected_response:true }...: avg=1.19s   min=7.23ms  med=1.11s   max=15.44s  p(90)=2.14s   p(95)=2.49s    p(99.9)=13.6s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 10933
     http_req_receiving.............: avg=71.64µs min=28.46µs med=52.71µs max=9.07ms  p(90)=99.58µs p(95)=123.36µs p(99.9)=1.06ms
     http_req_sending...............: avg=41.46µs min=5.96µs  med=12.2µs  max=29.26ms p(90)=28.15µs p(95)=44.07µs  p(99.9)=7.43ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.19s   min=7.17ms  med=1.11s   max=15.44s  p(90)=2.14s   p(95)=2.49s    p(99.9)=13.6s 
     http_reqs......................: 10933   159.988069/s
     iteration_duration.............: avg=1.31s   min=7.66ms  med=1.3s    max=15.45s  p(90)=2.19s   p(95)=2.58s    p(99.9)=13.7s 
     iterations.....................: 9933    145.354568/s
     success_rate...................: 100.00% ✓ 9933       ✗ 0    
     vus............................: 94      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13943 total, 0 failed avg: 217ms, p95: 228ms
hive-router 168 13644 total, 0 failed avg: 221ms, p95: 235ms
cosmo 157 12743 total, 0 failed avg: 237ms, p95: 262ms
hive-gateway 151 11571 total, 0 failed avg: 261ms, p95: 289ms
hive-gateway-bun 145 11167 total, 0 failed avg: 270ms, p95: 317ms
apollo-router 127 10356 total, 0 failed avg: 292ms, p95: 337ms ❌ 1 unexpected GraphQL errors
apollo-gateway 85 6963 total, 0 failed avg: 434ms, p95: 479ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41529      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=18.99µs  min=1.27µs   med=1.93µs   max=9.16ms   p(90)=3.44µs   p(95)=4.93µs   p(99.9)=6.64ms  
     http_req_connecting............: avg=16.37µs  min=0s       med=0s       max=9.13ms   p(90)=0s       p(95)=0s       p(99.9)=6.62ms  
     http_req_duration..............: avg=216.53ms min=156.46ms med=215.59ms max=621.92ms p(90)=225.48ms p(95)=228.21ms p(99.9)=528.76ms
       { expected_response:true }...: avg=216.53ms min=156.46ms med=215.59ms max=621.92ms p(90)=225.48ms p(95)=228.21ms p(99.9)=528.76ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13943
     http_req_receiving.............: avg=87.28µs  min=27.18µs  med=46.95µs  max=15.69ms  p(90)=98.28µs  p(95)=259.03µs p(99.9)=4.49ms  
     http_req_sending...............: avg=136.8µs  min=6.16µs   med=8.47µs   max=394.88ms p(90)=31.43µs  p(95)=94.98µs  p(99.9)=8.31ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.3ms  min=156.38ms med=215.49ms max=621.09ms p(90)=225.33ms p(95)=228ms    p(99.9)=508.45ms
     http_reqs......................: 13943   172.291601/s
     iteration_duration.............: avg=216.83ms min=156.66ms med=215.85ms max=644.61ms p(90)=225.69ms p(95)=228.45ms p(99.9)=537.31ms
     iterations.....................: 13843   171.055915/s
     success_rate...................: 100.00% ✓ 13843      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40632      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=25.21µs  min=1.25µs   med=2.45µs   max=11.37ms  p(90)=3.92µs   p(95)=5.38µs   p(99.9)=8.48ms  
     http_req_connecting............: avg=22.17µs  min=0s       med=0s       max=11.32ms  p(90)=0s       p(95)=0s       p(99.9)=8.46ms  
     http_req_duration..............: avg=221.4ms  min=119.32ms med=219.72ms max=644.7ms  p(90)=231.08ms p(95)=234.7ms  p(99.9)=545.44ms
       { expected_response:true }...: avg=221.4ms  min=119.32ms med=219.72ms max=644.7ms  p(90)=231.08ms p(95)=234.7ms  p(99.9)=545.44ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13644
     http_req_receiving.............: avg=91.08µs  min=26.98µs  med=47.22µs  max=66.8ms   p(90)=102.11µs p(95)=272.47µs p(99.9)=4.35ms  
     http_req_sending...............: avg=133.53µs min=5.59µs   med=9.77µs   max=389.19ms p(90)=30.11µs  p(95)=108.55µs p(99.9)=6.16ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.17ms min=115.02ms med=219.62ms max=631.92ms p(90)=230.89ms p(95)=234.54ms p(99.9)=523.65ms
     http_reqs......................: 13644   168.571327/s
     iteration_duration.............: avg=221.75ms min=119.62ms med=220ms    max=654.46ms p(90)=231.34ms p(95)=234.92ms p(99.9)=553.05ms
     iterations.....................: 13544   167.335829/s
     success_rate...................: 100.00% ✓ 13544      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37929      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   183 kB/s
     http_req_blocked...............: avg=21.78µs  min=1.39µs   med=2.55µs   max=9.34ms   p(90)=3.68µs   p(95)=4.72µs   p(99.9)=7.05ms  
     http_req_connecting............: avg=18.62µs  min=0s       med=0s       max=9.28ms   p(90)=0s       p(95)=0s       p(99.9)=7.03ms  
     http_req_duration..............: avg=237.15ms min=158.06ms med=236.91ms max=625.42ms p(90)=256.77ms p(95)=262.46ms p(99.9)=522ms   
       { expected_response:true }...: avg=237.15ms min=158.06ms med=236.91ms max=625.42ms p(90)=256.77ms p(95)=262.46ms p(99.9)=522ms   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12743
     http_req_receiving.............: avg=391.68µs min=32.52µs  med=57.19µs  max=32.65ms  p(90)=154.73µs p(95)=451.01µs p(99.9)=29.5ms  
     http_req_sending...............: avg=85.83µs  min=6.46µs   med=10.69µs  max=224.02ms p(90)=27.78µs  p(95)=114.48µs p(99.9)=3.65ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=236.67ms min=157.98ms med=236.53ms max=624.34ms p(90)=256.16ms p(95)=261.76ms p(99.9)=521.16ms
     http_reqs......................: 12743   157.304787/s
     iteration_duration.............: avg=237.76ms min=158.32ms med=237.3ms  max=649.76ms p(90)=257.12ms p(95)=262.91ms p(99.9)=575.65ms
     iterations.....................: 12643   156.070347/s
     success_rate...................: 100.00% ✓ 12643      ✗ 0    
     vus............................: 49      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34413      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 14 MB   176 kB/s
     http_req_blocked...............: avg=29.07µs  min=1.13µs   med=2.59µs   max=11.08ms  p(90)=4.02µs   p(95)=5.2µs    p(99.9)=8.74ms  
     http_req_connecting............: avg=24.2µs   min=0s       med=0s       max=11.04ms  p(90)=0s       p(95)=0s       p(99.9)=8.71ms  
     http_req_duration..............: avg=260.85ms min=152.59ms med=250.27ms max=884.24ms p(90)=268.08ms p(95)=289.42ms p(99.9)=875.99ms
       { expected_response:true }...: avg=260.85ms min=152.59ms med=250.27ms max=884.24ms p(90)=268.08ms p(95)=289.42ms p(99.9)=875.99ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11571
     http_req_receiving.............: avg=87.76µs  min=24.13µs  med=44.56µs  max=14ms     p(90)=103.45µs p(95)=323.66µs p(99.9)=2.38ms  
     http_req_sending...............: avg=130.67µs min=5.35µs   med=10.78µs  max=239.24ms p(90)=34.2µs   p(95)=143.08µs p(99.9)=5.98ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=260.63ms min=152.54ms med=250.16ms max=884.17ms p(90)=267.78ms p(95)=289.01ms p(99.9)=875.89ms
     http_reqs......................: 11571   151.482097/s
     iteration_duration.............: avg=262.08ms min=152.75ms med=250.63ms max=884.48ms p(90)=268.51ms p(95)=290.13ms p(99.9)=876.34ms
     iterations.....................: 11471   150.172944/s
     success_rate...................: 100.00% ✓ 11471      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33201      ✗ 0    
     data_received..................: 981 MB  13 MB/s
     data_sent......................: 13 MB   170 kB/s
     http_req_blocked...............: avg=29.13µs  min=1.19µs   med=2.7µs    max=11.6ms   p(90)=4.25µs   p(95)=5.69µs   p(99.9)=9.18ms  
     http_req_connecting............: avg=25.64µs  min=0s       med=0s       max=11.57ms  p(90)=0s       p(95)=0s       p(99.9)=9.14ms  
     http_req_duration..............: avg=270.19ms min=160.5ms  med=259.51ms max=728.35ms p(90)=279.38ms p(95)=316.58ms p(99.9)=684.56ms
       { expected_response:true }...: avg=270.19ms min=160.5ms  med=259.51ms max=728.35ms p(90)=279.38ms p(95)=316.58ms p(99.9)=684.56ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11167
     http_req_receiving.............: avg=120.89µs min=26.14µs  med=46.82µs  max=259.73ms p(90)=108.43µs p(95)=399.17µs p(99.9)=4.82ms  
     http_req_sending...............: avg=114.56µs min=5.5µs    med=11.02µs  max=342ms    p(90)=37.37µs  p(95)=164.73µs p(99.9)=6.38ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=269.95ms min=160.4ms  med=259.4ms  max=721.81ms p(90)=279.2ms  p(95)=314.77ms p(99.9)=684.27ms
     http_reqs......................: 11167   145.881932/s
     iteration_duration.............: avg=271.7ms  min=187.79ms med=259.89ms max=772.28ms p(90)=280.02ms p(95)=337ms    p(99.9)=727.75ms
     iterations.....................: 11067   144.575565/s
     success_rate...................: 100.00% ✓ 11067      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 10255 / ✗ 1
     ✓ valid response structure

     checks.........................: 99.99% ✓ 30767      ✗ 1    
     data_received..................: 909 MB 11 MB/s
     data_sent......................: 12 MB  148 kB/s
     http_req_blocked...............: avg=22.83µs  min=1.73µs   med=2.7µs    max=7.84ms   p(90)=3.98µs   p(95)=4.91µs   p(99.9)=6.27ms  
     http_req_connecting............: avg=19.35µs  min=0s       med=0s       max=7.8ms    p(90)=0s       p(95)=0s       p(99.9)=6.26ms  
     http_req_duration..............: avg=292.04ms min=178.97ms med=292.33ms max=709.97ms p(90)=327.7ms  p(95)=337.41ms p(99.9)=622.03ms
       { expected_response:true }...: avg=292.04ms min=178.97ms med=292.33ms max=709.97ms p(90)=327.7ms  p(95)=337.41ms p(99.9)=622.03ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 10356
     http_req_receiving.............: avg=94.48µs  min=33.9µs   med=50.26µs  max=82.17ms  p(90)=104.39µs p(95)=237.93µs p(99.9)=1.87ms  
     http_req_sending...............: avg=103.84µs min=7.33µs   med=10.96µs  max=298.48ms p(90)=26.67µs  p(95)=142.37µs p(99.9)=4.21ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=291.85ms min=178.86ms med=292.15ms max=709.25ms p(90)=327.51ms p(95)=337.19ms p(99.9)=621.19ms
     http_reqs......................: 10356  127.236817/s
     iteration_duration.............: avg=293.23ms min=179.21ms med=292.94ms max=735.15ms p(90)=328.22ms p(95)=337.9ms  p(99.9)=640.67ms
     iterations.....................: 10256  126.008188/s
     success_rate...................: 99.99% ✓ 10255      ✗ 1    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20589     ✗ 0   
     data_received..................: 612 MB  7.5 MB/s
     data_sent......................: 8.1 MB  99 kB/s
     http_req_blocked...............: avg=43.48µs  min=1.39µs   med=3.17µs   max=10.95ms  p(90)=5.09µs   p(95)=5.71µs   p(99.9)=9.48ms  
     http_req_connecting............: avg=39.7µs   min=0s       med=0s       max=10.92ms  p(90)=0s       p(95)=0s       p(99.9)=9.44ms  
     http_req_duration..............: avg=434.38ms min=210.66ms med=436.97ms max=1.01s    p(90)=464.81ms p(95)=479.28ms p(99.9)=940.07ms
       { expected_response:true }...: avg=434.38ms min=210.66ms med=436.97ms max=1.01s    p(90)=464.81ms p(95)=479.28ms p(99.9)=940.07ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 6963
     http_req_receiving.............: avg=101.02µs min=30.88µs  med=60.46µs  max=196.12ms p(90)=104.16µs p(95)=121.56µs p(99.9)=561.47µs
     http_req_sending...............: avg=85.32µs  min=6.51µs   med=13.47µs  max=216.07ms p(90)=21.17µs  p(95)=28.36µs  p(99.9)=3.16ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=434.19ms min=210.58ms med=436.87ms max=1.01s    p(90)=464.64ms p(95)=479.08ms p(99.9)=938.76ms
     http_reqs......................: 6963    85.374486/s
     iteration_duration.............: avg=438.23ms min=275.13ms med=437.61ms max=1.08s    p(90)=465.46ms p(95)=479.92ms p(99.9)=1.04s   
     iterations.....................: 6863    84.14837/s
     success_rate...................: 100.00% ✓ 6863      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14032 total, 0 failed avg: 215ms, p95: 227ms
hive-router 169 13686 total, 0 failed avg: 221ms, p95: 231ms
hive-gateway 165 12631 total, 0 failed avg: 239ms, p95: 264ms
cosmo 164 13334 total, 0 failed avg: 226ms, p95: 254ms
hive-gateway-bun 160 12257 total, 0 failed avg: 246ms, p95: 277ms
apollo-router 140 11455 total, 0 failed avg: 264ms, p95: 313ms
apollo-gateway 122 9993 total, 0 failed avg: 302ms, p95: 342ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41796      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=18.39µs  min=1.19µs   med=1.93µs   max=8.73ms   p(90)=3.61µs   p(95)=5.22µs   p(99.9)=6.39ms  
     http_req_connecting............: avg=15.73µs  min=0s       med=0s       max=8.69ms   p(90)=0s       p(95)=0s       p(99.9)=6.37ms  
     http_req_duration..............: avg=215.25ms min=154.18ms med=214.58ms max=607.39ms p(90)=223.83ms p(95)=226.6ms  p(99.9)=511.8ms 
       { expected_response:true }...: avg=215.25ms min=154.18ms med=214.58ms max=607.39ms p(90)=223.83ms p(95)=226.6ms  p(99.9)=511.8ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 14032
     http_req_receiving.............: avg=103.12µs min=25.92µs  med=47.08µs  max=273.9ms  p(90)=96.15µs  p(95)=256.15µs p(99.9)=4.94ms  
     http_req_sending...............: avg=132.43µs min=5.43µs   med=8.31µs   max=376.32ms p(90)=27.48µs  p(95)=102.51µs p(99.9)=8.05ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.01ms min=154.13ms med=214.48ms max=594.45ms p(90)=223.7ms  p(95)=226.35ms p(99.9)=480.69ms
     http_reqs......................: 14032   173.413355/s
     iteration_duration.............: avg=215.57ms min=154.37ms med=214.84ms max=630.08ms p(90)=224.05ms p(95)=226.8ms  p(99.9)=534.17ms
     iterations.....................: 13932   172.177513/s
     success_rate...................: 100.00% ✓ 13932      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40758      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   197 kB/s
     http_req_blocked...............: avg=19.8µs   min=1.17µs   med=2.01µs   max=9.32ms   p(90)=3.34µs   p(95)=4.66µs   p(99.9)=6.92ms  
     http_req_connecting............: avg=17.26µs  min=0s       med=0s       max=9.29ms   p(90)=0s       p(95)=0s       p(99.9)=6.9ms   
     http_req_duration..............: avg=220.83ms min=116.88ms med=219.84ms max=602.17ms p(90)=228.63ms p(95)=231.46ms p(99.9)=508.65ms
       { expected_response:true }...: avg=220.83ms min=116.88ms med=219.84ms max=602.17ms p(90)=228.63ms p(95)=231.46ms p(99.9)=508.65ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13686
     http_req_receiving.............: avg=81.03µs  min=25.82µs  med=44.23µs  max=9.36ms   p(90)=94.32µs  p(95)=256.33µs p(99.9)=5.06ms  
     http_req_sending...............: avg=125.81µs min=5.61µs   med=8.6µs    max=372.71ms p(90)=28.99µs  p(95)=102.72µs p(99.9)=6.57ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.62ms min=112.84ms med=219.74ms max=601.41ms p(90)=228.46ms p(95)=231.29ms p(99.9)=496.23ms
     http_reqs......................: 13686   169.062267/s
     iteration_duration.............: avg=221.2ms  min=117.14ms med=220.11ms max=614.53ms p(90)=228.83ms p(95)=231.66ms p(99.9)=535.56ms
     iterations.....................: 13586   167.826974/s
     success_rate...................: 100.00% ✓ 13586      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37593      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   192 kB/s
     http_req_blocked...............: avg=21.96µs  min=1.09µs   med=2.65µs   max=9.29ms   p(90)=4.14µs   p(95)=5.36µs   p(99.9)=6.95ms  
     http_req_connecting............: avg=18.58µs  min=0s       med=0s       max=9.26ms   p(90)=0s       p(95)=0s       p(99.9)=6.93ms  
     http_req_duration..............: avg=239.21ms min=159.46ms med=230.61ms max=730.11ms p(90)=252.74ms p(95)=263.98ms p(99.9)=620.32ms
       { expected_response:true }...: avg=239.21ms min=159.46ms med=230.61ms max=730.11ms p(90)=252.74ms p(95)=263.98ms p(99.9)=620.32ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12631
     http_req_receiving.............: avg=90.43µs  min=25.92µs  med=44.9µs   max=54.87ms  p(90)=95.28µs  p(95)=170.67µs p(99.9)=4.24ms  
     http_req_sending...............: avg=143.13µs min=5.24µs   med=10.78µs  max=293.73ms p(90)=33.18µs  p(95)=119.59µs p(99.9)=6.46ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=238.98ms min=159.39ms med=230.48ms max=719.3ms  p(90)=252.55ms p(95)=263.33ms p(99.9)=619.04ms
     http_reqs......................: 12631   165.041468/s
     iteration_duration.............: avg=240.16ms min=168.07ms med=230.99ms max=776.43ms p(90)=253.18ms p(95)=264.63ms p(99.9)=639.68ms
     iterations.....................: 12531   163.73483/s
     success_rate...................: 100.00% ✓ 12531      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 39702      ✗ 0    
     data_received..................: 1.2 GB  14 MB/s
     data_sent......................: 16 MB   191 kB/s
     http_req_blocked...............: avg=22.2µs   min=1.33µs   med=2.77µs   max=9.83ms   p(90)=4.31µs   p(95)=5.64µs   p(99.9)=7.36ms  
     http_req_connecting............: avg=18.53µs  min=0s       med=0s       max=9.8ms    p(90)=0s       p(95)=0s       p(99.9)=7.34ms  
     http_req_duration..............: avg=226.36ms min=128.69ms med=225.25ms max=641.64ms p(90)=247.13ms p(95)=253.59ms p(99.9)=525.82ms
       { expected_response:true }...: avg=226.36ms min=128.69ms med=225.25ms max=641.64ms p(90)=247.13ms p(95)=253.59ms p(99.9)=525.82ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13334
     http_req_receiving.............: avg=609.03µs min=32.8µs   med=69.89µs  max=54.96ms  p(90)=406.03µs p(95)=1.05ms   p(99.9)=39.38ms 
     http_req_sending...............: avg=102.44µs min=6.14µs   med=11.41µs  max=256.28ms p(90)=34.45µs  p(95)=136.76µs p(99.9)=4.19ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=225.65ms min=128.62ms med=224.61ms max=640.61ms p(90)=246.36ms p(95)=252.68ms p(99.9)=524.63ms
     http_reqs......................: 13334   164.411345/s
     iteration_duration.............: avg=226.87ms min=128.91ms med=225.68ms max=664.42ms p(90)=247.45ms p(95)=253.95ms p(99.9)=548.67ms
     iterations.....................: 13234   163.178321/s
     success_rate...................: 100.00% ✓ 13234      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36471      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   186 kB/s
     http_req_blocked...............: avg=27.14µs  min=1.18µs   med=2.57µs   max=12.15ms  p(90)=4.24µs   p(95)=5.65µs   p(99.9)=8.95ms  
     http_req_connecting............: avg=23.62µs  min=0s       med=0s       max=12.1ms   p(90)=0s       p(95)=0s       p(99.9)=8.9ms   
     http_req_duration..............: avg=246.05ms min=151.59ms med=237.8ms  max=696.31ms p(90)=262.81ms p(95)=276.86ms p(99.9)=689.13ms
       { expected_response:true }...: avg=246.05ms min=151.59ms med=237.8ms  max=696.31ms p(90)=262.81ms p(95)=276.86ms p(99.9)=689.13ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12257
     http_req_receiving.............: avg=104.46µs min=26.35µs  med=48.96µs  max=139.93ms p(90)=112.56µs p(95)=281.01µs p(99.9)=3.42ms  
     http_req_sending...............: avg=84.24µs  min=5.45µs   med=10.89µs  max=178.94ms p(90)=33.56µs  p(95)=135.4µs  p(99.9)=5.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=245.87ms min=146.49ms med=237.66ms max=693.73ms p(90)=262.65ms p(95)=276.56ms p(99.9)=688.12ms
     http_reqs......................: 12257   160.005507/s
     iteration_duration.............: avg=247.1ms  min=151.91ms med=238.2ms  max=737.48ms p(90)=263.24ms p(95)=277.31ms p(99.9)=690.59ms
     iterations.....................: 12157   158.700085/s
     success_rate...................: 100.00% ✓ 12157      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34065      ✗ 0    
     data_received..................: 1.0 GB  12 MB/s
     data_sent......................: 13 MB   164 kB/s
     http_req_blocked...............: avg=15.65µs  min=1.35µs   med=2.81µs   max=5.42ms   p(90)=4.33µs   p(95)=5.33µs   p(99.9)=4.11ms  
     http_req_connecting............: avg=11.92µs  min=0s       med=0s       max=5.39ms   p(90)=0s       p(95)=0s       p(99.9)=4.09ms  
     http_req_duration..............: avg=263.79ms min=151.08ms med=257.73ms max=672.24ms p(90)=302.15ms p(95)=312.61ms p(99.9)=573.39ms
       { expected_response:true }...: avg=263.79ms min=151.08ms med=257.73ms max=672.24ms p(90)=302.15ms p(95)=312.61ms p(99.9)=573.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11455
     http_req_receiving.............: avg=95.43µs  min=28.01µs  med=49.88µs  max=26.2ms   p(90)=107.53µs p(95)=304.93µs p(99.9)=3.08ms  
     http_req_sending...............: avg=128.96µs min=5.12µs   med=10.28µs  max=327.66ms p(90)=21.78µs  p(95)=127.5µs  p(99.9)=3.85ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=263.56ms min=150.97ms med=257.57ms max=671.44ms p(90)=301.89ms p(95)=312.41ms p(99.9)=568.5ms 
     http_reqs......................: 11455   140.542665/s
     iteration_duration.............: avg=264.55ms min=151.31ms med=258.19ms max=682.94ms p(90)=302.58ms p(95)=313.02ms p(99.9)=583.19ms
     iterations.....................: 11355   139.315754/s
     success_rate...................: 100.00% ✓ 11355      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29679      ✗ 0   
     data_received..................: 878 MB  11 MB/s
     data_sent......................: 12 MB   143 kB/s
     http_req_blocked...............: avg=30.74µs  min=1.31µs   med=3.45µs   max=10.26ms  p(90)=5.17µs   p(95)=6µs      p(99.9)=8.39ms  
     http_req_connecting............: avg=26.34µs  min=0s       med=0s       max=10.22ms  p(90)=0s       p(95)=0s       p(99.9)=8.36ms  
     http_req_duration..............: avg=302.36ms min=210.35ms med=300.13ms max=816.19ms p(90)=333.08ms p(95)=341.94ms p(99.9)=700.64ms
       { expected_response:true }...: avg=302.36ms min=210.35ms med=300.13ms max=816.19ms p(90)=333.08ms p(95)=341.94ms p(99.9)=700.64ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 9993
     http_req_receiving.............: avg=81.18µs  min=30.58µs  med=61.13µs  max=5.96ms   p(90)=107.05µs p(95)=129.6µs  p(99.9)=2.58ms  
     http_req_sending...............: avg=90.87µs  min=6.22µs   med=13.1µs   max=265.51ms p(90)=21.98µs  p(95)=38.42µs  p(99.9)=4.54ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=302.19ms min=210.26ms med=300.03ms max=814.84ms p(90)=332.91ms p(95)=341.77ms p(99.9)=699.15ms
     http_reqs......................: 9993    122.501963/s
     iteration_duration.............: avg=303.76ms min=219.11ms med=300.72ms max=843.98ms p(90)=333.62ms p(95)=342.43ms p(99.9)=738.6ms 
     iterations.....................: 9893    121.276085/s
     success_rate...................: 100.00% ✓ 9893       ✗ 0   
     vus............................: 50      min=0        max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 75a035f into main Oct 30, 2025
34 checks passed
@ardatan ardatan deleted the renovate/bun-1.x branch October 30, 2025 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant