Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Oct 28, 2025

This PR contains the following updates:

Package Change Age Confidence
@types/node (source) 22.18.12 -> 22.18.13 age confidence

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Oct 28, 2025
@github-actions
Copy link

💻 Website Preview

The latest changes are available as preview in: https://3cf87829.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1834 110521 total, 0 failed avg: 27ms, p95: 48ms
grafbase 1642 99101 total, 0 failed avg: 30ms, p95: 51ms
cosmo 676 40887 total, 0 failed avg: 73ms, p95: 108ms
apollo-router 369 22464 total, 0 failed avg: 133ms, p95: 173ms
hive-gateway-bun 312 19084 total, 0 failed avg: 157ms, p95: 200ms
hive-gateway 299 18380 total, 0 failed avg: 163ms, p95: 212ms
apollo-gateway 119 7330 total, 0 failed avg: 410ms, p95: 483ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 331263      ✗ 0     
     data_received..................: 9.7 GB  161 MB/s
     data_sent......................: 129 MB  2.1 MB/s
     http_req_blocked...............: avg=8.47µs   min=1.11µs  med=2.52µs  max=394.21ms p(90)=3.6µs    p(95)=4.16µs   p(99.9)=43.75µs
     http_req_connecting............: avg=1.96µs   min=0s      med=0s      max=8.56ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=26.9ms   min=1.82ms  med=24.4ms  max=423.38ms p(90)=41.85ms  p(95)=48.07ms  p(99.9)=86.23ms
       { expected_response:true }...: avg=26.9ms   min=1.82ms  med=24.4ms  max=423.38ms p(90)=41.85ms  p(95)=48.07ms  p(99.9)=86.23ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 110521
     http_req_receiving.............: avg=114.8µs  min=21.28µs med=40.61µs max=61.9ms   p(90)=102.48µs p(95)=331.43µs p(99.9)=13.36ms
     http_req_sending...............: avg=101.15µs min=5.07µs  med=9.85µs  max=367.3ms  p(90)=29.22µs  p(95)=121.59µs p(99.9)=13.69ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.68ms  min=1.78ms  med=24.24ms max=409.23ms p(90)=41.45ms  p(95)=47.66ms  p(99.9)=83.77ms
     http_reqs......................: 110521  1834.880875/s
     iteration_duration.............: avg=27.16ms  min=3.34ms  med=24.64ms max=446.36ms p(90)=42.1ms   p(95)=48.32ms  p(99.9)=87.4ms 
     iterations.....................: 110421  1833.220664/s
     success_rate...................: 100.00% ✓ 110421      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 297003      ✗ 0    
     data_received..................: 8.7 GB  144 MB/s
     data_sent......................: 115 MB  1.9 MB/s
     http_req_blocked...............: avg=7.47µs   min=967ns   med=2.78µs  max=244.19ms p(90)=4.06µs   p(95)=4.8µs    p(99.9)=106.13µs
     http_req_connecting............: avg=1.68µs   min=0s      med=0s      max=6.56ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=30.03ms  min=2.53ms  med=27.33ms max=435.73ms p(90)=44.36ms  p(95)=50.76ms  p(99.9)=84.02ms 
       { expected_response:true }...: avg=30.03ms  min=2.53ms  med=27.33ms max=435.73ms p(90)=44.36ms  p(95)=50.76ms  p(99.9)=84.02ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 99101
     http_req_receiving.............: avg=124.69µs min=23.16µs med=45.9µs  max=69.87ms  p(90)=110.84µs p(95)=355.06µs p(99.9)=12.49ms 
     http_req_sending...............: avg=99.4µs   min=4.1µs   med=10.25µs max=398.53ms p(90)=24.83µs  p(95)=125.1µs  p(99.9)=13.18ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=29.8ms   min=2.49ms  med=27.17ms max=421.85ms p(90)=43.96ms  p(95)=50.36ms  p(99.9)=82.5ms  
     http_reqs......................: 99101   1642.999129/s
     iteration_duration.............: avg=30.29ms  min=7.89ms  med=27.57ms max=448.38ms p(90)=44.61ms  p(95)=51ms     p(99.9)=85.44ms 
     iterations.....................: 99001   1641.341225/s
     success_rate...................: 100.00% ✓ 99001       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 122361     ✗ 0    
     data_received..................: 3.6 GB  59 MB/s
     data_sent......................: 48 MB   787 kB/s
     http_req_blocked...............: avg=10.23µs  min=1.3µs   med=2.74µs  max=10.32ms  p(90)=3.93µs   p(95)=4.81µs   p(99.9)=2.16ms  
     http_req_connecting............: avg=6.58µs   min=0s      med=0s      max=10.29ms  p(90)=0s       p(95)=0s       p(99.9)=1.93ms  
     http_req_duration..............: avg=73.09ms  min=2.87ms  med=71.89ms max=509.99ms p(90)=99.72ms  p(95)=107.82ms p(99.9)=290.98ms
       { expected_response:true }...: avg=73.09ms  min=2.87ms  med=71.89ms max=509.99ms p(90)=99.72ms  p(95)=107.82ms p(99.9)=290.98ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 40887
     http_req_receiving.............: avg=166.75µs min=27.94µs med=72.28µs max=213.41ms p(90)=152.67µs p(95)=388.35µs p(99.9)=15.75ms 
     http_req_sending...............: avg=71µs     min=5.77µs  med=11.19µs max=261.76ms p(90)=29.47µs  p(95)=124.5µs  p(99.9)=4.03ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=72.85ms  min=2.8ms   med=71.68ms max=489.93ms p(90)=99.48ms  p(95)=107.56ms p(99.9)=283.29ms
     http_reqs......................: 40887   676.649045/s
     iteration_duration.............: avg=73.57ms  min=6.45ms  med=72.22ms max=553.88ms p(90)=100.02ms p(95)=108.12ms p(99.9)=305.93ms
     iterations.....................: 40787   674.99412/s
     success_rate...................: 100.00% ✓ 40787      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 67092      ✗ 0    
     data_received..................: 2.0 GB  32 MB/s
     data_sent......................: 26 MB   430 kB/s
     http_req_blocked...............: avg=13.01µs  min=1.9µs   med=2.96µs   max=7.82ms   p(90)=4.56µs   p(95)=5.27µs   p(99.9)=4.65ms  
     http_req_connecting............: avg=8.95µs   min=0s      med=0s       max=7.79ms   p(90)=0s       p(95)=0s       p(99.9)=4.46ms  
     http_req_duration..............: avg=133.38ms min=6.31ms  med=132.47ms max=630.5ms  p(90)=163.34ms p(95)=172.94ms p(99.9)=451.91ms
       { expected_response:true }...: avg=133.38ms min=6.31ms  med=132.47ms max=630.5ms  p(90)=163.34ms p(95)=172.94ms p(99.9)=451.91ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 22464
     http_req_receiving.............: avg=84.42µs  min=37.74µs med=55.72µs  max=5.89ms   p(90)=109.38µs p(95)=142.75µs p(99.9)=2.2ms   
     http_req_sending...............: avg=81.11µs  min=8.24µs  med=11.78µs  max=311.45ms p(90)=20.57µs  p(95)=38.76µs  p(99.9)=2.72ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=133.21ms min=6.23ms  med=132.38ms max=629.24ms p(90)=163.21ms p(95)=172.77ms p(99.9)=435.37ms
     http_reqs......................: 22464   369.260732/s
     iteration_duration.............: avg=134.29ms min=26.26ms med=132.87ms max=655.44ms p(90)=163.66ms p(95)=173.32ms p(99.9)=465.8ms 
     iterations.....................: 22364   367.616943/s
     success_rate...................: 100.00% ✓ 22364      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 56952      ✗ 0    
     data_received..................: 1.7 GB  27 MB/s
     data_sent......................: 22 MB   363 kB/s
     http_req_blocked...............: avg=16.38µs  min=985ns   med=2.85µs   max=9.55ms   p(90)=4.71µs   p(95)=6.02µs   p(99.9)=6.41ms  
     http_req_connecting............: avg=12.73µs  min=0s      med=0s       max=9.51ms   p(90)=0s       p(95)=0s       p(99.9)=6.38ms  
     http_req_duration..............: avg=157.04ms min=7.25ms  med=146.57ms max=700.86ms p(90)=172.79ms p(95)=199.99ms p(99.9)=501.15ms
       { expected_response:true }...: avg=157.04ms min=7.25ms  med=146.57ms max=700.86ms p(90)=172.79ms p(95)=199.99ms p(99.9)=501.15ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 19084
     http_req_receiving.............: avg=104.29µs min=21.04µs med=49.57µs  max=199.91ms p(90)=97.68µs  p(95)=148.36µs p(99.9)=4ms     
     http_req_sending...............: avg=120.44µs min=4.34µs  med=10.6µs   max=282.38ms p(90)=21.93µs  p(95)=119.71µs p(99.9)=4.87ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=156.82ms min=7.2ms   med=146.44ms max=679.97ms p(90)=172.67ms p(95)=199.45ms p(99.9)=491.44ms
     http_reqs......................: 19084   312.006733/s
     iteration_duration.............: avg=158.14ms min=30.22ms med=146.91ms max=720.83ms p(90)=173.17ms p(95)=200.81ms p(99.9)=516.42ms
     iterations.....................: 18984   310.371821/s
     success_rate...................: 100.00% ✓ 18984      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 54840      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   349 kB/s
     http_req_blocked...............: avg=19.38µs  min=1.24µs  med=2.73µs   max=11.65ms  p(90)=4.42µs   p(95)=5.44µs   p(99.9)=7.13ms  
     http_req_connecting............: avg=15.47µs  min=0s      med=0s       max=11.58ms  p(90)=0s       p(95)=0s       p(99.9)=7.09ms  
     http_req_duration..............: avg=163.17ms min=6.75ms  med=151.11ms max=708.52ms p(90)=180.3ms  p(95)=212.33ms p(99.9)=521.05ms
       { expected_response:true }...: avg=163.17ms min=6.75ms  med=151.11ms max=708.52ms p(90)=180.3ms  p(95)=212.33ms p(99.9)=521.05ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18380
     http_req_receiving.............: avg=101.49µs min=25.67µs med=47.96µs  max=91.62ms  p(90)=106.84µs p(95)=194.38µs p(99.9)=5.13ms  
     http_req_sending...............: avg=71.83µs  min=5.46µs  med=11.3µs   max=163.99ms p(90)=32.67µs  p(95)=127.59µs p(99.9)=4.84ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=162.99ms min=6.68ms  med=150.95ms max=676.18ms p(90)=180.13ms p(95)=212.19ms p(99.9)=520.91ms
     http_reqs......................: 18380   299.803297/s
     iteration_duration.............: avg=164.44ms min=40.69ms med=151.5ms  max=751.41ms p(90)=180.74ms p(95)=214.07ms p(99.9)=527.78ms
     iterations.....................: 18280   298.172159/s
     success_rate...................: 100.00% ✓ 18280      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21690      ✗ 0   
     data_received..................: 644 MB  11 MB/s
     data_sent......................: 8.5 MB  140 kB/s
     http_req_blocked...............: avg=44.12µs  min=1.31µs  med=3.11µs   max=12.27ms  p(90)=4.67µs   p(95)=5.42µs   p(99.9)=10.49ms 
     http_req_connecting............: avg=40.44µs  min=0s      med=0s       max=12.2ms   p(90)=0s       p(95)=0s       p(99.9)=10.46ms 
     http_req_duration..............: avg=409.85ms min=7.49ms  med=410.38ms max=768ms    p(90)=464.9ms  p(95)=483.1ms  p(99.9)=676.44ms
       { expected_response:true }...: avg=409.85ms min=7.49ms  med=410.38ms max=768ms    p(90)=464.9ms  p(95)=483.1ms  p(99.9)=676.44ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7330
     http_req_receiving.............: avg=71.88µs  min=29.44µs med=53.97µs  max=56.75ms  p(90)=94.58µs  p(95)=109.09µs p(99.9)=757.84µs
     http_req_sending...............: avg=117.29µs min=6.34µs  med=12.56µs  max=296.08ms p(90)=19.03µs  p(95)=23.45µs  p(99.9)=4.55ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=409.66ms min=7.41ms  med=410.27ms max=758.72ms p(90)=464.76ms p(95)=483.01ms p(99.9)=675.18ms
     http_reqs......................: 7330    119.94255/s
     iteration_duration.............: avg=415.92ms min=51.68ms med=411.13ms max=792.62ms p(90)=465.53ms p(95)=484.01ms p(99.9)=746.04ms
     iterations.....................: 7230    118.306226/s
     success_rate...................: 100.00% ✓ 7230       ✗ 0   
     vus............................: 32      min=32       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1826 113639 total, 0 failed avg: 122ms, p95: 298ms
grafbase 1652 104334 total, 0 failed avg: 133ms, p95: 317ms
cosmo 696 44423 total, 0 failed avg: 316ms, p95: 696ms
apollo-router 386 26015 total, 0 failed avg: 542ms, p95: 1251ms ❌ 17 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway 262 18232 total, 0 failed avg: 769ms, p95: 1673ms
hive-gateway-bun 254 17689 total, 0 failed avg: 792ms, p95: 1726ms
apollo-gateway 157 10820 total, 0 failed avg: 1205ms, p95: 2565ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 337917      ✗ 0     
     data_received..................: 10 GB   160 MB/s
     data_sent......................: 132 MB  2.1 MB/s
     http_req_blocked...............: avg=525.64µs min=1.14µs  med=2.61µs   max=343.75ms p(90)=3.96µs   p(95)=4.6µs    p(99.9)=181.75ms
     http_req_connecting............: avg=522.32µs min=0s      med=0s       max=343.69ms p(90)=0s       p(95)=0s       p(99.9)=181.64ms
     http_req_duration..............: avg=122.48ms min=1.84ms  med=112.05ms max=433.7ms  p(90)=249.05ms p(95)=298.09ms p(99.9)=377.49ms
       { expected_response:true }...: avg=122.48ms min=1.84ms  med=112.05ms max=433.7ms  p(90)=249.05ms p(95)=298.09ms p(99.9)=377.49ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 113639
     http_req_receiving.............: avg=540.24µs min=21.11µs med=41.31µs  max=134.39ms p(90)=102.36µs p(95)=393.47µs p(99.9)=74.06ms 
     http_req_sending...............: avg=457.88µs min=4.92µs  med=10.29µs  max=142.19ms p(90)=22.63µs  p(95)=127.76µs p(99.9)=72.8ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=121.48ms min=1.72ms  med=111ms    max=392.22ms p(90)=246.95ms p(95)=296.01ms p(99.9)=373.53ms
     http_reqs......................: 113639  1826.115886/s
     iteration_duration.............: avg=124.39ms min=2.08ms  med=113.86ms max=729.92ms p(90)=251.59ms p(95)=300.65ms p(99.9)=431.18ms
     iterations.....................: 112639  1810.046439/s
     success_rate...................: 100.00% ✓ 112639      ✗ 0     
     vus............................: 70      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 310002      ✗ 0     
     data_received..................: 9.2 GB  145 MB/s
     data_sent......................: 121 MB  1.9 MB/s
     http_req_blocked...............: avg=505.69µs min=1.03µs  med=2.85µs   max=358.2ms  p(90)=4.38µs   p(95)=5.14µs   p(99.9)=176.45ms
     http_req_connecting............: avg=501.3µs  min=0s      med=0s       max=358.08ms p(90)=0s       p(95)=0s       p(99.9)=176.36ms
     http_req_duration..............: avg=133.48ms min=2.51ms  med=121.32ms max=470.58ms p(90)=268.71ms p(95)=316.56ms p(99.9)=418.8ms 
       { expected_response:true }...: avg=133.48ms min=2.51ms  med=121.32ms max=470.58ms p(90)=268.71ms p(95)=316.56ms p(99.9)=418.8ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 104334
     http_req_receiving.............: avg=552.15µs min=22.88µs med=47.68µs  max=162.8ms  p(90)=138.48µs p(95)=428.1µs  p(99.9)=81.36ms 
     http_req_sending...............: avg=454.89µs min=4.13µs  med=10.71µs  max=135.18ms p(90)=23.57µs  p(95)=136.28µs p(99.9)=71.5ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=132.48ms min=2.46ms  med=120.51ms max=456ms    p(90)=266.49ms p(95)=314.4ms  p(99.9)=415.75ms
     http_reqs......................: 104334  1652.371713/s
     iteration_duration.............: avg=135.6ms  min=3.24ms  med=123.12ms max=784.83ms p(90)=271.24ms p(95)=319.36ms p(99.9)=453.31ms
     iterations.....................: 103334  1636.534385/s
     success_rate...................: 100.00% ✓ 103334      ✗ 0     
     vus............................: 65      min=0         max=496 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 130269     ✗ 0    
     data_received..................: 3.9 GB  61 MB/s
     data_sent......................: 52 MB   811 kB/s
     http_req_blocked...............: avg=118.49µs min=1.41µs  med=2.96µs   max=137.35ms p(90)=4.39µs   p(95)=6.1µs    p(99.9)=40.89ms 
     http_req_connecting............: avg=113.83µs min=0s      med=0s       max=137.11ms p(90)=0s       p(95)=0s       p(99.9)=40.83ms 
     http_req_duration..............: avg=316.1ms  min=2.81ms  med=301.85ms max=1.14s    p(90)=616.24ms p(95)=695.67ms p(99.9)=991.03ms
       { expected_response:true }...: avg=316.1ms  min=2.81ms  med=301.85ms max=1.14s    p(90)=616.24ms p(95)=695.67ms p(99.9)=991.03ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 44423
     http_req_receiving.............: avg=1.22ms   min=28.08µs med=59.75µs  max=338.58ms p(90)=252.58µs p(95)=495.37µs p(99.9)=209.25ms
     http_req_sending...............: avg=190.51µs min=5.87µs  med=11.25µs  max=119.19ms p(90)=34.16µs  p(95)=134.76µs p(99.9)=36.22ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=314.68ms min=2.76ms  med=301.23ms max=1.14s    p(90)=614.72ms p(95)=689.86ms p(99.9)=965.45ms
     http_reqs......................: 44423   696.740724/s
     iteration_duration.............: avg=323.92ms min=3.08ms  med=309.81ms max=1.14s    p(90)=619.57ms p(95)=700.18ms p(99.9)=993.32ms
     iterations.....................: 43423   681.05649/s
     success_rate...................: 100.00% ✓ 43423      ✗ 0    
     vus............................: 98      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 24998 / ✗ 17
     ✗ valid response structure
      ↳  99% — ✓ 25014 / ✗ 1

     checks.........................: 99.97% ✓ 75027      ✗ 18   
     data_received..................: 2.3 GB 34 MB/s
     data_sent......................: 30 MB  451 kB/s
     http_req_blocked...............: avg=115.04µs min=1.36µs  med=3.1µs    max=134.94ms p(90)=5.2µs    p(95)=8.21µs   p(99.9)=38.3ms 
     http_req_connecting............: avg=109.57µs min=0s      med=0s       max=134.87ms p(90)=0s       p(95)=0s       p(99.9)=38.25ms
     http_req_duration..............: avg=541.74ms min=6.15ms  med=500.73ms max=2.1s     p(90)=1.11s    p(95)=1.25s    p(99.9)=1.83s  
       { expected_response:true }...: avg=541.74ms min=6.15ms  med=500.73ms max=2.1s     p(90)=1.11s    p(95)=1.25s    p(99.9)=1.83s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26015
     http_req_receiving.............: avg=140.23µs min=28.64µs med=55.97µs  max=56.31ms  p(90)=114.97µs p(95)=317.16µs p(99.9)=15.31ms
     http_req_sending...............: avg=147.54µs min=5.95µs  med=12.01µs  max=111.94ms p(90)=33.03µs  p(95)=131.65µs p(99.9)=30.34ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=541.46ms min=6.11ms  med=500.44ms max=2.1s     p(90)=1.11s    p(95)=1.25s    p(99.9)=1.83s  
     http_reqs......................: 26015  386.4076/s
     iteration_duration.............: avg=563.9ms  min=6.55ms  med=525.42ms max=2.1s     p(90)=1.12s    p(95)=1.25s    p(99.9)=1.83s  
     iterations.....................: 25015  371.554338/s
     success_rate...................: 99.93% ✓ 24998      ✗ 17   
     vus............................: 78     min=0        max=495
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51696      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   308 kB/s
     http_req_blocked...............: avg=127.89µs min=1.26µs med=2.78µs   max=100.05ms p(90)=4.48µs  p(95)=7.09µs   p(99.9)=32.26ms
     http_req_connecting............: avg=121.07µs min=0s     med=0s       max=99.98ms  p(90)=0s      p(95)=0s       p(99.9)=32.2ms 
     http_req_duration..............: avg=768.79ms min=6.91ms med=715.06ms max=5.03s    p(90)=1.52s   p(95)=1.67s    p(99.9)=4.36s  
       { expected_response:true }...: avg=768.79ms min=6.91ms med=715.06ms max=5.03s    p(90)=1.52s   p(95)=1.67s    p(99.9)=4.36s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18232
     http_req_receiving.............: avg=175.92µs min=26.4µs med=43.82µs  max=84.78ms  p(90)=88.67µs p(95)=156.52µs p(99.9)=25.91ms
     http_req_sending...............: avg=185.74µs min=5.65µs med=11.01µs  max=107.38ms p(90)=30.63µs p(95)=113.28µs p(99.9)=32.86ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=768.43ms min=6.71ms med=714.57ms max=5.03s    p(90)=1.52s   p(95)=1.67s    p(99.9)=4.36s  
     http_reqs......................: 18232   262.73746/s
     iteration_duration.............: avg=813.75ms min=7.1ms  med=763.31ms max=5.04s    p(90)=1.53s   p(95)=1.68s    p(99.9)=4.39s  
     iterations.....................: 17232   248.326673/s
     success_rate...................: 100.00% ✓ 17232      ✗ 0    
     vus............................: 86      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 50067      ✗ 0    
     data_received..................: 1.6 GB  22 MB/s
     data_sent......................: 21 MB   298 kB/s
     http_req_blocked...............: avg=157.62µs min=1.26µs  med=2.82µs   max=217.98ms p(90)=4.89µs   p(95)=7.94µs   p(99.9)=41.44ms
     http_req_connecting............: avg=152.13µs min=0s      med=0s       max=217.92ms p(90)=0s       p(95)=0s       p(99.9)=41.38ms
     http_req_duration..............: avg=791.57ms min=6.88ms  med=739.52ms max=5.21s    p(90)=1.58s    p(95)=1.72s    p(99.9)=4.25s  
       { expected_response:true }...: avg=791.57ms min=6.88ms  med=739.52ms max=5.21s    p(90)=1.58s    p(95)=1.72s    p(99.9)=4.25s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17689
     http_req_receiving.............: avg=201.78µs min=28.22µs med=46.48µs  max=186.09ms p(90)=101.81µs p(95)=269.56µs p(99.9)=32.06ms
     http_req_sending...............: avg=273.7µs  min=6.06µs  med=11.29µs  max=212.04ms p(90)=33.37µs  p(95)=134.61µs p(99.9)=50.16ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=791.1ms  min=6.8ms   med=739.11ms max=5.21s    p(90)=1.58s    p(95)=1.72s    p(99.9)=4.25s  
     http_reqs......................: 17689   254.190177/s
     iteration_duration.............: avg=839.44ms min=7.55ms  med=792.02ms max=5.23s    p(90)=1.6s     p(95)=1.73s    p(99.9)=4.29s  
     iterations.....................: 16689   239.82022/s
     success_rate...................: 100.00% ✓ 16689      ✗ 0    
     vus............................: 96      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29460      ✗ 0    
     data_received..................: 950 MB  14 MB/s
     data_sent......................: 13 MB   188 kB/s
     http_req_blocked...............: avg=28.76µs min=1.32µs  med=3.39µs  max=14.98ms p(90)=5.32µs  p(95)=11.51µs  p(99.9)=3.83ms
     http_req_connecting............: avg=22.62µs min=0s      med=0s      max=14.93ms p(90)=0s      p(95)=0s       p(99.9)=3.78ms
     http_req_duration..............: avg=1.2s    min=7.42ms  med=1.14s   max=15.56s  p(90)=2.18s   p(95)=2.56s    p(99.9)=14.15s
       { expected_response:true }...: avg=1.2s    min=7.42ms  med=1.14s   max=15.56s  p(90)=2.18s   p(95)=2.56s    p(99.9)=14.15s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10820
     http_req_receiving.............: avg=75.46µs min=27.54µs med=54.85µs max=16.64ms p(90)=99.09µs p(95)=122.26µs p(99.9)=1.31ms
     http_req_sending...............: avg=41.01µs min=5.96µs  med=12.7µs  max=21.91ms p(90)=29.43µs p(95)=45.2µs   p(99.9)=6.4ms 
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.2s    min=7.36ms  med=1.14s   max=15.56s  p(90)=2.18s   p(95)=2.56s    p(99.9)=14.15s
     http_reqs......................: 10820   157.66341/s
     iteration_duration.............: avg=1.32s   min=7.74ms  med=1.31s   max=15.59s  p(90)=2.22s   p(95)=2.66s    p(99.9)=14.3s 
     iterations.....................: 9820    143.091931/s
     success_rate...................: 100.00% ✓ 9820       ✗ 0    
     vus............................: 105     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13995 total, 0 failed avg: 216ms, p95: 227ms
cosmo 168 13643 total, 0 failed avg: 221ms, p95: 241ms
hive-router 168 13695 total, 0 failed avg: 220ms, p95: 231ms
hive-gateway 159 12209 total, 0 failed avg: 247ms, p95: 285ms
hive-gateway-bun 159 12193 total, 0 failed avg: 248ms, p95: 296ms
apollo-router 141 11516 total, 0 failed avg: 262ms, p95: 305ms ❌ 1 unexpected GraphQL errors
apollo-gateway 127 10443 total, 0 failed avg: 290ms, p95: 325ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41685      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=20.17µs  min=1.21µs   med=1.97µs   max=9.21ms   p(90)=3.68µs   p(95)=5.43µs   p(99.9)=6.97ms  
     http_req_connecting............: avg=16.8µs   min=0s       med=0s       max=9.18ms   p(90)=0s       p(95)=0s       p(99.9)=6.8ms   
     http_req_duration..............: avg=215.94ms min=157ms    med=215.12ms max=609.09ms p(90)=224.63ms p(95)=227.48ms p(99.9)=531.86ms
       { expected_response:true }...: avg=215.94ms min=157ms    med=215.12ms max=609.09ms p(90)=224.63ms p(95)=227.48ms p(99.9)=531.86ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13995
     http_req_receiving.............: avg=83.72µs  min=28.16µs  med=48.66µs  max=12.69ms  p(90)=102.69µs p(95)=263.66µs p(99.9)=2.93ms  
     http_req_sending...............: avg=134.29µs min=5.57µs   med=8.71µs   max=388.86ms p(90)=28.4µs   p(95)=105.76µs p(99.9)=7.94ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.72ms min=156.9ms  med=215.01ms max=607.57ms p(90)=224.48ms p(95)=227.27ms p(99.9)=494.96ms
     http_reqs......................: 13995   172.810135/s
     iteration_duration.............: avg=216.24ms min=157.32ms med=215.38ms max=636.41ms p(90)=224.86ms p(95)=227.7ms  p(99.9)=545.11ms
     iterations.....................: 13895   171.575336/s
     success_rate...................: 100.00% ✓ 13895      ✗ 0    
     vus............................: 27      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40629      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=20.55µs  min=1.24µs   med=2.6µs    max=9.12ms   p(90)=3.79µs   p(95)=4.72µs   p(99.9)=6.82ms  
     http_req_connecting............: avg=17.29µs  min=0s       med=0s       max=9.09ms   p(90)=0s       p(95)=0s       p(99.9)=6.8ms   
     http_req_duration..............: avg=221.42ms min=127.74ms med=220.29ms max=631.72ms p(90)=235.46ms p(95)=240.6ms  p(99.9)=518.75ms
       { expected_response:true }...: avg=221.42ms min=127.74ms med=220.29ms max=631.72ms p(90)=235.46ms p(95)=240.6ms  p(99.9)=518.75ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13643
     http_req_receiving.............: avg=400µs    min=28.59µs  med=59.85µs  max=89.61ms  p(90)=332.64µs p(95)=776.52µs p(99.9)=23.66ms 
     http_req_sending...............: avg=111.7µs  min=5.81µs   med=11.04µs  max=312.72ms p(90)=31.06µs  p(95)=126.36µs p(99.9)=3.67ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.91ms min=127.6ms  med=219.85ms max=630.91ms p(90)=234.94ms p(95)=239.98ms p(99.9)=505.94ms
     http_reqs......................: 13643   168.426149/s
     iteration_duration.............: avg=221.87ms min=127.97ms med=220.62ms max=654.52ms p(90)=235.78ms p(95)=240.94ms p(99.9)=542.83ms
     iterations.....................: 13543   167.191625/s
     success_rate...................: 100.00% ✓ 13543      ✗ 0    
     vus............................: 13      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40785      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   197 kB/s
     http_req_blocked...............: avg=21µs     min=1.15µs   med=1.99µs   max=10.13ms  p(90)=3.32µs   p(95)=4.63µs   p(99.9)=7.37ms  
     http_req_connecting............: avg=18.45µs  min=0s       med=0s       max=10.1ms   p(90)=0s       p(95)=0s       p(99.9)=7.34ms  
     http_req_duration..............: avg=220.41ms min=159.19ms med=219.4ms  max=608.24ms p(90)=228.1ms  p(95)=230.84ms p(99.9)=522.91ms
       { expected_response:true }...: avg=220.41ms min=159.19ms med=219.4ms  max=608.24ms p(90)=228.1ms  p(95)=230.84ms p(99.9)=522.91ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13695
     http_req_receiving.............: avg=99.07µs  min=23.94µs  med=43.32µs  max=278.05ms p(90)=93.36µs  p(95)=248.14µs p(99.9)=4.38ms  
     http_req_sending...............: avg=125.99µs min=5.58µs   med=8.49µs   max=370.84ms p(90)=29.16µs  p(95)=97.35µs  p(99.9)=6.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.18ms min=159.15ms med=219.3ms  max=601.8ms  p(90)=227.96ms p(95)=230.65ms p(99.9)=493.08ms
     http_reqs......................: 13695   168.975969/s
     iteration_duration.............: avg=220.76ms min=159.32ms med=219.66ms max=629.33ms p(90)=228.3ms  p(95)=231.02ms p(99.9)=544.55ms
     iterations.....................: 13595   167.742118/s
     success_rate...................: 100.00% ✓ 13595      ✗ 0    
     vus............................: 7       min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36327      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   186 kB/s
     http_req_blocked...............: avg=27.32µs  min=1.2µs    med=2.59µs   max=11.41ms  p(90)=4.3µs    p(95)=5.71µs   p(99.9)=8.73ms  
     http_req_connecting............: avg=23.71µs  min=0s       med=0s       max=11.37ms  p(90)=0s       p(95)=0s       p(99.9)=8.71ms  
     http_req_duration..............: avg=246.98ms min=160.33ms med=238.58ms max=827.41ms p(90)=263.96ms p(95)=285.3ms  p(99.9)=701ms   
       { expected_response:true }...: avg=246.98ms min=160.33ms med=238.58ms max=827.41ms p(90)=263.96ms p(95)=285.3ms  p(99.9)=701ms   
     http_req_failed................: 0.00%   ✓ 0          ✗ 12209
     http_req_receiving.............: avg=103.24µs min=26.61µs  med=48.21µs  max=172.88ms p(90)=104.97µs p(95)=176.97µs p(99.9)=3.74ms  
     http_req_sending...............: avg=74µs     min=5.36µs   med=10.65µs  max=205.96ms p(90)=30.33µs  p(95)=116.24µs p(99.9)=5.07ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=246.8ms  min=160.23ms med=238.46ms max=826.66ms p(90)=263.76ms p(95)=285.09ms p(99.9)=700.8ms 
     http_reqs......................: 12209   159.653667/s
     iteration_duration.............: avg=248.12ms min=170.45ms med=239.04ms max=859.19ms p(90)=264.38ms p(95)=286.13ms p(99.9)=741.92ms
     iterations.....................: 12109   158.345995/s
     success_rate...................: 100.00% ✓ 12109      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36279      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   185 kB/s
     http_req_blocked...............: avg=26.19µs  min=1.1µs    med=2.52µs   max=10.85ms  p(90)=3.97µs   p(95)=4.98µs   p(99.9)=8.43ms  
     http_req_connecting............: avg=22.99µs  min=0s       med=0s       max=10.8ms   p(90)=0s       p(95)=0s       p(99.9)=8.4ms   
     http_req_duration..............: avg=247.59ms min=155.93ms med=237.69ms max=980.58ms p(90)=277.21ms p(95)=295.83ms p(99.9)=755.03ms
       { expected_response:true }...: avg=247.59ms min=155.93ms med=237.69ms max=980.58ms p(90)=277.21ms p(95)=295.83ms p(99.9)=755.03ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12193
     http_req_receiving.............: avg=83.93µs  min=24.4µs   med=43.52µs  max=6.85ms   p(90)=97.3µs   p(95)=265.91µs p(99.9)=3.55ms  
     http_req_sending...............: avg=123.37µs min=5.18µs   med=10.64µs  max=318.59ms p(90)=32.71µs  p(95)=123.23µs p(99.9)=6.11ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=247.38ms min=151.89ms med=237.51ms max=980.52ms p(90)=277.04ms p(95)=295.42ms p(99.9)=754.69ms
     http_reqs......................: 12193   159.357165/s
     iteration_duration.............: avg=248.64ms min=156.17ms med=238.37ms max=980.87ms p(90)=277.55ms p(95)=296.77ms p(99.9)=755.58ms
     iterations.....................: 12093   158.050209/s
     success_rate...................: 100.00% ✓ 12093      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 11415 / ✗ 1
     ✓ valid response structure

     checks.........................: 99.99% ✓ 34247      ✗ 1    
     data_received..................: 1.0 GB 12 MB/s
     data_sent......................: 13 MB  164 kB/s
     http_req_blocked...............: avg=26.88µs  min=1.69µs   med=2.78µs   max=10.39ms  p(90)=4.24µs   p(95)=5.2µs    p(99.9)=8.2ms   
     http_req_connecting............: avg=22.81µs  min=0s       med=0s       max=10.35ms  p(90)=0s       p(95)=0s       p(99.9)=8.18ms  
     http_req_duration..............: avg=262.4ms  min=169.8ms  med=259.57ms max=689.79ms p(90)=294.87ms p(95)=304.67ms p(99.9)=591.48ms
       { expected_response:true }...: avg=262.4ms  min=169.8ms  med=259.57ms max=689.79ms p(90)=294.87ms p(95)=304.67ms p(99.9)=591.48ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 11516
     http_req_receiving.............: avg=115.92µs min=33.21µs  med=52.78µs  max=11.67ms  p(90)=148.32µs p(95)=410.63µs p(99.9)=4.37ms  
     http_req_sending...............: avg=67.05µs  min=7.4µs    med=11.19µs  max=128.29ms p(90)=36.28µs  p(95)=138.58µs p(99.9)=4.3ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=262.22ms min=169.74ms med=259.39ms max=688.48ms p(90)=294.63ms p(95)=304.5ms  p(99.9)=590.3ms 
     http_reqs......................: 11516  141.309607/s
     iteration_duration.............: avg=263.25ms min=170.03ms med=260.2ms  max=703.15ms p(90)=295.39ms p(95)=305.22ms p(99.9)=641.18ms
     iterations.....................: 11416  140.082535/s
     success_rate...................: 99.99% ✓ 11415      ✗ 1    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 31029      ✗ 0    
     data_received..................: 917 MB  11 MB/s
     data_sent......................: 12 MB   149 kB/s
     http_req_blocked...............: avg=23.15µs  min=1.17µs   med=3.47µs   max=8.09ms   p(90)=5.17µs   p(95)=6.02µs   p(99.9)=6.15ms  
     http_req_connecting............: avg=18.54µs  min=0s       med=0s       max=8.06ms   p(90)=0s       p(95)=0s       p(99.9)=6.13ms  
     http_req_duration..............: avg=289.52ms min=211.75ms med=287.03ms max=752.7ms  p(90)=313.04ms p(95)=324.98ms p(99.9)=666.44ms
       { expected_response:true }...: avg=289.52ms min=211.75ms med=287.03ms max=752.7ms  p(90)=313.04ms p(95)=324.98ms p(99.9)=666.44ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10443
     http_req_receiving.............: avg=78.24µs  min=26.42µs  med=59.53µs  max=6.01ms   p(90)=102.73µs p(95)=125.94µs p(99.9)=1.6ms   
     http_req_sending...............: avg=79.85µs  min=5.26µs   med=13µs     max=162.72ms p(90)=21.9µs   p(95)=29.42µs  p(99.9)=3.43ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=289.37ms min=211.52ms med=286.93ms max=752.04ms p(90)=312.79ms p(95)=324.85ms p(99.9)=665.8ms 
     http_reqs......................: 10443   127.90561/s
     iteration_duration.............: avg=290.69ms min=220.73ms med=287.51ms max=774.71ms p(90)=313.5ms  p(95)=325.41ms p(99.9)=721.86ms
     iterations.....................: 10343   126.680812/s
     success_rate...................: 100.00% ✓ 10343      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14027 total, 0 failed avg: 216ms, p95: 227ms
hive-router 167 13533 total, 0 failed avg: 223ms, p95: 236ms
cosmo 155 12645 total, 0 failed avg: 239ms, p95: 265ms
hive-gateway 149 11433 total, 0 failed avg: 264ms, p95: 372ms
hive-gateway-bun 134 10313 total, 0 failed avg: 293ms, p95: 415ms
apollo-router 123 10037 total, 0 failed avg: 301ms, p95: 344ms
apollo-gateway 87 7146 total, 0 failed avg: 424ms, p95: 465ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41781      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=19.37µs  min=1.16µs   med=1.89µs   max=9.15ms   p(90)=3.22µs   p(95)=4.37µs   p(99.9)=6.68ms  
     http_req_connecting............: avg=16.42µs  min=0s       med=0s       max=9.12ms   p(90)=0s       p(95)=0s       p(99.9)=6.66ms  
     http_req_duration..............: avg=215.6ms  min=156.77ms med=214.74ms max=605.33ms p(90)=224.34ms p(95)=227.13ms p(99.9)=502.17ms
       { expected_response:true }...: avg=215.6ms  min=156.77ms med=214.74ms max=605.33ms p(90)=224.34ms p(95)=227.13ms p(99.9)=502.17ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14027
     http_req_receiving.............: avg=80.05µs  min=25.63µs  med=44.18µs  max=13.55ms  p(90)=85.9µs   p(95)=235.54µs p(99.9)=6.09ms  
     http_req_sending...............: avg=111.26µs min=5.62µs   med=8.4µs    max=370.54ms p(90)=28.7µs   p(95)=93.34µs  p(99.9)=8.73ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.41ms min=156.72ms med=214.63ms max=604.14ms p(90)=224.18ms p(95)=226.95ms p(99.9)=489.98ms
     http_reqs......................: 14027   173.083412/s
     iteration_duration.............: avg=215.91ms min=156.98ms med=215.01ms max=623.09ms p(90)=224.57ms p(95)=227.34ms p(99.9)=525.29ms
     iterations.....................: 13927   171.849481/s
     success_rate...................: 100.00% ✓ 13927      ✗ 0    
     vus............................: 35      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40299      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=21.94µs  min=1.21µs   med=2.27µs   max=10.58ms  p(90)=3.45µs   p(95)=4.77µs   p(99.9)=7.75ms  
     http_req_connecting............: avg=19.18µs  min=0s       med=0s       max=10.54ms  p(90)=0s       p(95)=0s       p(99.9)=7.72ms  
     http_req_duration..............: avg=223.3ms  min=118.86ms med=222.32ms max=608.25ms p(90)=232.53ms p(95)=235.75ms p(99.9)=504.81ms
       { expected_response:true }...: avg=223.3ms  min=118.86ms med=222.32ms max=608.25ms p(90)=232.53ms p(95)=235.75ms p(99.9)=504.81ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13533
     http_req_receiving.............: avg=78.81µs  min=26.94µs  med=44.97µs  max=11.16ms  p(90)=93.34µs  p(95)=255.25µs p(99.9)=2.84ms  
     http_req_sending...............: avg=90.28µs  min=5.59µs   med=9.43µs   max=178.03ms p(90)=29.79µs  p(95)=102.56µs p(99.9)=5.22ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.13ms min=115.85ms med=222.21ms max=607.31ms p(90)=232.43ms p(95)=235.53ms p(99.9)=503.33ms
     http_reqs......................: 13533   167.19798/s
     iteration_duration.............: avg=223.69ms min=119.16ms med=222.58ms max=621.43ms p(90)=232.73ms p(95)=235.95ms p(99.9)=532.91ms
     iterations.....................: 13433   165.962497/s
     success_rate...................: 100.00% ✓ 13433      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37635      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   181 kB/s
     http_req_blocked...............: avg=23.45µs  min=1.57µs   med=2.75µs   max=10.15ms  p(90)=4.07µs   p(95)=5.26µs   p(99.9)=7.63ms  
     http_req_connecting............: avg=19.99µs  min=0s       med=0s       max=10.12ms  p(90)=0s       p(95)=0s       p(99.9)=7.61ms  
     http_req_duration..............: avg=239.41ms min=131.54ms med=238.87ms max=689.69ms p(90)=259.94ms p(95)=265.4ms  p(99.9)=579.74ms
       { expected_response:true }...: avg=239.41ms min=131.54ms med=238.87ms max=689.69ms p(90)=259.94ms p(95)=265.4ms  p(99.9)=579.74ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12645
     http_req_receiving.............: avg=361.52µs min=32.72µs  med=61.83µs  max=40.67ms  p(90)=172.18µs p(95)=482.99µs p(99.9)=31.09ms 
     http_req_sending...............: avg=100.24µs min=6.65µs   med=10.82µs  max=272.6ms  p(90)=28.28µs  p(95)=120.3µs  p(99.9)=4.49ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=238.95ms min=127.78ms med=238.44ms max=688.5ms  p(90)=259.22ms p(95)=264.76ms p(99.9)=578.42ms
     http_reqs......................: 12645   155.771435/s
     iteration_duration.............: avg=239.98ms min=131.78ms med=239.26ms max=705.68ms p(90)=260.26ms p(95)=265.74ms p(99.9)=593.28ms
     iterations.....................: 12545   154.539553/s
     success_rate...................: 100.00% ✓ 12545      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33999      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   174 kB/s
     http_req_blocked...............: avg=28.38µs  min=1.18µs   med=2.63µs   max=11.14ms  p(90)=4.02µs   p(95)=5.21µs   p(99.9)=8.72ms  
     http_req_connecting............: avg=25µs     min=0s       med=0s       max=11.09ms  p(90)=0s       p(95)=0s       p(99.9)=8.69ms  
     http_req_duration..............: avg=263.76ms min=159.39ms med=254.59ms max=795.68ms p(90)=272.12ms p(95)=372.22ms p(99.9)=652.44ms
       { expected_response:true }...: avg=263.76ms min=159.39ms med=254.59ms max=795.68ms p(90)=272.12ms p(95)=372.22ms p(99.9)=652.44ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11433
     http_req_receiving.............: avg=85.19µs  min=24.35µs  med=44.12µs  max=9.74ms   p(90)=94.36µs  p(95)=347.81µs p(99.9)=2.35ms  
     http_req_sending...............: avg=141.57µs min=5.4µs    med=10.7µs   max=279.59ms p(90)=34.35µs  p(95)=142.3µs  p(99.9)=6.57ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=263.53ms min=159.27ms med=254.47ms max=794.98ms p(90)=271.93ms p(95)=371.76ms p(99.9)=651.42ms
     http_reqs......................: 11433   149.861587/s
     iteration_duration.............: avg=265.09ms min=191.46ms med=254.96ms max=818.3ms  p(90)=272.56ms p(95)=373.26ms p(99.9)=752.48ms
     iterations.....................: 11333   148.550806/s
     success_rate...................: 100.00% ✓ 11333      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30639      ✗ 0    
     data_received..................: 906 MB  12 MB/s
     data_sent......................: 12 MB   156 kB/s
     http_req_blocked...............: avg=35.19µs  min=1.19µs   med=2.89µs   max=12.75ms  p(90)=4.94µs   p(95)=6.76µs   p(99.9)=10.11ms 
     http_req_connecting............: avg=31.35µs  min=0s       med=0s       max=12.71ms  p(90)=0s       p(95)=0s       p(99.9)=10.08ms 
     http_req_duration..............: avg=292.9ms  min=160.96ms med=285.5ms  max=928.48ms p(90)=324.09ms p(95)=415.45ms p(99.9)=813.81ms
       { expected_response:true }...: avg=292.9ms  min=160.96ms med=285.5ms  max=928.48ms p(90)=324.09ms p(95)=415.45ms p(99.9)=813.81ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10313
     http_req_receiving.............: avg=100.24µs min=26.81µs  med=52.01µs  max=10.7ms   p(90)=122.48µs p(95)=376.57µs p(99.9)=2.8ms   
     http_req_sending...............: avg=100.71µs min=5.61µs   med=11.49µs  max=216.35ms p(90)=36.96µs  p(95)=160.93µs p(99.9)=5.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=292.69ms min=160.81ms med=285.39ms max=928.12ms p(90)=323.9ms  p(95)=415.08ms p(99.9)=812.7ms 
     http_reqs......................: 10313   134.331606/s
     iteration_duration.............: avg=294.57ms min=204.64ms med=286.12ms max=987.05ms p(90)=324.61ms p(95)=416.53ms p(99.9)=829.89ms
     iterations.....................: 10213   133.02906/s
     success_rate...................: 100.00% ✓ 10213      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29811      ✗ 0    
     data_received..................: 881 MB  11 MB/s
     data_sent......................: 12 MB   143 kB/s
     http_req_blocked...............: avg=28.96µs  min=1.42µs   med=2.9µs    max=10.22ms  p(90)=4.28µs   p(95)=5.2µs    p(99.9)=8.28ms  
     http_req_connecting............: avg=25.36µs  min=0s       med=0s       max=10.18ms  p(90)=0s       p(95)=0s       p(99.9)=8.26ms  
     http_req_duration..............: avg=301.14ms min=175.53ms med=302.64ms max=719.3ms  p(90)=335.6ms  p(95)=344.49ms p(99.9)=631.94ms
       { expected_response:true }...: avg=301.14ms min=175.53ms med=302.64ms max=719.3ms  p(90)=335.6ms  p(95)=344.49ms p(99.9)=631.94ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10037
     http_req_receiving.............: avg=91.4µs   min=34.43µs  med=54.22µs  max=9.01ms   p(90)=111.74µs p(95)=242.58µs p(99.9)=1.7ms   
     http_req_sending...............: avg=113.19µs min=7.1µs    med=11.21µs  max=288.23ms p(90)=29.53µs  p(95)=142.54µs p(99.9)=3.59ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=300.94ms min=175.46ms med=302.46ms max=717.94ms p(90)=335.44ms p(95)=344.21ms p(99.9)=630.71ms
     http_reqs......................: 10037   123.247731/s
     iteration_duration.............: avg=302.44ms min=175.78ms med=303.27ms max=738.68ms p(90)=336.05ms p(95)=344.94ms p(99.9)=671.44ms
     iterations.....................: 9937    122.019797/s
     success_rate...................: 100.00% ✓ 9937       ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21138     ✗ 0   
     data_received..................: 628 MB  7.7 MB/s
     data_sent......................: 8.3 MB  102 kB/s
     http_req_blocked...............: avg=44.27µs  min=1.4µs    med=2.98µs   max=11.27ms  p(90)=4.55µs   p(95)=5.21µs   p(99.9)=9.78ms  
     http_req_connecting............: avg=40.7µs   min=0s       med=0s       max=11.24ms  p(90)=0s       p(95)=0s       p(99.9)=9.75ms  
     http_req_duration..............: avg=424.05ms min=210.63ms med=425.98ms max=926.02ms p(90)=453.3ms  p(95)=465.02ms p(99.9)=821.21ms
       { expected_response:true }...: avg=424.05ms min=210.63ms med=425.98ms max=926.02ms p(90)=453.3ms  p(95)=465.02ms p(99.9)=821.21ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7146
     http_req_receiving.............: avg=92.56µs  min=31.46µs  med=52.45µs  max=207.95ms p(90)=93.2µs   p(95)=109.23µs p(99.9)=395.11µs
     http_req_sending...............: avg=117.84µs min=6.41µs   med=12.1µs   max=307.89ms p(90)=19.28µs  p(95)=26.44µs  p(99.9)=3.47ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=423.84ms min=210.5ms  med=425.89ms max=925.79ms p(90)=452.95ms p(95)=464.8ms  p(99.9)=809.9ms 
     http_reqs......................: 7146    87.464626/s
     iteration_duration.............: avg=427.51ms min=298.33ms med=426.49ms max=977.94ms p(90)=453.86ms p(95)=465.45ms p(99.9)=871.89ms
     iterations.....................: 7046    86.24066/s
     success_rate...................: 100.00% ✓ 7046      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 79a2c60 into main Oct 30, 2025
34 checks passed
@ardatan ardatan deleted the renovate/node-22.x branch October 30, 2025 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant