Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Nov 11, 2025

This PR contains the following updates:

Package Change Age Confidence
@graphql-hive/gateway (source) 2.1.14 -> 2.1.16 age confidence

Release Notes

graphql-hive/gateway (@​graphql-hive/gateway)

v2.1.16

Compare Source

Patch Changes

v2.1.15

Compare Source

Patch Changes

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Nov 11, 2025
@github-actions
Copy link

💻 Website Preview

The latest changes are available as preview in: https://dfab5107.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1773 110939 total, 0 failed avg: 126ms, p95: 301ms
grafbase 1494 94989 total, 0 failed avg: 146ms, p95: 339ms
cosmo 696 44397 total, 0 failed avg: 316ms, p95: 702ms
apollo-router 371 25055 total, 0 failed avg: 563ms, p95: 1273ms ❌ 28 unexpected GraphQL errors
hive-gateway-bun 273 18980 total, 0 failed avg: 739ms, p95: 1639ms
hive-gateway 254 17690 total, 0 failed avg: 792ms, p95: 1824ms
apollo-gateway 153 10566 total, 0 failed avg: 1230ms, p95: 2545ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 329817      ✗ 0     
     data_received..................: 9.7 GB  156 MB/s
     data_sent......................: 129 MB  2.1 MB/s
     http_req_blocked...............: avg=480.16µs min=1.15µs  med=2.49µs   max=381.38ms p(90)=3.9µs    p(95)=4.72µs   p(99.9)=169.85ms
     http_req_connecting............: avg=474.44µs min=0s      med=0s       max=381.23ms p(90)=0s       p(95)=0s       p(99.9)=169.23ms
     http_req_duration..............: avg=125.55ms min=1.75ms  med=114.1ms  max=447.74ms p(90)=253.76ms p(95)=301.15ms p(99.9)=393.72ms
       { expected_response:true }...: avg=125.55ms min=1.75ms  med=114.1ms  max=447.74ms p(90)=253.76ms p(95)=301.15ms p(99.9)=393.72ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 110939
     http_req_receiving.............: avg=513.93µs min=22.49µs med=41.89µs  max=128.52ms p(90)=148.55µs p(95)=390.39µs p(99.9)=75.39ms 
     http_req_sending...............: avg=433.77µs min=4.97µs  med=10.1µs   max=144.1ms  p(90)=29.34µs  p(95)=126.86µs p(99.9)=66.43ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=124.6ms  min=1.71ms  med=113.11ms max=427.92ms p(90)=251.46ms p(95)=299.04ms p(99.9)=388.86ms
     http_reqs......................: 110939  1773.166058/s
     iteration_duration.............: avg=127.45ms min=1.9ms   med=115.77ms max=749.14ms p(90)=256.2ms  p(95)=303.63ms p(99.9)=427.38ms
     iterations.....................: 109939  1757.182805/s
     success_rate...................: 100.00% ✓ 109939      ✗ 0     
     vus............................: 86      min=0         max=498 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 281967      ✗ 0    
     data_received..................: 8.3 GB  131 MB/s
     data_sent......................: 111 MB  1.7 MB/s
     http_req_blocked...............: avg=727.27µs min=1.17µs  med=2.9µs    max=408.65ms p(90)=4.44µs   p(95)=5.83µs   p(99.9)=229.61ms
     http_req_connecting............: avg=719.02µs min=0s      med=0s       max=408.61ms p(90)=0s       p(95)=0s       p(99.9)=228.07ms
     http_req_duration..............: avg=146.47ms min=2.65ms  med=135.33ms max=527.9ms  p(90)=290.59ms p(95)=339.09ms p(99.9)=443.38ms
       { expected_response:true }...: avg=146.47ms min=2.65ms  med=135.33ms max=527.9ms  p(90)=290.59ms p(95)=339.09ms p(99.9)=443.38ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 94989
     http_req_receiving.............: avg=647.45µs min=25.47µs med=47.62µs  max=155.09ms p(90)=130.58µs p(95)=454.66µs p(99.9)=86.81ms 
     http_req_sending...............: avg=607.77µs min=5.31µs  med=11.7µs   max=180.16ms p(90)=32.82µs  p(95)=146.02µs p(99.9)=86.3ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=145.21ms min=2.61ms  med=133.99ms max=469.68ms p(90)=287.78ms p(95)=336.57ms p(99.9)=437.17ms
     http_reqs......................: 94989   1494.84967/s
     iteration_duration.............: avg=149.13ms min=3.34ms  med=137.85ms max=918.35ms p(90)=293.93ms p(95)=342.59ms p(99.9)=519.75ms
     iterations.....................: 93989   1479.112588/s
     success_rate...................: 100.00% ✓ 93989       ✗ 0    
     vus............................: 85      min=0         max=499
     vus_max........................: 500     min=500       max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 130191     ✗ 0    
     data_received..................: 3.9 GB  61 MB/s
     data_sent......................: 52 MB   811 kB/s
     http_req_blocked...............: avg=115.31µs min=1.36µs med=2.96µs   max=137.61ms p(90)=4.31µs   p(95)=5.8µs    p(99.9)=38.84ms 
     http_req_connecting............: avg=110.31µs min=0s     med=0s       max=137.56ms p(90)=0s       p(95)=0s       p(99.9)=38.75ms 
     http_req_duration..............: avg=316.22ms min=2.81ms med=295.93ms max=1.13s    p(90)=622.53ms p(95)=702.15ms p(99.9)=975.19ms
       { expected_response:true }...: avg=316.22ms min=2.81ms med=295.93ms max=1.13s    p(90)=622.53ms p(95)=702.15ms p(99.9)=975.19ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 44397
     http_req_receiving.............: avg=431.94µs min=27µs   med=59.48µs  max=129.07ms p(90)=179.56µs p(95)=453.86µs p(99.9)=65.74ms 
     http_req_sending...............: avg=175.85µs min=5.71µs med=11.17µs  max=126.85ms p(90)=30.53µs  p(95)=130.36µs p(99.9)=32.38ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=315.62ms min=2.73ms med=295.31ms max=1.13s    p(90)=621.08ms p(95)=700.69ms p(99.9)=974.98ms
     http_reqs......................: 44397   696.337125/s
     iteration_duration.............: avg=324.06ms min=3.01ms med=305.38ms max=1.13s    p(90)=626.57ms p(95)=705.3ms  p(99.9)=977.89ms
     iterations.....................: 43397   680.652797/s
     success_rate...................: 100.00% ✓ 43397      ✗ 0    
     vus............................: 94      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 24027 / ✗ 28
     ✓ valid response structure

     checks.........................: 99.96% ✓ 72137      ✗ 28   
     data_received..................: 2.2 GB 33 MB/s
     data_sent......................: 29 MB  433 kB/s
     http_req_blocked...............: avg=63.4µs   min=1.08µs  med=3.26µs   max=86.03ms p(90)=5.26µs   p(95)=7.13µs  p(99.9)=16.94ms
     http_req_connecting............: avg=58.32µs  min=0s      med=0s       max=85.97ms p(90)=0s       p(95)=0s      p(99.9)=16.88ms
     http_req_duration..............: avg=563.21ms min=6.11ms  med=525.32ms max=1.86s   p(90)=1.13s    p(95)=1.27s   p(99.9)=1.72s  
       { expected_response:true }...: avg=563.21ms min=6.11ms  med=525.32ms max=1.86s   p(90)=1.13s    p(95)=1.27s   p(99.9)=1.72s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 25055
     http_req_receiving.............: avg=103.3µs  min=29.48µs med=56.77µs  max=51.44ms p(90)=100.08µs p(95)=153.4µs p(99.9)=5.2ms  
     http_req_sending...............: avg=89.11µs  min=4.57µs  med=11.92µs  max=70.82ms p(90)=24.01µs  p(95)=97.66µs p(99.9)=15.55ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s      p(90)=0s       p(95)=0s      p(99.9)=0s     
     http_req_waiting...............: avg=563.02ms min=6.04ms  med=525.2ms  max=1.86s   p(90)=1.13s    p(95)=1.27s   p(99.9)=1.72s  
     http_reqs......................: 25055  371.287541/s
     iteration_duration.............: avg=586.95ms min=6.42ms  med=552.25ms max=1.86s   p(90)=1.14s    p(95)=1.28s   p(99.9)=1.73s  
     iterations.....................: 24055  356.468641/s
     success_rate...................: 99.88% ✓ 24027      ✗ 28   
     vus............................: 90     min=0        max=500
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53940      ✗ 0    
     data_received..................: 1.7 GB  24 MB/s
     data_sent......................: 22 MB   321 kB/s
     http_req_blocked...............: avg=140.09µs min=1.13µs  med=2.83µs   max=137.4ms  p(90)=4.88µs  p(95)=7.67µs   p(99.9)=38.14ms
     http_req_connecting............: avg=134.93µs min=0s      med=0s       max=137.35ms p(90)=0s      p(95)=0s       p(99.9)=38.07ms
     http_req_duration..............: avg=739.43ms min=6.99ms  med=662.84ms max=4.81s    p(90)=1.5s    p(95)=1.63s    p(99.9)=3.76s  
       { expected_response:true }...: avg=739.43ms min=6.99ms  med=662.84ms max=4.81s    p(90)=1.5s    p(95)=1.63s    p(99.9)=3.76s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18980
     http_req_receiving.............: avg=172.77µs min=25.75µs med=46.96µs  max=75.38ms  p(90)=91.51µs p(95)=202.17µs p(99.9)=24.11ms
     http_req_sending...............: avg=182.26µs min=5.11µs  med=10.39µs  max=139.97ms p(90)=23.43µs p(95)=113.17µs p(99.9)=40.85ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=739.08ms min=6.94ms  med=662.32ms max=4.8s     p(90)=1.5s    p(95)=1.63s    p(99.9)=3.76s  
     http_reqs......................: 18980   273.802598/s
     iteration_duration.............: avg=780.93ms min=7.94ms  med=716.47ms max=4.82s    p(90)=1.51s   p(95)=1.64s    p(99.9)=3.79s  
     iterations.....................: 17980   259.37675/s
     success_rate...................: 100.00% ✓ 17980      ✗ 0    
     vus............................: 85      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 50070      ✗ 0    
     data_received..................: 1.6 GB  22 MB/s
     data_sent......................: 21 MB   298 kB/s
     http_req_blocked...............: avg=176.83µs min=1.36µs med=3.02µs   max=169.26ms p(90)=5.9µs    p(95)=9.16µs   p(99.9)=46.03ms
     http_req_connecting............: avg=167.96µs min=0s     med=0s       max=169.1ms  p(90)=0s       p(95)=0s       p(99.9)=45.94ms
     http_req_duration..............: avg=791.57ms min=6.77ms med=714.18ms max=5.11s    p(90)=1.56s    p(95)=1.82s    p(99.9)=4.29s  
       { expected_response:true }...: avg=791.57ms min=6.77ms med=714.18ms max=5.11s    p(90)=1.56s    p(95)=1.82s    p(99.9)=4.29s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17690
     http_req_receiving.............: avg=188.13µs min=30.1µs med=50.2µs   max=148.16ms p(90)=115.52µs p(95)=244.37µs p(99.9)=25.11ms
     http_req_sending...............: avg=234.71µs min=6.42µs med=11.9µs   max=98.56ms  p(90)=35.16µs  p(95)=132.52µs p(99.9)=42.53ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=791.14ms min=6.67ms med=714.04ms max=5.11s    p(90)=1.56s    p(95)=1.82s    p(99.9)=4.29s  
     http_reqs......................: 17690   254.378524/s
     iteration_duration.............: avg=839.51ms min=7.73ms med=786.5ms  max=5.12s    p(90)=1.6s     p(95)=1.83s    p(99.9)=4.34s  
     iterations.....................: 16690   239.998732/s
     success_rate...................: 100.00% ✓ 16690      ✗ 0    
     vus............................: 92      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 28698      ✗ 0    
     data_received..................: 928 MB  13 MB/s
     data_sent......................: 13 MB   183 kB/s
     http_req_blocked...............: avg=35.41µs min=1.38µs  med=3.29µs  max=26.44ms p(90)=5.54µs   p(95)=12.17µs  p(99.9)=6.54ms
     http_req_connecting............: avg=29.28µs min=0s      med=0s      max=26.38ms p(90)=0s       p(95)=0s       p(99.9)=6.49ms
     http_req_duration..............: avg=1.23s   min=7.41ms  med=1.2s    max=15.84s  p(90)=2.22s    p(95)=2.54s    p(99.9)=14.68s
       { expected_response:true }...: avg=1.23s   min=7.41ms  med=1.2s    max=15.84s  p(90)=2.22s    p(95)=2.54s    p(99.9)=14.68s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10566
     http_req_receiving.............: avg=75.89µs min=28.03µs med=54.63µs max=3.44ms  p(90)=102.48µs p(95)=127.41µs p(99.9)=1.72ms
     http_req_sending...............: avg=47.1µs  min=5.45µs  med=12.74µs max=18.18ms p(90)=30.95µs  p(95)=50.05µs  p(99.9)=7.12ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.23s   min=7.36ms  med=1.2s    max=15.84s  p(90)=2.22s    p(95)=2.54s    p(99.9)=14.68s
     http_reqs......................: 10566   153.098187/s
     iteration_duration.............: avg=1.35s   min=8.03ms  med=1.34s   max=15.87s  p(90)=2.25s    p(95)=2.58s    p(99.9)=14.8s 
     iterations.....................: 9566    138.608486/s
     success_rate...................: 100.00% ✓ 9566       ✗ 0    
     vus............................: 72      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13987 total, 0 failed avg: 216ms, p95: 228ms
cosmo 166 13545 total, 0 failed avg: 223ms, p95: 248ms
hive-router 166 13489 total, 0 failed avg: 224ms, p95: 236ms
hive-gateway 165 12651 total, 0 failed avg: 238ms, p95: 267ms
hive-gateway-bun 155 11933 total, 0 failed avg: 253ms, p95: 298ms
apollo-router 135 11070 total, 0 failed avg: 273ms, p95: 316ms ❌ 1 unexpected GraphQL errors
apollo-gateway 120 9871 total, 0 failed avg: 306ms, p95: 345ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41661      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=18.7µs   min=1.23µs   med=1.92µs   max=8.9ms    p(90)=3.34µs   p(95)=4.9µs    p(99.9)=6.51ms  
     http_req_connecting............: avg=16.11µs  min=0s       med=0s       max=8.87ms   p(90)=0s       p(95)=0s       p(99.9)=6.49ms  
     http_req_duration..............: avg=215.91ms min=159.57ms med=215.09ms max=597.52ms p(90)=225.11ms p(95)=227.93ms p(99.9)=508ms   
       { expected_response:true }...: avg=215.91ms min=159.57ms med=215.09ms max=597.52ms p(90)=225.11ms p(95)=227.93ms p(99.9)=508ms   
     http_req_failed................: 0.00%   ✓ 0          ✗ 13987
     http_req_receiving.............: avg=90.55µs  min=27.3µs   med=46.04µs  max=17.63ms  p(90)=108.35µs p(95)=293.82µs p(99.9)=6.47ms  
     http_req_sending...............: avg=160.08µs min=5.45µs   med=8.54µs   max=365.22ms p(90)=40µs     p(95)=108.1µs  p(99.9)=10.81ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.66ms min=159.51ms med=214.96ms max=596.89ms p(90)=224.92ms p(95)=227.66ms p(99.9)=491.74ms
     http_reqs......................: 13987   172.815749/s
     iteration_duration.............: avg=216.21ms min=159.74ms med=215.35ms max=610.9ms  p(90)=225.34ms p(95)=228.16ms p(99.9)=523.51ms
     iterations.....................: 13887   171.580204/s
     success_rate...................: 100.00% ✓ 13887      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40335      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=16.3µs   min=1.26µs   med=2.75µs   max=7.11ms   p(90)=4.23µs   p(95)=5.68µs   p(99.9)=5.09ms  
     http_req_connecting............: avg=12.87µs  min=0s       med=0s       max=7.07ms   p(90)=0s       p(95)=0s       p(99.9)=5.07ms  
     http_req_duration..............: avg=223.35ms min=162.13ms med=221.6ms  max=622.56ms p(90)=241.93ms p(95)=247.74ms p(99.9)=509.14ms
       { expected_response:true }...: avg=223.35ms min=162.13ms med=221.6ms  max=622.56ms p(90)=241.93ms p(95)=247.74ms p(99.9)=509.14ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13545
     http_req_receiving.............: avg=464.95µs min=27.83µs  med=54.85µs  max=106.63ms p(90)=329.32µs p(95)=685.13µs p(99.9)=27.93ms 
     http_req_sending...............: avg=75.15µs  min=5.32µs   med=10.44µs  max=215.66ms p(90)=25.55µs  p(95)=129.15µs p(99.9)=3.61ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.81ms min=162.07ms med=221.11ms max=603.49ms p(90)=241.27ms p(95)=247.05ms p(99.9)=507.83ms
     http_reqs......................: 13545   166.884949/s
     iteration_duration.............: avg=223.79ms min=162.41ms med=221.96ms max=637.8ms  p(90)=242.29ms p(95)=248.02ms p(99.9)=544.12ms
     iterations.....................: 13445   165.652871/s
     success_rate...................: 100.00% ✓ 13445      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40167      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=20.28µs  min=1.22µs   med=2.12µs   max=9.5ms    p(90)=3.66µs   p(95)=5.25µs   p(99.9)=6.85ms  
     http_req_connecting............: avg=17.15µs  min=0s       med=0s       max=9.46ms   p(90)=0s       p(95)=0s       p(99.9)=6.83ms  
     http_req_duration..............: avg=223.81ms min=120.32ms med=222.68ms max=620.08ms p(90)=232.77ms p(95)=236.23ms p(99.9)=521.46ms
       { expected_response:true }...: avg=223.81ms min=120.32ms med=222.68ms max=620.08ms p(90)=232.77ms p(95)=236.23ms p(99.9)=521.46ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13489
     http_req_receiving.............: avg=99.21µs  min=25.93µs  med=48.29µs  max=29.51ms  p(90)=131.57µs p(95)=339.78µs p(99.9)=5.6ms   
     http_req_sending...............: avg=97.56µs  min=5.75µs   med=9.14µs   max=341.8ms  p(90)=47.52µs  p(95)=119.8µs  p(99.9)=10.29ms 
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.61ms min=120.27ms med=222.56ms max=619.13ms p(90)=232.59ms p(95)=236.01ms p(99.9)=512ms   
     http_reqs......................: 13489   166.681002/s
     iteration_duration.............: avg=224.21ms min=120.64ms med=222.95ms max=652ms    p(90)=233ms    p(95)=236.46ms p(99.9)=552.96ms
     iterations.....................: 13389   165.445322/s
     success_rate...................: 100.00% ✓ 13389      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37653      ✗ 0    
     data_received..................: 1.1 GB  15 MB/s
     data_sent......................: 15 MB   193 kB/s
     http_req_blocked...............: avg=48.21µs  min=1.2µs    med=2.56µs   max=20.93ms  p(90)=4.17µs   p(95)=5.44µs   p(99.9)=14.56ms 
     http_req_connecting............: avg=44.73µs  min=0s       med=0s       max=20.91ms  p(90)=0s       p(95)=0s       p(99.9)=14.51ms 
     http_req_duration..............: avg=238.34ms min=153.44ms med=230.05ms max=713.73ms p(90)=251.7ms  p(95)=267.33ms p(99.9)=571.25ms
       { expected_response:true }...: avg=238.34ms min=153.44ms med=230.05ms max=713.73ms p(90)=251.7ms  p(95)=267.33ms p(99.9)=571.25ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12651
     http_req_receiving.............: avg=85.55µs  min=26.27µs  med=46.1µs   max=15.24ms  p(90)=101.83µs p(95)=217.14µs p(99.9)=3ms     
     http_req_sending...............: avg=121.4µs  min=5.27µs   med=10.79µs  max=187.42ms p(90)=33.38µs  p(95)=131.24µs p(99.9)=8.47ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=238.13ms min=153.38ms med=229.92ms max=709.24ms p(90)=251.5ms  p(95)=267.01ms p(99.9)=562.67ms
     http_reqs......................: 12651   165.71442/s
     iteration_duration.............: avg=239.38ms min=153.68ms med=230.43ms max=740.17ms p(90)=252.2ms  p(95)=267.75ms p(99.9)=622.62ms
     iterations.....................: 12551   164.404528/s
     success_rate...................: 100.00% ✓ 12551      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 35499      ✗ 0    
     data_received..................: 1.0 GB  14 MB/s
     data_sent......................: 14 MB   181 kB/s
     http_req_blocked...............: avg=61.56µs  min=1.27µs   med=2.88µs   max=22.57ms  p(90)=4.72µs   p(95)=6.17µs   p(99.9)=17.61ms 
     http_req_connecting............: avg=57.56µs  min=0s       med=0s       max=22.15ms  p(90)=0s       p(95)=0s       p(99.9)=17.57ms 
     http_req_duration..............: avg=252.67ms min=160.54ms med=244.9ms  max=949.81ms p(90)=273.69ms p(95)=297.91ms p(99.9)=817.69ms
       { expected_response:true }...: avg=252.67ms min=160.54ms med=244.9ms  max=949.81ms p(90)=273.69ms p(95)=297.91ms p(99.9)=817.69ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11933
     http_req_receiving.............: avg=103.07µs min=26.51µs  med=50.56µs  max=13.73ms  p(90)=116.29µs p(95)=285.84µs p(99.9)=5.72ms  
     http_req_sending...............: avg=101.63µs min=5.44µs   med=11.36µs  max=209.53ms p(90)=33.97µs  p(95)=141.29µs p(99.9)=8.3ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=252.47ms min=160.45ms med=244.78ms max=942.76ms p(90)=273.54ms p(95)=297.51ms p(99.9)=817.21ms
     http_reqs......................: 11933   155.540949/s
     iteration_duration.............: avg=253.99ms min=185.74ms med=245.47ms max=991.13ms p(90)=274.13ms p(95)=299ms    p(99.9)=846.7ms 
     iterations.....................: 11833   154.237496/s
     success_rate...................: 100.00% ✓ 11833      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 10969 / ✗ 1
     ✓ valid response structure

     checks.........................: 99.99% ✓ 32909      ✗ 1    
     data_received..................: 971 MB 12 MB/s
     data_sent......................: 13 MB  158 kB/s
     http_req_blocked...............: avg=26.19µs  min=1.28µs   med=2.89µs   max=9.91ms   p(90)=4.52µs   p(95)=6.02µs   p(99.9)=7.67ms  
     http_req_connecting............: avg=21.6µs   min=0s       med=0s       max=9.87ms   p(90)=0s       p(95)=0s       p(99.9)=7.65ms  
     http_req_duration..............: avg=272.57ms min=170.81ms med=272.91ms max=712.31ms p(90)=306.73ms p(95)=315.62ms p(99.9)=601.25ms
       { expected_response:true }...: avg=272.57ms min=170.81ms med=272.91ms max=712.31ms p(90)=306.73ms p(95)=315.62ms p(99.9)=601.25ms
     http_req_failed................: 0.00%  ✓ 0          ✗ 11070
     http_req_receiving.............: avg=148.72µs min=28.93µs  med=53.71µs  max=109.42ms p(90)=183.27µs p(95)=467.73µs p(99.9)=5.95ms  
     http_req_sending...............: avg=125.77µs min=5.88µs   med=11.4µs   max=195.5ms  p(90)=104.32µs p(95)=160.39µs p(99.9)=6.98ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=272.3ms  min=168.88ms med=272.71ms max=697.45ms p(90)=306.4ms  p(95)=315.28ms p(99.9)=599.73ms
     http_reqs......................: 11070  135.975331/s
     iteration_duration.............: avg=273.57ms min=171.06ms med=273.52ms max=728.92ms p(90)=307.2ms  p(95)=316.07ms p(99.9)=621.98ms
     iterations.....................: 10970  134.747008/s
     success_rate...................: 99.99% ✓ 10969      ✗ 1    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29313      ✗ 0   
     data_received..................: 867 MB  11 MB/s
     data_sent......................: 12 MB   140 kB/s
     http_req_blocked...............: avg=74.35µs  min=1.43µs   med=3.28µs   max=21.45ms  p(90)=5.09µs   p(95)=6.22µs   p(99.9)=19.82ms 
     http_req_connecting............: avg=69.38µs  min=0s       med=0s       max=21.22ms  p(90)=0s       p(95)=0s       p(99.9)=19.67ms 
     http_req_duration..............: avg=306.07ms min=212.56ms med=304.23ms max=814.5ms  p(90)=334.71ms p(95)=344.51ms p(99.9)=728.79ms
       { expected_response:true }...: avg=306.07ms min=212.56ms med=304.23ms max=814.5ms  p(90)=334.71ms p(95)=344.51ms p(99.9)=728.79ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 9871
     http_req_receiving.............: avg=89.53µs  min=31.02µs  med=62.17µs  max=44.24ms  p(90)=114.38µs p(95)=149.5µs  p(99.9)=2.45ms  
     http_req_sending...............: avg=114.24µs min=6.52µs   med=13.1µs   max=262.84ms p(90)=26.7µs   p(95)=41.09µs  p(99.9)=3.8ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=305.86ms min=212.35ms med=304.11ms max=805.68ms p(90)=334.47ms p(95)=344.26ms p(99.9)=727.11ms
     http_reqs......................: 9871    120.723067/s
     iteration_duration.............: avg=307.56ms min=217.37ms med=304.84ms max=860.58ms p(90)=335.23ms p(95)=344.9ms  p(99.9)=809.5ms 
     iterations.....................: 9771    119.500059/s
     success_rate...................: 100.00% ✓ 9771       ✗ 0   
     vus............................: 50      min=0        max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14038 total, 0 failed avg: 216ms, p95: 228ms
hive-router 165 13443 total, 0 failed avg: 225ms, p95: 237ms
cosmo 157 12793 total, 0 failed avg: 236ms, p95: 262ms
hive-gateway-bun 148 11399 total, 0 failed avg: 265ms, p95: 362ms
hive-gateway 144 11062 total, 0 failed avg: 273ms, p95: 327ms
apollo-router 125 10240 total, 0 failed avg: 296ms, p95: 341ms
apollo-gateway 85 6953 total, 0 failed avg: 435ms, p95: 480ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41814      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=21.88µs  min=1.28µs   med=1.99µs   max=11.89ms  p(90)=3.33µs   p(95)=4.33µs   p(99.9)=7.9ms   
     http_req_connecting............: avg=18.59µs  min=0s       med=0s       max=10.6ms   p(90)=0s       p(95)=0s       p(99.9)=7.62ms  
     http_req_duration..............: avg=215.62ms min=157.77ms med=214.72ms max=594.58ms p(90)=225.06ms p(95)=228.01ms p(99.9)=500.63ms
       { expected_response:true }...: avg=215.62ms min=157.77ms med=214.72ms max=594.58ms p(90)=225.06ms p(95)=228.01ms p(99.9)=500.63ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14038
     http_req_receiving.............: avg=89.49µs  min=27.03µs  med=45.45µs  max=14.71ms  p(90)=99.08µs  p(95)=307.36µs p(99.9)=5.02ms  
     http_req_sending...............: avg=151.63µs min=5.93µs   med=8.65µs   max=364.51ms p(90)=39.88µs  p(95)=110.56µs p(99.9)=8.61ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.38ms min=157.71ms med=214.59ms max=593.47ms p(90)=224.91ms p(95)=227.82ms p(99.9)=487.14ms
     http_reqs......................: 14038   173.236746/s
     iteration_duration.............: avg=215.92ms min=158.06ms med=214.98ms max=604.14ms p(90)=225.29ms p(95)=228.25ms p(99.9)=516.79ms
     iterations.....................: 13938   172.00269/s
     success_rate...................: 100.00% ✓ 13938      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40029      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=46.23µs  min=1.17µs   med=2.2µs    max=17.42ms  p(90)=3.31µs   p(95)=4.51µs   p(99.9)=13.67ms 
     http_req_connecting............: avg=43.41µs  min=0s       med=0s       max=17.39ms  p(90)=0s       p(95)=0s       p(99.9)=13.62ms 
     http_req_duration..............: avg=225.13ms min=164.6ms  med=224.13ms max=602.5ms  p(90)=234.37ms p(95)=237.49ms p(99.9)=523.98ms
       { expected_response:true }...: avg=225.13ms min=164.6ms  med=224.13ms max=602.5ms  p(90)=234.37ms p(95)=237.49ms p(99.9)=523.98ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13443
     http_req_receiving.............: avg=89.55µs  min=26.21µs  med=44.97µs  max=14.1ms   p(90)=106.96µs p(95)=296.02µs p(99.9)=4.46ms  
     http_req_sending...............: avg=160.93µs min=5.46µs   med=9.61µs   max=381.33ms p(90)=40.9µs   p(95)=101.01µs p(99.9)=9.95ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=224.88ms min=164.06ms med=224.02ms max=600.53ms p(90)=234.19ms p(95)=237.25ms p(99.9)=483.39ms
     http_reqs......................: 13443   165.890391/s
     iteration_duration.............: avg=225.53ms min=164.83ms med=224.4ms  max=638.12ms p(90)=234.58ms p(95)=237.71ms p(99.9)=539.03ms
     iterations.....................: 13343   164.656363/s
     success_rate...................: 100.00% ✓ 13343      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38079      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   184 kB/s
     http_req_blocked...............: avg=22.56µs  min=1.52µs   med=2.77µs   max=10.08ms  p(90)=4.28µs   p(95)=5.69µs   p(99.9)=7.35ms  
     http_req_connecting............: avg=19.01µs  min=0s       med=0s       max=10.05ms  p(90)=0s       p(95)=0s       p(99.9)=7.32ms  
     http_req_duration..............: avg=236.16ms min=125.75ms med=235.04ms max=649.1ms  p(90)=255.15ms p(95)=261.52ms p(99.9)=538.58ms
       { expected_response:true }...: avg=236.16ms min=125.75ms med=235.04ms max=649.1ms  p(90)=255.15ms p(95)=261.52ms p(99.9)=538.58ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12793
     http_req_receiving.............: avg=320.48µs min=33.04µs  med=65µs     max=261.14ms p(90)=243.21µs p(95)=513.67µs p(99.9)=27.03ms 
     http_req_sending...............: avg=145.78µs min=6.45µs   med=11.14µs  max=317.2ms  p(90)=34.95µs  p(95)=142.2µs  p(99.9)=3.83ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=235.69ms min=125.65ms med=234.77ms max=647.86ms p(90)=254.7ms  p(95)=261.07ms p(99.9)=530.46ms
     http_reqs......................: 12793   157.838977/s
     iteration_duration.............: avg=236.69ms min=126ms    med=235.47ms max=671.34ms p(90)=255.48ms p(95)=261.89ms p(99.9)=547.18ms
     iterations.....................: 12693   156.605186/s
     success_rate...................: 100.00% ✓ 12693      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33897      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   173 kB/s
     http_req_blocked...............: avg=58.95µs  min=982ns    med=2.77µs   max=18.39ms  p(90)=4.8µs    p(95)=6.2µs    p(99.9)=15.33ms 
     http_req_connecting............: avg=55.31µs  min=0s       med=0s       max=18.36ms  p(90)=0s       p(95)=0s       p(99.9)=15.21ms 
     http_req_duration..............: avg=264.66ms min=132.84ms med=253.38ms max=724.82ms p(90)=276.31ms p(95)=362.01ms p(99.9)=620ms   
       { expected_response:true }...: avg=264.66ms min=132.84ms med=253.38ms max=724.82ms p(90)=276.31ms p(95)=362.01ms p(99.9)=620ms   
     http_req_failed................: 0.00%   ✓ 0          ✗ 11399
     http_req_receiving.............: avg=111.58µs min=21.58µs  med=49.21µs  max=142.74ms p(90)=117.27µs p(95)=387.01µs p(99.9)=5.44ms  
     http_req_sending...............: avg=97.1µs   min=4.32µs   med=10.71µs  max=202.77ms p(90)=36.03µs  p(95)=147.79µs p(99.9)=5.72ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=264.45ms min=132.77ms med=253.25ms max=712.48ms p(90)=276.15ms p(95)=360.96ms p(99.9)=619.65ms
     http_reqs......................: 11399   148.795858/s
     iteration_duration.............: avg=265.93ms min=133.1ms  med=253.75ms max=748.59ms p(90)=276.72ms p(95)=371.7ms  p(99.9)=644.46ms
     iterations.....................: 11299   147.490517/s
     success_rate...................: 100.00% ✓ 11299      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32886      ✗ 0    
     data_received..................: 972 MB  13 MB/s
     data_sent......................: 13 MB   168 kB/s
     http_req_blocked...............: avg=29.97µs  min=1.21µs   med=2.72µs   max=11.7ms   p(90)=4.4µs    p(95)=5.82µs   p(99.9)=9.32ms 
     http_req_connecting............: avg=26.43µs  min=0s       med=0s       max=11.66ms  p(90)=0s       p(95)=0s       p(99.9)=9.29ms 
     http_req_duration..............: avg=272.56ms min=154.23ms med=257.61ms max=1.56s    p(90)=280.43ms p(95)=326.66ms p(99.9)=1.56s  
       { expected_response:true }...: avg=272.56ms min=154.23ms med=257.61ms max=1.56s    p(90)=280.43ms p(95)=326.66ms p(99.9)=1.56s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 11062
     http_req_receiving.............: avg=124.6µs  min=25.45µs  med=48.76µs  max=189.73ms p(90)=129.28µs p(95)=428.67µs p(99.9)=4.88ms 
     http_req_sending...............: avg=127.33µs min=5.33µs   med=11.27µs  max=195.83ms p(90)=52.9µs   p(95)=162.9µs  p(99.9)=10.06ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=272.3ms  min=148.94ms med=257.46ms max=1.56s    p(90)=280.2ms  p(95)=321ms    p(99.9)=1.56s  
     http_reqs......................: 11062   144.715997/s
     iteration_duration.............: avg=273.97ms min=154.53ms med=258ms    max=1.56s    p(90)=280.83ms p(95)=329.82ms p(99.9)=1.56s  
     iterations.....................: 10962   143.40777/s
     success_rate...................: 100.00% ✓ 10962      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30420     ✗ 0    
     data_received..................: 899 MB  11 MB/s
     data_sent......................: 12 MB   146 kB/s
     http_req_blocked...............: avg=23.08µs  min=1.64µs   med=2.83µs   max=7.81ms   p(90)=4.11µs   p(95)=5.08µs   p(99.9)=6.26ms  
     http_req_connecting............: avg=19.55µs  min=0s       med=0s       max=7.78ms   p(90)=0s       p(95)=0s       p(99.9)=6.24ms  
     http_req_duration..............: avg=296.03ms min=175.04ms med=297.6ms  max=727.46ms p(90)=332.05ms p(95)=340.89ms p(99.9)=631.71ms
       { expected_response:true }...: avg=296.03ms min=175.04ms med=297.6ms  max=727.46ms p(90)=332.05ms p(95)=340.89ms p(99.9)=631.71ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 10240
     http_req_receiving.............: avg=88.04µs  min=31.99µs  med=51.36µs  max=6.3ms    p(90)=104.19µs p(95)=275.25µs p(99.9)=1.64ms  
     http_req_sending...............: avg=123.42µs min=7.31µs   med=11.12µs  max=250.14ms p(90)=30.77µs  p(95)=144.62µs p(99.9)=3.63ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=295.82ms min=174.98ms med=297.43ms max=726.04ms p(90)=331.89ms p(95)=340.67ms p(99.9)=630.29ms
     http_reqs......................: 10240   125.71133/s
     iteration_duration.............: avg=297.23ms min=175.28ms med=298.2ms  max=749.95ms p(90)=332.47ms p(95)=341.24ms p(99.9)=650.26ms
     iterations.....................: 10140   124.48368/s
     success_rate...................: 100.00% ✓ 10140     ✗ 0    
     vus............................: 50      min=0       max=50 
     vus_max........................: 50      min=50      max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20559     ✗ 0   
     data_received..................: 611 MB  7.5 MB/s
     data_sent......................: 8.1 MB  99 kB/s
     http_req_blocked...............: avg=82.61µs  min=1.48µs   med=3.23µs   max=20.72ms  p(90)=5.08µs   p(95)=5.87µs   p(99.9)=17.38ms 
     http_req_connecting............: avg=77.89µs  min=0s       med=0s       max=20.54ms  p(90)=0s       p(95)=0s       p(99.9)=17.32ms 
     http_req_duration..............: avg=435.14ms min=211.73ms med=437.63ms max=995.69ms p(90)=468.15ms p(95)=480.24ms p(99.9)=896.87ms
       { expected_response:true }...: avg=435.14ms min=211.73ms med=437.63ms max=995.69ms p(90)=468.15ms p(95)=480.24ms p(99.9)=896.87ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 6953
     http_req_receiving.............: avg=108.4µs  min=31.72µs  med=56.48µs  max=275.23ms p(90)=100.17µs p(95)=115.52µs p(99.9)=540.49µs
     http_req_sending...............: avg=128.86µs min=6.45µs   med=12.85µs  max=275.16ms p(90)=20.88µs  p(95)=29.79µs  p(99.9)=4.5ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=434.9ms  min=211.65ms med=437.52ms max=984.52ms p(90)=467.99ms p(95)=480.05ms p(99.9)=877.21ms
     http_reqs......................: 6953    85.044447/s
     iteration_duration.............: avg=439.05ms min=265.51ms med=438.22ms max=1.03s    p(90)=469.08ms p(95)=480.55ms p(99.9)=1.01s   
     iterations.....................: 6853    83.821314/s
     success_rate...................: 100.00% ✓ 6853      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1630 98249 total, 0 failed avg: 30ms, p95: 52ms
grafbase 1594 96252 total, 0 failed avg: 31ms, p95: 54ms
cosmo 637 38582 total, 0 failed avg: 77ms, p95: 113ms
apollo-router 371 22556 total, 0 failed avg: 133ms, p95: 173ms
hive-gateway 304 18743 total, 0 failed avg: 160ms, p95: 319ms
hive-gateway-bun 296 18055 total, 0 failed avg: 166ms, p95: 332ms
apollo-gateway 118 7261 total, 0 failed avg: 414ms, p95: 486ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 294447      ✗ 0    
     data_received..................: 8.6 GB  143 MB/s
     data_sent......................: 114 MB  1.9 MB/s
     http_req_blocked...............: avg=6.15µs   min=1.17µs  med=2.65µs  max=11.78ms  p(90)=3.9µs    p(95)=4.69µs   p(99.9)=92.29µs 
     http_req_connecting............: avg=2.92µs   min=0s      med=0s      max=11.75ms  p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=30.27ms  min=1.94ms  med=27.78ms max=446.45ms p(90)=46ms     p(95)=52.48ms  p(99.9)=99.11ms 
       { expected_response:true }...: avg=30.27ms  min=1.94ms  med=27.78ms max=446.45ms p(90)=46ms     p(95)=52.48ms  p(99.9)=99.11ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 98249
     http_req_receiving.............: avg=124.81µs min=24.97µs med=44.66µs max=93.82ms  p(90)=117.33µs p(95)=357.42µs p(99.9)=12.19ms 
     http_req_sending...............: avg=101.38µs min=5.26µs  med=10.51µs max=247.54ms p(90)=32.34µs  p(95)=132.03µs p(99.9)=14.74ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=30.05ms  min=1.9ms   med=27.62ms max=445.93ms p(90)=45.63ms  p(95)=52.03ms  p(99.9)=96.83ms 
     http_reqs......................: 98249   1630.367086/s
     iteration_duration.............: avg=30.56ms  min=4.56ms  med=28.03ms max=493.12ms p(90)=46.25ms  p(95)=52.74ms  p(99.9)=100.08ms
     iterations.....................: 98149   1628.707663/s
     success_rate...................: 100.00% ✓ 98149       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 288456      ✗ 0    
     data_received..................: 8.5 GB  140 MB/s
     data_sent......................: 112 MB  1.9 MB/s
     http_req_blocked...............: avg=8.57µs   min=1.19µs med=2.95µs  max=16.96ms  p(90)=4.11µs   p(95)=5.09µs   p(99.9)=119.02µs
     http_req_connecting............: avg=4.97µs   min=0s     med=0s      max=16.84ms  p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=30.87ms  min=2.95ms med=27.53ms max=513.01ms p(90)=47.68ms  p(95)=54.05ms  p(99.9)=88.9ms  
       { expected_response:true }...: avg=30.87ms  min=2.95ms med=27.53ms max=513.01ms p(90)=47.68ms  p(95)=54.05ms  p(99.9)=88.9ms  
     http_req_failed................: 0.00%   ✓ 0           ✗ 96252
     http_req_receiving.............: avg=148.48µs min=25.5µs med=47.44µs max=50.14ms  p(90)=152.03µs p(95)=392.65µs p(99.9)=16.44ms 
     http_req_sending...............: avg=126.48µs min=4.93µs med=11.68µs max=463.35ms p(90)=43.67µs  p(95)=138.92µs p(99.9)=16.91ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=30.59ms  min=2.89ms med=27.32ms max=512.34ms p(90)=47.17ms  p(95)=53.5ms   p(99.9)=85.21ms 
     http_reqs......................: 96252   1594.420245/s
     iteration_duration.............: avg=31.18ms  min=7.24ms med=27.81ms max=552.1ms  p(90)=47.97ms  p(95)=54.36ms  p(99.9)=91.7ms  
     iterations.....................: 96152   1592.763739/s
     success_rate...................: 100.00% ✓ 96152       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 115446     ✗ 0    
     data_received..................: 3.4 GB  56 MB/s
     data_sent......................: 45 MB   741 kB/s
     http_req_blocked...............: avg=10.63µs  min=1.36µs  med=2.86µs  max=10.53ms  p(90)=4.38µs   p(95)=5.41µs   p(99.9)=2.37ms  
     http_req_connecting............: avg=6.98µs   min=0s      med=0s      max=10.49ms  p(90)=0s       p(95)=0s       p(99.9)=2.35ms  
     http_req_duration..............: avg=77.45ms  min=3.06ms  med=76.29ms max=538.43ms p(90)=104.7ms  p(95)=113.34ms p(99.9)=314.5ms 
       { expected_response:true }...: avg=77.45ms  min=3.06ms  med=76.29ms max=538.43ms p(90)=104.7ms  p(95)=113.34ms p(99.9)=314.5ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 38582
     http_req_receiving.............: avg=171.84µs min=29.43µs med=75.14µs max=39.85ms  p(90)=157.18µs p(95)=406.68µs p(99.9)=16.2ms  
     http_req_sending...............: avg=66.62µs  min=5.98µs  med=11.68µs max=321.63ms p(90)=31.56µs  p(95)=134.93µs p(99.9)=3.63ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=77.21ms  min=2.97ms  med=76.08ms max=537.16ms p(90)=104.44ms p(95)=113.09ms p(99.9)=307.69ms
     http_reqs......................: 38582   637.241809/s
     iteration_duration.............: avg=77.98ms  min=7.3ms   med=76.63ms max=595.63ms p(90)=105.02ms p(95)=113.67ms p(99.9)=344.72ms
     iterations.....................: 38482   635.590154/s
     success_rate...................: 100.00% ✓ 38482      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 67368      ✗ 0    
     data_received..................: 2.0 GB  33 MB/s
     data_sent......................: 26 MB   432 kB/s
     http_req_blocked...............: avg=10.23µs  min=1.92µs  med=3.18µs   max=5.68ms   p(90)=4.78µs   p(95)=5.59µs   p(99.9)=3.12ms  
     http_req_connecting............: avg=6.39µs   min=0s      med=0s       max=5.65ms   p(90)=0s       p(95)=0s       p(99.9)=3.1ms   
     http_req_duration..............: avg=132.81ms min=5.85ms  med=132.11ms max=557.17ms p(90)=163.82ms p(95)=173.46ms p(99.9)=390.16ms
       { expected_response:true }...: avg=132.81ms min=5.85ms  med=132.11ms max=557.17ms p(90)=163.82ms p(95)=173.46ms p(99.9)=390.16ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 22556
     http_req_receiving.............: avg=96.04µs  min=35.79µs med=54.79µs  max=259.66ms p(90)=96.21µs  p(95)=116.2µs  p(99.9)=1.36ms  
     http_req_sending...............: avg=89.19µs  min=7.42µs  med=11.7µs   max=343.4ms  p(90)=19.57µs  p(95)=26.86µs  p(99.9)=2.15ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=132.63ms min=5.76ms  med=131.98ms max=531.16ms p(90)=163.64ms p(95)=173.31ms p(99.9)=377.24ms
     http_reqs......................: 22556   371.180401/s
     iteration_duration.............: avg=133.68ms min=37.86ms med=132.48ms max=582.45ms p(90)=164.12ms p(95)=173.83ms p(99.9)=410ms   
     iterations.....................: 22456   369.534806/s
     success_rate...................: 100.00% ✓ 22456      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55929      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   355 kB/s
     http_req_blocked...............: avg=20.06µs  min=1.27µs  med=2.73µs   max=11.71ms  p(90)=4.52µs   p(95)=5.73µs   p(99.9)=7.22ms  
     http_req_connecting............: avg=16.19µs  min=0s      med=0s       max=11.67ms  p(90)=0s       p(95)=0s       p(99.9)=7.18ms  
     http_req_duration..............: avg=160.25ms min=6.57ms  med=148.28ms max=614.9ms  p(90)=177.47ms p(95)=318.59ms p(99.9)=575.22ms
       { expected_response:true }...: avg=160.25ms min=6.57ms  med=148.28ms max=614.9ms  p(90)=177.47ms p(95)=318.59ms p(99.9)=575.22ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18743
     http_req_receiving.............: avg=114.31µs min=25.95µs med=48.52µs  max=259.89ms p(90)=113.99µs p(95)=238.25µs p(99.9)=4.93ms  
     http_req_sending...............: avg=86.9µs   min=5.3µs   med=11.18µs  max=382.83ms p(90)=33.31µs  p(95)=131.6µs  p(99.9)=5.69ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=160.04ms min=6.51ms  med=148.11ms max=590.43ms p(90)=177.31ms p(95)=318.21ms p(99.9)=574.87ms
     http_reqs......................: 18743   304.857239/s
     iteration_duration.............: avg=161.44ms min=41.35ms med=148.71ms max=685.53ms p(90)=177.93ms p(95)=319.86ms p(99.9)=576.48ms
     iterations.....................: 18643   303.230726/s
     success_rate...................: 100.00% ✓ 18643      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53865      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   344 kB/s
     http_req_blocked...............: avg=26.69µs  min=1.27µs  med=2.87µs   max=16.06ms  p(90)=4.57µs   p(95)=5.59µs   p(99.9)=10.15ms 
     http_req_connecting............: avg=22.73µs  min=0s      med=0s       max=16.03ms  p(90)=0s       p(95)=0s       p(99.9)=10.12ms 
     http_req_duration..............: avg=165.86ms min=7.02ms  med=154.46ms max=627.56ms p(90)=187.55ms p(95)=331.8ms  p(99.9)=477.6ms 
       { expected_response:true }...: avg=165.86ms min=7.02ms  med=154.46ms max=627.56ms p(90)=187.55ms p(95)=331.8ms  p(99.9)=477.6ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 18055
     http_req_receiving.............: avg=93.82µs  min=26.29µs med=47.1µs   max=14.86ms  p(90)=102.49µs p(95)=177.8µs  p(99.9)=4.28ms  
     http_req_sending...............: avg=108.48µs min=5.36µs  med=11.38µs  max=264.99ms p(90)=32.29µs  p(95)=125.84µs p(99.9)=9.06ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=165.66ms min=6.96ms  med=154.31ms max=618.46ms p(90)=187.39ms p(95)=331.64ms p(99.9)=474.13ms
     http_reqs......................: 18055   296.038543/s
     iteration_duration.............: avg=167.23ms min=43.65ms med=154.85ms max=702.58ms p(90)=188.06ms p(95)=332.52ms p(99.9)=575.28ms
     iterations.....................: 17955   294.398894/s
     success_rate...................: 100.00% ✓ 17955      ✗ 0    
     vus............................: 18      min=18       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21483      ✗ 0   
     data_received..................: 638 MB  10 MB/s
     data_sent......................: 8.4 MB  138 kB/s
     http_req_blocked...............: avg=43.86µs  min=1.26µs   med=2.84µs   max=11.48ms  p(90)=4.19µs   p(95)=4.89µs   p(99.9)=9.93ms  
     http_req_connecting............: avg=40.56µs  min=0s       med=0s       max=11.45ms  p(90)=0s       p(95)=0s       p(99.9)=9.9ms   
     http_req_duration..............: avg=414.1ms  min=7.48ms   med=413.47ms max=786.87ms p(90)=469.21ms p(95)=486.24ms p(99.9)=693.4ms 
       { expected_response:true }...: avg=414.1ms  min=7.48ms   med=413.47ms max=786.87ms p(90)=469.21ms p(95)=486.24ms p(99.9)=693.4ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 7261
     http_req_receiving.............: avg=65.18µs  min=26.73µs  med=49.08µs  max=25.22ms  p(90)=88.16µs  p(95)=103.56µs p(99.9)=399.61µs
     http_req_sending...............: avg=62.73µs  min=5.69µs   med=11.74µs  max=172.15ms p(90)=17.31µs  p(95)=21.36µs  p(99.9)=3.67ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=413.97ms min=7.42ms   med=413.38ms max=765.92ms p(90)=469.11ms p(95)=486.16ms p(99.9)=692.66ms
     http_reqs......................: 7261    118.750383/s
     iteration_duration.............: avg=420.22ms min=191.19ms med=414.19ms max=797.35ms p(90)=469.92ms p(95)=487.2ms  p(99.9)=714.55ms
     iterations.....................: 7161    117.114928/s
     success_rate...................: 100.00% ✓ 7161       ✗ 0   
     vus............................: 36      min=36       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@enisdenjo
Copy link
Member

Superseded by #841

@renovate
Copy link
Contributor Author

renovate bot commented Nov 11, 2025

Renovate Ignore Notification

Because you closed this PR without merging, Renovate will ignore this update (2.1.16). You will get a PR once a newer version is released. To ignore this dependency forever, add it to the ignoreDeps array of your Renovate config.

If you accidentally closed this PR, or if you changed your mind: rename this PR to get a fresh replacement PR.

@renovate renovate bot deleted the renovate/graphql-hive-gateway-monorepo branch November 11, 2025 15:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant