Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Oct 28, 2025

This PR contains the following updates:

Package Change Age Confidence
@apollo/server (source) 5.0.0 -> 5.1.0 age confidence

Release Notes

apollographql/apollo-server (@​apollo/server)

v5.1.0

Compare Source

Minor Changes
  • #​8148 80a1a1a Thanks @​jerelmiller! - Apollo Server now supports the incremental delivery protocol (@defer and @stream) that ships with [email protected]. To use the current protocol, clients must send the Accept header with a value of multipart/mixed; incrementalSpec=v0.2.

    Upgrading to 5.1 will depend on what version of graphql you have installed and whether you already support the incremental delivery protocol.

I use graphql@16 without incremental delivery

Continue using `graphql` v16 with no additional changes. Incremental delivery won't be available.

I use graphql@16 but would like to add support for incremental delivery

Install `[email protected]` and follow the ["Incremental delivery" guide](https://www.apollographql.com/docs/apollo-server/workflow/requests#incremental-delivery-experimental) to add the `@defer` and `@stream` directives to your schema. Clients should send the `Accept` header with a value of `multipart/mixed; incrementalSpec=v0.2` to get multipart responses.

I use [email protected] and use incremental delivery

You must upgrade to `[email protected]` to continue using incremental delivery. If you'd like to continue providing support for the legacy incremental protocol, install the [`@yaacovcr/transform`](https://redirect.github.com/yaacovCR/transform) package. Apollo Server will attempt to load this module when the client specifies an `Accept` header with a value of `multipart/mixed; deferSpec=20220824`. If this package is not installed, an error is returned by the server.

Because Apollo Server now supports multiple versions of the incremental delivery types, the existing incremental delivery types have been renamed with an `Alpha2` suffix. If you import these types in your code, you will need to add the `Alpha2` suffix.

```diff
import type {
- GraphQLExperimentalFormattedInitialIncrementalExecutionResult,
+ GraphQLExperimentalFormattedInitialIncrementalExecutionResultAlpha2,

- GraphQLExperimentalFormattedSubsequentIncrementalExecutionResult,
+ GraphQLExperimentalFormattedSubsequentIncrementalExecutionResultAlpha2,

- GraphQLExperimentalFormattedIncrementalResult,
+ GraphQLExperimentalFormattedIncrementalResultAlpha2,

- GraphQLExperimentalFormattedIncrementalDeferResult,
+ GraphQLExperimentalFormattedIncrementalDeferResultAlpha2,

- GraphQLExperimentalFormattedIncrementalStreamResult,
+ GraphQLExperimentalFormattedIncrementalStreamResultAlpha2,
} from '@​apollo/server';
```

Incremental delivery types for the `[email protected]` version are now available using the `Alpha9` suffix:

```ts
import type {
  GraphQLExperimentalFormattedInitialIncrementalExecutionResultAlpha9,
  GraphQLExperimentalFormattedSubsequentIncrementalExecutionResultAlpha9,
  GraphQLExperimentalFormattedIncrementalResultAlpha9,
  GraphQLExperimentalFormattedIncrementalDeferResultAlpha9,
  GraphQLExperimentalFormattedIncrementalStreamResultAlpha9,
  GraphQLExperimentalFormattedCompletedResultAlpha9,
  GraphQLExperimentalPendingResultAlpha9,
} from '@​apollo/server';
```

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Oct 28, 2025
@github-actions
Copy link

💻 Website Preview

The latest changes are available as preview in: https://38d87b7b.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1763 106303 total, 0 failed avg: 28ms, p95: 51ms
grafbase 1552 93715 total, 0 failed avg: 32ms, p95: 56ms
cosmo 687 41543 total, 0 failed avg: 72ms, p95: 105ms
apollo-router 367 22328 total, 0 failed avg: 134ms, p95: 174ms
hive-gateway 291 17799 total, 0 failed avg: 168ms, p95: 289ms
hive-gateway-bun 280 17122 total, 0 failed avg: 175ms, p95: 327ms
apollo-gateway 118 7240 total, 0 failed avg: 415ms, p95: 487ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 318609      ✗ 0     
     data_received..................: 9.3 GB  155 MB/s
     data_sent......................: 124 MB  2.1 MB/s
     http_req_blocked...............: avg=5.35µs   min=1.2µs  med=2.62µs  max=9.23ms   p(90)=3.87µs   p(95)=4.54µs   p(99.9)=105.37µs
     http_req_connecting............: avg=2.17µs   min=0s     med=0s      max=9.19ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=27.98ms  min=1.91ms med=25.21ms max=418.46ms p(90)=44.05ms  p(95)=50.96ms  p(99.9)=88.9ms  
       { expected_response:true }...: avg=27.98ms  min=1.91ms med=25.21ms max=418.46ms p(90)=44.05ms  p(95)=50.96ms  p(99.9)=88.9ms  
     http_req_failed................: 0.00%   ✓ 0           ✗ 106303
     http_req_receiving.............: avg=132.09µs min=25.2µs med=44.38µs max=353.95ms p(90)=109.74µs p(95)=356.26µs p(99.9)=14.75ms 
     http_req_sending...............: avg=104.02µs min=5.28µs med=10.19µs max=365.92ms p(90)=29.27µs  p(95)=128.99µs p(99.9)=15.44ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=27.74ms  min=1.87ms med=25.04ms max=409.35ms p(90)=43.62ms  p(95)=50.48ms  p(99.9)=83.96ms 
     http_reqs......................: 106303  1763.569185/s
     iteration_duration.............: avg=28.25ms  min=3.79ms med=25.46ms max=444.96ms p(90)=44.31ms  p(95)=51.21ms  p(99.9)=90.2ms  
     iterations.....................: 106203  1761.910182/s
     success_rate...................: 100.00% ✓ 106203      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 280845      ✗ 0    
     data_received..................: 8.2 GB  137 MB/s
     data_sent......................: 109 MB  1.8 MB/s
     http_req_blocked...............: avg=5.98µs   min=1.06µs  med=3.24µs  max=7.52ms   p(90)=4.7µs    p(95)=5.6µs    p(99.9)=137.91µs
     http_req_connecting............: avg=2.03µs   min=0s      med=0s      max=7.48ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=31.75ms  min=2.57ms  med=28.38ms max=442.73ms p(90)=49.02ms  p(95)=56.11ms  p(99.9)=92.03ms 
       { expected_response:true }...: avg=31.75ms  min=2.57ms  med=28.38ms max=442.73ms p(90)=49.02ms  p(95)=56.11ms  p(99.9)=92.03ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 93715
     http_req_receiving.............: avg=158.45µs min=27.76µs med=54.77µs max=63.83ms  p(90)=182.05µs p(95)=453.45µs p(99.9)=16.41ms 
     http_req_sending...............: avg=114.46µs min=4.79µs  med=11.58µs max=407.4ms  p(90)=41.45µs  p(95)=160.87µs p(99.9)=16.17ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=31.47ms  min=2.51ms  med=28.18ms max=441.96ms p(90)=48.48ms  p(95)=55.49ms  p(99.9)=89.34ms 
     http_reqs......................: 93715   1552.806582/s
     iteration_duration.............: avg=32.03ms  min=7.4ms   med=28.63ms max=460.86ms p(90)=49.29ms  p(95)=56.37ms  p(99.9)=92.85ms 
     iterations.....................: 93615   1551.149637/s
     success_rate...................: 100.00% ✓ 93615       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 124329     ✗ 0    
     data_received..................: 3.6 GB  60 MB/s
     data_sent......................: 48 MB   800 kB/s
     http_req_blocked...............: avg=9.24µs   min=1.38µs  med=2.87µs  max=9.5ms    p(90)=3.89µs   p(95)=4.59µs   p(99.9)=1.4ms   
     http_req_connecting............: avg=5.72µs   min=0s      med=0s      max=9.47ms   p(90)=0s       p(95)=0s       p(99.9)=1.38ms  
     http_req_duration..............: avg=71.95ms  min=2.73ms  med=71.05ms max=516.69ms p(90)=96.92ms  p(95)=104.52ms p(99.9)=292.88ms
       { expected_response:true }...: avg=71.95ms  min=2.73ms  med=71.05ms max=516.69ms p(90)=96.92ms  p(95)=104.52ms p(99.9)=292.88ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 41543
     http_req_receiving.............: avg=161.53µs min=30.29µs med=67.26µs max=90.51ms  p(90)=142.76µs p(95)=385µs    p(99.9)=15.92ms 
     http_req_sending...............: avg=70.18µs  min=5.73µs  med=11.14µs max=300.72ms p(90)=29.64µs  p(95)=125.01µs p(99.9)=3.87ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=71.72ms  min=2.67ms  med=70.86ms max=515.77ms p(90)=96.66ms  p(95)=104.29ms p(99.9)=274.24ms
     http_reqs......................: 41543   687.678884/s
     iteration_duration.............: avg=72.41ms  min=5.57ms  med=71.4ms  max=541.89ms p(90)=97.23ms  p(95)=104.83ms p(99.9)=297.11ms
     iterations.....................: 41443   686.023541/s
     success_rate...................: 100.00% ✓ 41443      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 66684      ✗ 0    
     data_received..................: 2.0 GB  32 MB/s
     data_sent......................: 26 MB   427 kB/s
     http_req_blocked...............: avg=14.29µs  min=1.43µs  med=3.13µs   max=9.3ms    p(90)=4.48µs   p(95)=5.3µs    p(99.9)=5.11ms  
     http_req_connecting............: avg=10.47µs  min=0s      med=0s       max=9.27ms   p(90)=0s       p(95)=0s       p(99.9)=5.09ms  
     http_req_duration..............: avg=134.15ms min=5.98ms  med=133.52ms max=628.41ms p(90)=165.03ms p(95)=173.88ms p(99.9)=446.05ms
       { expected_response:true }...: avg=134.15ms min=5.98ms  med=133.52ms max=628.41ms p(90)=165.03ms p(95)=173.88ms p(99.9)=446.05ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 22328
     http_req_receiving.............: avg=79.92µs  min=31.84µs med=54.78µs  max=7.6ms    p(90)=105.9µs  p(95)=134.7µs  p(99.9)=1.51ms  
     http_req_sending...............: avg=59.16µs  min=6.7µs   med=12µs     max=340.62ms p(90)=20.02µs  p(95)=35.69µs  p(99.9)=2.16ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=134.01ms min=5.93ms  med=133.41ms max=626.79ms p(90)=164.94ms p(95)=173.76ms p(99.9)=434.67ms
     http_reqs......................: 22328   367.36298/s
     iteration_duration.............: avg=135.08ms min=13.46ms med=133.95ms max=646.1ms  p(90)=165.39ms p(95)=174.24ms p(99.9)=467.45ms
     iterations.....................: 22228   365.717678/s
     success_rate...................: 100.00% ✓ 22228      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53097      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   339 kB/s
     http_req_blocked...............: avg=20.32µs  min=1.19µs  med=2.79µs   max=11.45ms  p(90)=4.54µs   p(95)=5.64µs   p(99.9)=7.49ms  
     http_req_connecting............: avg=16.55µs  min=0s      med=0s       max=11.42ms  p(90)=0s       p(95)=0s       p(99.9)=7.46ms  
     http_req_duration..............: avg=168.38ms min=7.01ms  med=156.51ms max=951.6ms  p(90)=189.49ms p(95)=289.24ms p(99.9)=943.88ms
       { expected_response:true }...: avg=168.38ms min=7.01ms  med=156.51ms max=951.6ms  p(90)=189.49ms p(95)=289.24ms p(99.9)=943.88ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 17799
     http_req_receiving.............: avg=102.81µs min=26.96µs med=47.62µs  max=134.28ms p(90)=101.9µs  p(95)=160.13µs p(99.9)=5.34ms  
     http_req_sending...............: avg=87.54µs  min=5.7µs   med=11.3µs   max=237.52ms p(90)=32.2µs   p(95)=122.16µs p(99.9)=4.89ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=168.19ms min=6.96ms  med=156.37ms max=951.52ms p(90)=189.24ms p(95)=269.14ms p(99.9)=943.84ms
     http_reqs......................: 17799   291.491848/s
     iteration_duration.............: avg=169.66ms min=25.46ms med=156.91ms max=951.89ms p(90)=190.02ms p(95)=305.13ms p(99.9)=944.19ms
     iterations.....................: 17699   289.854161/s
     success_rate...................: 100.00% ✓ 17699      ✗ 0    
     vus............................: 41      min=41       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51066      ✗ 0    
     data_received..................: 1.5 GB  25 MB/s
     data_sent......................: 20 MB   326 kB/s
     http_req_blocked...............: avg=21.95µs  min=1.22µs  med=3.09µs   max=12.37ms  p(90)=5µs      p(95)=6.26µs   p(99.9)=7.72ms  
     http_req_connecting............: avg=17.79µs  min=0s      med=0s       max=12.32ms  p(90)=0s       p(95)=0s       p(99.9)=7.69ms  
     http_req_duration..............: avg=175.03ms min=7.26ms  med=163.75ms max=655.82ms p(90)=194.46ms p(95)=326.83ms p(99.9)=540.39ms
       { expected_response:true }...: avg=175.03ms min=7.26ms  med=163.75ms max=655.82ms p(90)=194.46ms p(95)=326.83ms p(99.9)=540.39ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 17122
     http_req_receiving.............: avg=93.27µs  min=27.54µs med=52.15µs  max=10.9ms   p(90)=111.23µs p(95)=164.74µs p(99.9)=3.35ms  
     http_req_sending...............: avg=123.54µs min=5.75µs  med=11.84µs  max=349.21ms p(90)=32.63µs  p(95)=123.15µs p(99.9)=5.52ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=174.81ms min=7.17ms  med=163.59ms max=655.63ms p(90)=194.17ms p(95)=326.09ms p(99.9)=539.13ms
     http_reqs......................: 17122   280.488194/s
     iteration_duration.............: avg=176.45ms min=27.91ms med=164.21ms max=684.75ms p(90)=194.98ms p(95)=330.51ms p(99.9)=561.91ms
     iterations.....................: 17022   278.85002/s
     success_rate...................: 100.00% ✓ 17022      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21420      ✗ 0   
     data_received..................: 636 MB  10 MB/s
     data_sent......................: 8.4 MB  138 kB/s
     http_req_blocked...............: avg=47.87µs  min=1.38µs  med=3.07µs   max=12.23ms  p(90)=4.76µs   p(95)=5.61µs   p(99.9)=10.56ms 
     http_req_connecting............: avg=44.21µs  min=0s      med=0s       max=12.2ms   p(90)=0s       p(95)=0s       p(99.9)=10.53ms 
     http_req_duration..............: avg=414.84ms min=7.48ms  med=413.71ms max=868.22ms p(90)=470.11ms p(95)=486.54ms p(99.9)=821.13ms
       { expected_response:true }...: avg=414.84ms min=7.48ms  med=413.71ms max=868.22ms p(90)=470.11ms p(95)=486.54ms p(99.9)=821.13ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7240
     http_req_receiving.............: avg=76.1µs   min=30.34µs med=52.87µs  max=87.14ms  p(90)=95.42µs  p(95)=111.28µs p(99.9)=591.53µs
     http_req_sending...............: avg=139.76µs min=6.43µs  med=12.47µs  max=242.04ms p(90)=19.96µs  p(95)=23.31µs  p(99.9)=4.03ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=414.63ms min=7.43ms  med=413.62ms max=864.04ms p(90)=470ms    p(95)=486.42ms p(99.9)=820.29ms
     http_reqs......................: 7240    118.451046/s
     iteration_duration.............: avg=421.22ms min=50.74ms med=414.41ms max=918.3ms  p(90)=470.88ms p(95)=487.81ms p(99.9)=868.96ms
     iterations.....................: 7140    116.814982/s
     success_rate...................: 100.00% ✓ 7140       ✗ 0   
     vus............................: 24      min=24       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1785 111360 total, 0 failed avg: 125ms, p95: 301ms
grafbase 1529 96882 total, 0 failed avg: 143ms, p95: 334ms
cosmo 706 45182 total, 0 failed avg: 311ms, p95: 690ms
apollo-router 401 26904 total, 0 failed avg: 524ms, p95: 1213ms ❌ 23 unexpected GraphQL errors
hive-gateway 280 19590 total, 0 failed avg: 717ms, p95: 1555ms
hive-gateway-bun 258 17972 total, 0 failed avg: 779ms, p95: 1697ms
apollo-gateway 154 10656 total, 0 failed avg: 1223ms, p95: 2658ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 331080      ✗ 0     
     data_received..................: 9.8 GB  157 MB/s
     data_sent......................: 130 MB  2.1 MB/s
     http_req_blocked...............: avg=523µs    min=1.16µs  med=2.62µs   max=345.68ms p(90)=4.16µs   p(95)=4.98µs   p(99.9)=182.1ms 
     http_req_connecting............: avg=518.61µs min=0s      med=0s       max=345.62ms p(90)=0s       p(95)=0s       p(99.9)=181.97ms
     http_req_duration..............: avg=124.97ms min=1.58ms  med=113.24ms max=483.85ms p(90)=253.87ms p(95)=301.07ms p(99.9)=397.31ms
       { expected_response:true }...: avg=124.97ms min=1.58ms  med=113.24ms max=483.85ms p(90)=253.87ms p(95)=301.07ms p(99.9)=397.31ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 111360
     http_req_receiving.............: avg=570.83µs min=23.78µs med=42.6µs   max=127.46ms p(90)=106.59µs p(95)=408.05µs p(99.9)=84.3ms  
     http_req_sending...............: avg=459.19µs min=5.09µs  med=10.32µs  max=133.7ms  p(90)=26.56µs  p(95)=131.49µs p(99.9)=73.47ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=123.94ms min=1.53ms  med=112.17ms max=463.54ms p(90)=251.67ms p(95)=299.14ms p(99.9)=393.38ms
     http_reqs......................: 111360  1785.104194/s
     iteration_duration.............: avg=126.95ms min=1.71ms  med=115.02ms max=776.57ms p(90)=256.48ms p(95)=303.35ms p(99.9)=447.24ms
     iterations.....................: 110360  1769.074163/s
     success_rate...................: 100.00% ✓ 110360      ✗ 0     
     vus............................: 78      min=0         max=493 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 287646      ✗ 0    
     data_received..................: 8.5 GB  134 MB/s
     data_sent......................: 113 MB  1.8 MB/s
     http_req_blocked...............: avg=704.85µs min=1.18µs  med=2.92µs   max=449.06ms p(90)=4.25µs   p(95)=5.11µs   p(99.9)=221.68ms
     http_req_connecting............: avg=698.29µs min=0s      med=0s       max=432.99ms p(90)=0s       p(95)=0s       p(99.9)=221.52ms
     http_req_duration..............: avg=143.4ms  min=2.56ms  med=132.24ms max=500.65ms p(90)=284.58ms p(95)=334.39ms p(99.9)=430.32ms
       { expected_response:true }...: avg=143.4ms  min=2.56ms  med=132.24ms max=500.65ms p(90)=284.58ms p(95)=334.39ms p(99.9)=430.32ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 96882
     http_req_receiving.............: avg=659.62µs min=21.06µs med=48.23µs  max=149.24ms p(90)=109.98µs p(95)=436.97µs p(99.9)=88.21ms 
     http_req_sending...............: avg=584.14µs min=5.29µs  med=11.89µs  max=151.79ms p(90)=31.47µs  p(95)=140.53µs p(99.9)=83.83ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=142.16ms min=2.52ms  med=130.89ms max=445.02ms p(90)=282.49ms p(95)=332.29ms p(99.9)=425.74ms
     http_reqs......................: 96882   1529.281133/s
     iteration_duration.............: avg=146.16ms min=2.81ms  med=134.39ms max=948.17ms p(90)=287.99ms p(95)=337.87ms p(99.9)=529.58ms
     iterations.....................: 95882   1513.496146/s
     success_rate...................: 100.00% ✓ 95882       ✗ 0    
     vus............................: 77      min=0         max=493
     vus_max........................: 500     min=500       max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 132546     ✗ 0    
     data_received..................: 4.0 GB  62 MB/s
     data_sent......................: 53 MB   823 kB/s
     http_req_blocked...............: avg=98.7µs   min=1.3µs  med=2.8µs    max=148.8ms  p(90)=4.14µs   p(95)=5.76µs   p(99.9)=30.82ms 
     http_req_connecting............: avg=94.29µs  min=0s     med=0s       max=148.73ms p(90)=0s       p(95)=0s       p(99.9)=30.75ms 
     http_req_duration..............: avg=310.74ms min=2.82ms med=293.95ms max=1.14s    p(90)=612ms    p(95)=689.64ms p(99.9)=994.51ms
       { expected_response:true }...: avg=310.74ms min=2.82ms med=293.95ms max=1.14s    p(90)=612ms    p(95)=689.64ms p(99.9)=994.51ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 45182
     http_req_receiving.............: avg=464.68µs min=27.5µs med=58.95µs  max=128.43ms p(90)=174.07µs p(95)=475.31µs p(99.9)=67.38ms 
     http_req_sending...............: avg=162.87µs min=5.69µs med=11.04µs  max=92.24ms  p(90)=30.39µs  p(95)=127.79µs p(99.9)=35.7ms  
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=310.12ms min=2.73ms med=293.19ms max=1.14s    p(90)=611.44ms p(95)=688.85ms p(99.9)=993.52ms
     http_reqs......................: 45182   706.914541/s
     iteration_duration.............: avg=318.28ms min=3.04ms med=302.34ms max=1.14s    p(90)=615.4ms  p(95)=693.66ms p(99.9)=995.91ms
     iterations.....................: 44182   691.268609/s
     success_rate...................: 100.00% ✓ 44182      ✗ 0    
     vus............................: 58      min=0        max=498
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 25881 / ✗ 23
     ✓ valid response structure

     checks.........................: 99.97% ✓ 77689      ✗ 23   
     data_received..................: 2.4 GB 35 MB/s
     data_sent......................: 31 MB  469 kB/s
     http_req_blocked...............: avg=113.43µs min=1.52µs  med=2.94µs   max=165.6ms  p(90)=4.54µs   p(95)=6.34µs   p(99.9)=34.21ms
     http_req_connecting............: avg=108.06µs min=0s      med=0s       max=165.55ms p(90)=0s       p(95)=0s       p(99.9)=34.15ms
     http_req_duration..............: avg=523.92ms min=6.06ms  med=480.53ms max=1.95s    p(90)=1.06s    p(95)=1.21s    p(99.9)=1.71s  
       { expected_response:true }...: avg=523.92ms min=6.06ms  med=480.53ms max=1.95s    p(90)=1.06s    p(95)=1.21s    p(99.9)=1.71s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 26904
     http_req_receiving.............: avg=121.46µs min=28.91µs med=51.53µs  max=68.07ms  p(90)=100.53µs p(95)=203.36µs p(99.9)=10.83ms
     http_req_sending...............: avg=134.94µs min=6.71µs  med=11.42µs  max=81.12ms  p(90)=30.72µs  p(95)=122.92µs p(99.9)=29.11ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=523.67ms min=5.99ms  med=480.34ms max=1.95s    p(90)=1.06s    p(95)=1.21s    p(99.9)=1.71s  
     http_reqs......................: 26904  401.797489/s
     iteration_duration.............: avg=544.68ms min=6.37ms  med=502.8ms  max=1.95s    p(90)=1.07s    p(95)=1.22s    p(99.9)=1.71s  
     iterations.....................: 25904  386.863/s
     success_rate...................: 99.91% ✓ 25881      ✗ 23   
     vus............................: 62     min=0        max=498
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55770      ✗ 0    
     data_received..................: 1.7 GB  25 MB/s
     data_sent......................: 23 MB   329 kB/s
     http_req_blocked...............: avg=91.14µs  min=1.06µs  med=2.7µs    max=119.04ms p(90)=4.5µs   p(95)=6.34µs   p(99.9)=21.33ms
     http_req_connecting............: avg=86.32µs  min=0s      med=0s       max=118.85ms p(90)=0s      p(95)=0s       p(99.9)=21.28ms
     http_req_duration..............: avg=716.95ms min=7.34ms  med=677.16ms max=4.42s    p(90)=1.42s   p(95)=1.55s    p(99.9)=3.26s  
       { expected_response:true }...: avg=716.95ms min=7.34ms  med=677.16ms max=4.42s    p(90)=1.42s   p(95)=1.55s    p(99.9)=3.26s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 19590
     http_req_receiving.............: avg=152.03µs min=24.94µs med=45.12µs  max=81.94ms  p(90)=83.5µs  p(95)=135.99µs p(99.9)=21.04ms
     http_req_sending...............: avg=161.42µs min=4.35µs  med=9.88µs   max=78.41ms  p(90)=22.37µs p(95)=98.35µs  p(99.9)=24.76ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=716.63ms min=7.29ms  med=676.57ms max=4.42s    p(90)=1.42s   p(95)=1.55s    p(99.9)=3.25s  
     http_reqs......................: 19590   280.819507/s
     iteration_duration.............: avg=755.71ms min=8.02ms  med=715.38ms max=4.44s    p(90)=1.43s   p(95)=1.56s    p(99.9)=3.32s  
     iterations.....................: 18590   266.484667/s
     success_rate...................: 100.00% ✓ 18590      ✗ 0    
     vus............................: 102     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 50916      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   304 kB/s
     http_req_blocked...............: avg=132.29µs min=1.28µs med=2.92µs   max=175.89ms p(90)=4.74µs  p(95)=8.66µs   p(99.9)=33.02ms
     http_req_connecting............: avg=126.81µs min=0s     med=0s       max=175.85ms p(90)=0s      p(95)=0s       p(99.9)=32.96ms
     http_req_duration..............: avg=778.69ms min=6.67ms med=711.37ms max=5.49s    p(90)=1.56s   p(95)=1.69s    p(99.9)=4.21s  
       { expected_response:true }...: avg=778.69ms min=6.67ms med=711.37ms max=5.49s    p(90)=1.56s   p(95)=1.69s    p(99.9)=4.21s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17972
     http_req_receiving.............: avg=180.64µs min=27.4µs med=44.56µs  max=121.41ms p(90)=91.97µs p(95)=292.03µs p(99.9)=27.59ms
     http_req_sending...............: avg=205.85µs min=5.87µs med=11.15µs  max=104.16ms p(90)=32.5µs  p(95)=129.3µs  p(99.9)=33.6ms 
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=778.31ms min=6.59ms med=710.86ms max=5.49s    p(90)=1.56s   p(95)=1.69s    p(99.9)=4.2s   
     http_reqs......................: 17972   258.860557/s
     iteration_duration.............: avg=824.97ms min=6.82ms med=775.6ms  max=5.5s     p(90)=1.57s   p(95)=1.7s     p(99.9)=4.27s  
     iterations.....................: 16972   244.45701/s
     success_rate...................: 100.00% ✓ 16972      ✗ 0    
     vus............................: 84      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 28968      ✗ 0    
     data_received..................: 936 MB  14 MB/s
     data_sent......................: 13 MB   185 kB/s
     http_req_blocked...............: avg=25.68µs min=1.3µs   med=3.28µs  max=21.55ms p(90)=5.43µs  p(95)=17.2µs   p(99.9)=3.51ms
     http_req_connecting............: avg=17.73µs min=0s      med=0s      max=16.45ms p(90)=0s      p(95)=0s       p(99.9)=2.9ms 
     http_req_duration..............: avg=1.22s   min=7.42ms  med=1.18s   max=16.13s  p(90)=2.14s   p(95)=2.65s    p(99.9)=14.61s
       { expected_response:true }...: avg=1.22s   min=7.42ms  med=1.18s   max=16.13s  p(90)=2.14s   p(95)=2.65s    p(99.9)=14.61s
     http_req_failed................: 0.00%   ✓ 0          ✗ 10656
     http_req_receiving.............: avg=72.54µs min=27.13µs med=53.72µs max=8.64ms  p(90)=98.29µs p(95)=121.23µs p(99.9)=1.08ms
     http_req_sending...............: avg=38.84µs min=5.9µs   med=12.53µs max=17.85ms p(90)=30.25µs p(95)=47.77µs  p(99.9)=6.06ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s      p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.22s   min=7.37ms  med=1.18s   max=16.13s  p(90)=2.14s   p(95)=2.65s    p(99.9)=14.61s
     http_reqs......................: 10656   154.705058/s
     iteration_duration.............: avg=1.34s   min=7.59ms  med=1.32s   max=16.14s  p(90)=2.18s   p(95)=2.7s     p(99.9)=14.68s
     iterations.....................: 9656    140.186941/s
     success_rate...................: 100.00% ✓ 9656       ✗ 0    
     vus............................: 68      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13992 total, 0 failed avg: 216ms, p95: 228ms
hive-router 170 13745 total, 0 failed avg: 220ms, p95: 230ms
cosmo 166 13483 total, 0 failed avg: 224ms, p95: 247ms
hive-gateway-bun 163 12536 total, 0 failed avg: 241ms, p95: 266ms
hive-gateway 162 12411 total, 0 failed avg: 243ms, p95: 272ms
apollo-router 134 10970 total, 0 failed avg: 275ms, p95: 315ms
apollo-gateway 119 9778 total, 0 failed avg: 309ms, p95: 344ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41676      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=19.56µs  min=1.19µs   med=1.93µs   max=9.29ms   p(90)=3.6µs    p(95)=5.19µs   p(99.9)=6.84ms  
     http_req_connecting............: avg=16.86µs  min=0s       med=0s       max=9.26ms   p(90)=0s       p(95)=0s       p(99.9)=6.83ms  
     http_req_duration..............: avg=215.89ms min=155.68ms med=215.05ms max=591.23ms p(90)=224.88ms p(95)=227.53ms p(99.9)=522.05ms
       { expected_response:true }...: avg=215.89ms min=155.68ms med=215.05ms max=591.23ms p(90)=224.88ms p(95)=227.53ms p(99.9)=522.05ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13992
     http_req_receiving.............: avg=85.87µs  min=26.71µs  med=47.35µs  max=22.61ms  p(90)=102.39µs p(95)=258.27µs p(99.9)=4.1ms   
     http_req_sending...............: avg=142.85µs min=5.44µs   med=8.44µs   max=366.17ms p(90)=30.44µs  p(95)=96.9µs   p(99.9)=9.23ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.66ms min=155.62ms med=214.92ms max=590.24ms p(90)=224.7ms  p(95)=227.33ms p(99.9)=479.74ms
     http_reqs......................: 13992   172.836225/s
     iteration_duration.............: avg=216.21ms min=155.96ms med=215.29ms max=622.38ms p(90)=225.1ms  p(95)=227.72ms p(99.9)=542.69ms
     iterations.....................: 13892   171.600975/s
     success_rate...................: 100.00% ✓ 13892      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40935      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   198 kB/s
     http_req_blocked...............: avg=19.4µs   min=1.14µs   med=1.91µs   max=9.3ms    p(90)=2.97µs   p(95)=4.06µs   p(99.9)=6.91ms  
     http_req_connecting............: avg=16.99µs  min=0s       med=0s       max=9.27ms   p(90)=0s       p(95)=0s       p(99.9)=6.89ms  
     http_req_duration..............: avg=219.61ms min=112.09ms med=218.75ms max=582.39ms p(90)=227.07ms p(95)=229.78ms p(99.9)=507.59ms
       { expected_response:true }...: avg=219.61ms min=112.09ms med=218.75ms max=582.39ms p(90)=227.07ms p(95)=229.78ms p(99.9)=507.59ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13745
     http_req_receiving.............: avg=70.02µs  min=24.18µs  med=42.29µs  max=8.77ms   p(90)=82.11µs  p(95)=233.87µs p(99.9)=1.56ms  
     http_req_sending...............: avg=96.19µs  min=5.46µs   med=8.16µs   max=363.92ms p(90)=27.17µs  p(95)=96.42µs  p(99.9)=5.36ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=219.45ms min=108.35ms med=218.67ms max=581.46ms p(90)=226.93ms p(95)=229.6ms  p(99.9)=478.48ms
     http_reqs......................: 13745   170.140704/s
     iteration_duration.............: avg=219.95ms min=112.27ms med=219ms    max=604.01ms p(90)=227.24ms p(95)=229.95ms p(99.9)=531.89ms
     iterations.....................: 13645   168.902867/s
     success_rate...................: 100.00% ✓ 13645      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40149      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=20.77µs  min=1.29µs   med=2.81µs   max=9.18ms   p(90)=4.16µs   p(95)=5.2µs    p(99.9)=6.8ms   
     http_req_connecting............: avg=17.11µs  min=0s       med=0s       max=9.13ms   p(90)=0s       p(95)=0s       p(99.9)=6.78ms  
     http_req_duration..............: avg=224.07ms min=124.97ms med=222.81ms max=647.04ms p(90)=240.81ms p(95)=246.54ms p(99.9)=524.95ms
       { expected_response:true }...: avg=224.07ms min=124.97ms med=222.81ms max=647.04ms p(90)=240.81ms p(95)=246.54ms p(99.9)=524.95ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13483
     http_req_receiving.............: avg=452.74µs min=30.59µs  med=62.15µs  max=98.64ms  p(90)=269.79µs p(95)=723.29µs p(99.9)=24.66ms 
     http_req_sending...............: avg=102.22µs min=5.65µs   med=11.06µs  max=235.21ms p(90)=30.76µs  p(95)=126.54µs p(99.9)=4.14ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.51ms min=124.91ms med=222.38ms max=635.55ms p(90)=240.26ms p(95)=245.91ms p(99.9)=523.83ms
     http_reqs......................: 13483   166.462069/s
     iteration_duration.............: avg=224.55ms min=125.2ms  med=223.21ms max=655.1ms  p(90)=241.13ms p(95)=246.86ms p(99.9)=553.63ms
     iterations.....................: 13383   165.227462/s
     success_rate...................: 100.00% ✓ 13383      ✗ 0    
     vus............................: 29      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 37308      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   190 kB/s
     http_req_blocked...............: avg=21.49µs  min=959ns    med=2.66µs   max=9.04ms   p(90)=4.47µs   p(95)=6.04µs   p(99.9)=6.91ms  
     http_req_connecting............: avg=18.22µs  min=0s       med=0s       max=9.01ms   p(90)=0s       p(95)=0s       p(99.9)=6.88ms  
     http_req_duration..............: avg=240.83ms min=145.31ms med=232.96ms max=691.34ms p(90)=254.88ms p(95)=265.57ms p(99.9)=629.68ms
       { expected_response:true }...: avg=240.83ms min=145.31ms med=232.96ms max=691.34ms p(90)=254.88ms p(95)=265.57ms p(99.9)=629.68ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12536
     http_req_receiving.............: avg=91.79µs  min=23.7µs   med=46.07µs  max=112.95ms p(90)=97.69µs  p(95)=200.3µs  p(99.9)=3.04ms  
     http_req_sending...............: avg=128.51µs min=4.33µs   med=10.16µs  max=191.85ms p(90)=22.86µs  p(95)=120.81µs p(99.9)=7.96ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=240.61ms min=141.74ms med=232.84ms max=690.5ms  p(90)=254.66ms p(95)=265.23ms p(99.9)=629.62ms
     http_reqs......................: 12536   163.596175/s
     iteration_duration.............: avg=241.73ms min=145.57ms med=233.3ms  max=744.28ms p(90)=255.16ms p(95)=266.09ms p(99.9)=630.42ms
     iterations.....................: 12436   162.291164/s
     success_rate...................: 100.00% ✓ 12436      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36933      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   189 kB/s
     http_req_blocked...............: avg=24.06µs  min=1.22µs   med=2.66µs   max=10.08ms  p(90)=4.19µs   p(95)=5.61µs   p(99.9)=7.78ms
     http_req_connecting............: avg=20.64µs  min=0s       med=0s       max=10.04ms  p(90)=0s       p(95)=0s       p(99.9)=7.76ms
     http_req_duration..............: avg=243.35ms min=160.55ms med=234.92ms max=1.4s     p(90)=259.67ms p(95)=272ms    p(99.9)=1.4s  
       { expected_response:true }...: avg=243.35ms min=160.55ms med=234.92ms max=1.4s     p(90)=259.67ms p(95)=272ms    p(99.9)=1.4s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 12411
     http_req_receiving.............: avg=93.55µs  min=25.85µs  med=46.3µs   max=12.4ms   p(90)=105.18µs p(95)=285.16µs p(99.9)=4.3ms 
     http_req_sending...............: avg=113.33µs min=5.61µs   med=11µs     max=246.91ms p(90)=33.81µs  p(95)=133.36µs p(99.9)=5.31ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=243.14ms min=160.47ms med=234.79ms max=1.4s     p(90)=259.42ms p(95)=271.67ms p(99.9)=1.4s  
     http_reqs......................: 12411   162.087895/s
     iteration_duration.............: avg=244.36ms min=163.62ms med=235.34ms max=1.4s     p(90)=260.07ms p(95)=272.4ms  p(99.9)=1.4s  
     iterations.....................: 12311   160.781893/s
     success_rate...................: 100.00% ✓ 12311      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32610      ✗ 0    
     data_received..................: 963 MB  12 MB/s
     data_sent......................: 13 MB   157 kB/s
     http_req_blocked...............: avg=23.07µs  min=1.3µs    med=2.85µs   max=7.95ms   p(90)=4.24µs   p(95)=5.48µs   p(99.9)=6.28ms  
     http_req_connecting............: avg=18.65µs  min=0s       med=0s       max=7.92ms   p(90)=0s       p(95)=0s       p(99.9)=6.27ms  
     http_req_duration..............: avg=275.21ms min=138.79ms med=276.68ms max=676.26ms p(90)=306.78ms p(95)=314.83ms p(99.9)=580.56ms
       { expected_response:true }...: avg=275.21ms min=138.79ms med=276.68ms max=676.26ms p(90)=306.78ms p(95)=314.83ms p(99.9)=580.56ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10970
     http_req_receiving.............: avg=126.96µs min=31.52µs  med=52.27µs  max=11.4ms   p(90)=152.74µs p(95)=434.97µs p(99.9)=6ms     
     http_req_sending...............: avg=150.66µs min=6.29µs   med=11.38µs  max=349.32ms p(90)=65.85µs  p(95)=142.32µs p(99.9)=5.29ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=274.93ms min=138.73ms med=276.44ms max=675.16ms p(90)=306.56ms p(95)=314.5ms  p(99.9)=579.19ms
     http_reqs......................: 10970   134.684883/s
     iteration_duration.............: avg=276.24ms min=139.02ms med=277.33ms max=696.28ms p(90)=307.18ms p(95)=315.33ms p(99.9)=630.51ms
     iterations.....................: 10870   133.457127/s
     success_rate...................: 100.00% ✓ 10870      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 29034      ✗ 0   
     data_received..................: 859 MB  11 MB/s
     data_sent......................: 11 MB   139 kB/s
     http_req_blocked...............: avg=35.42µs  min=1.46µs   med=3.93µs   max=11.57ms  p(90)=6.03µs   p(95)=7.25µs   p(99.9)=9.51ms  
     http_req_connecting............: avg=29.91µs  min=0s       med=0s       max=11.53ms  p(90)=0s       p(95)=0s       p(99.9)=9.49ms  
     http_req_duration..............: avg=308.9ms  min=212.21ms med=306.52ms max=875.55ms p(90)=334.12ms p(95)=344.28ms p(99.9)=780.27ms
       { expected_response:true }...: avg=308.9ms  min=212.21ms med=306.52ms max=875.55ms p(90)=334.12ms p(95)=344.28ms p(99.9)=780.27ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 9778
     http_req_receiving.............: avg=138.27µs min=32.34µs  med=74.66µs  max=232.38ms p(90)=126.83µs p(95)=164µs    p(99.9)=2.3ms   
     http_req_sending...............: avg=87.57µs  min=6.97µs   med=15.34µs  max=281.41ms p(90)=30.56µs  p(95)=44.73µs  p(99.9)=5.37ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=308.67ms min=212.1ms  med=306.38ms max=844.29ms p(90)=333.98ms p(95)=344.13ms p(99.9)=741.34ms
     http_reqs......................: 9778    119.610839/s
     iteration_duration.............: avg=310.46ms min=217.24ms med=307.09ms max=916.95ms p(90)=334.55ms p(95)=344.71ms p(99.9)=834.62ms
     iterations.....................: 9678    118.387574/s
     success_rate...................: 100.00% ✓ 9678       ✗ 0   
     vus............................: 50      min=0        max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 171 13886 total, 0 failed avg: 218ms, p95: 229ms
hive-router 166 13492 total, 0 failed avg: 224ms, p95: 236ms
cosmo 162 13148 total, 0 failed avg: 230ms, p95: 248ms
hive-gateway-bun 148 11367 total, 0 failed avg: 266ms, p95: 364ms
hive-gateway 142 10913 total, 0 failed avg: 277ms, p95: 383ms
apollo-router 126 10277 total, 0 failed avg: 294ms, p95: 339ms
apollo-gateway 85 6958 total, 0 failed avg: 435ms, p95: 479ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41358      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   199 kB/s
     http_req_blocked...............: avg=15.48µs  min=1.07µs   med=2.09µs   max=7.17ms   p(90)=3.68µs   p(95)=5.45µs   p(99.9)=5.05ms  
     http_req_connecting............: avg=12.83µs  min=0s       med=0s       max=7.14ms   p(90)=0s       p(95)=0s       p(99.9)=5.03ms  
     http_req_duration..............: avg=217.67ms min=130.96ms med=216.8ms  max=645.98ms p(90)=226.14ms p(95)=229.11ms p(99.9)=535.13ms
       { expected_response:true }...: avg=217.67ms min=130.96ms med=216.8ms  max=645.98ms p(90)=226.14ms p(95)=229.11ms p(99.9)=535.13ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13886
     http_req_receiving.............: avg=89.2µs   min=25.63µs  med=45.57µs  max=101.68ms p(90)=95.3µs   p(95)=273.16µs p(99.9)=5.2ms   
     http_req_sending...............: avg=64.24µs  min=4.76µs   med=8.15µs   max=206.08ms p(90)=23.41µs  p(95)=96.33µs  p(99.9)=7.03ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=217.52ms min=130.89ms med=216.7ms  max=640.11ms p(90)=226.01ms p(95)=228.92ms p(99.9)=534.45ms
     http_reqs......................: 13886   171.289126/s
     iteration_duration.............: avg=218.05ms min=131.14ms med=217.04ms max=663.55ms p(90)=226.37ms p(95)=229.3ms  p(99.9)=561.37ms
     iterations.....................: 13786   170.055588/s
     success_rate...................: 100.00% ✓ 13786      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40176      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=19.96µs  min=1.25µs   med=2.25µs   max=9.25ms   p(90)=3.39µs   p(95)=4.59µs   p(99.9)=6.84ms  
     http_req_connecting............: avg=17.25µs  min=0s       med=0s       max=9.22ms   p(90)=0s       p(95)=0s       p(99.9)=6.82ms  
     http_req_duration..............: avg=224.05ms min=124.92ms med=222.79ms max=641.7ms  p(90)=232.95ms p(95)=236.09ms p(99.9)=543.06ms
       { expected_response:true }...: avg=224.05ms min=124.92ms med=222.79ms max=641.7ms  p(90)=232.95ms p(95)=236.09ms p(99.9)=543.06ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13492
     http_req_receiving.............: avg=79.34µs  min=26µs     med=44.2µs   max=11.91ms  p(90)=93.51µs  p(95)=258.31µs p(99.9)=2.99ms  
     http_req_sending...............: avg=138.86µs min=5.42µs   med=9.26µs   max=409.75ms p(90)=29.61µs  p(95)=99.45µs  p(99.9)=6.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.84ms min=120.87ms med=222.68ms max=640.75ms p(90)=232.82ms p(95)=235.95ms p(99.9)=527.75ms
     http_reqs......................: 13492   166.610248/s
     iteration_duration.............: avg=224.43ms min=125.22ms med=223.05ms max=665.06ms p(90)=233.16ms p(95)=236.29ms p(99.9)=559.61ms
     iterations.....................: 13392   165.375366/s
     success_rate...................: 100.00% ✓ 13392      ✗ 0    
     vus............................: 3       min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 39144      ✗ 0    
     data_received..................: 1.2 GB  14 MB/s
     data_sent......................: 15 MB   189 kB/s
     http_req_blocked...............: avg=21.3µs   min=1.37µs   med=2.57µs   max=9.44ms   p(90)=3.81µs   p(95)=4.77µs   p(99.9)=7.1ms   
     http_req_connecting............: avg=18.08µs  min=0s       med=0s       max=9.41ms   p(90)=0s       p(95)=0s       p(99.9)=7.08ms  
     http_req_duration..............: avg=229.82ms min=166.91ms med=229.41ms max=648.06ms p(90)=243.61ms p(95)=248.19ms p(99.9)=531.8ms 
       { expected_response:true }...: avg=229.82ms min=166.91ms med=229.41ms max=648.06ms p(90)=243.61ms p(95)=248.19ms p(99.9)=531.8ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13148
     http_req_receiving.............: avg=346.41µs min=31.5µs   med=64.79µs  max=266.05ms p(90)=221.85µs p(95)=499.55µs p(99.9)=28.11ms 
     http_req_sending...............: avg=121.66µs min=5.96µs   med=10.76µs  max=312.36ms p(90)=29.46µs  p(95)=118.92µs p(99.9)=4.11ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=229.35ms min=166.74ms med=229.08ms max=632.15ms p(90)=243.07ms p(95)=247.54ms p(99.9)=518.45ms
     http_reqs......................: 13148   162.255929/s
     iteration_duration.............: avg=230.32ms min=167.27ms med=229.77ms max=662.41ms p(90)=243.89ms p(95)=248.47ms p(99.9)=555.21ms
     iterations.....................: 13048   161.021856/s
     success_rate...................: 100.00% ✓ 13048      ✗ 0    
     vus............................: 24      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33801      ✗ 0    
     data_received..................: 998 MB  13 MB/s
     data_sent......................: 13 MB   173 kB/s
     http_req_blocked...............: avg=28.53µs  min=1.13µs   med=2.62µs   max=11.59ms  p(90)=4.06µs   p(95)=5.24µs   p(99.9)=9.12ms  
     http_req_connecting............: avg=25.11µs  min=0s       med=0s       max=11.56ms  p(90)=0s       p(95)=0s       p(99.9)=9.06ms  
     http_req_duration..............: avg=265.57ms min=156.87ms med=256.87ms max=679.16ms p(90)=276.05ms p(95)=363.73ms p(99.9)=587.25ms
       { expected_response:true }...: avg=265.57ms min=156.87ms med=256.87ms max=679.16ms p(90)=276.05ms p(95)=363.73ms p(99.9)=587.25ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11367
     http_req_receiving.............: avg=92.91µs  min=25.14µs  med=43.93µs  max=18.91ms  p(90)=100.09µs p(95)=348.31µs p(99.9)=4.19ms  
     http_req_sending...............: avg=111.24µs min=5.41µs   med=10.78µs  max=199.39ms p(90)=34.62µs  p(95)=144.88µs p(99.9)=9.41ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=265.36ms min=156.82ms med=256.72ms max=678.09ms p(90)=275.78ms p(95)=363.01ms p(99.9)=585.78ms
     http_reqs......................: 11367   148.744941/s
     iteration_duration.............: avg=266.83ms min=157.11ms med=257.21ms max=705.51ms p(90)=276.45ms p(95)=364.69ms p(99.9)=631.92ms
     iterations.....................: 11267   147.436373/s
     success_rate...................: 100.00% ✓ 11267      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32439      ✗ 0    
     data_received..................: 958 MB  13 MB/s
     data_sent......................: 13 MB   165 kB/s
     http_req_blocked...............: avg=29.81µs  min=1.2µs    med=2.73µs   max=11.62ms  p(90)=4.55µs   p(95)=5.96µs   p(99.9)=9.15ms  
     http_req_connecting............: avg=26.17µs  min=0s       med=0s       max=11.58ms  p(90)=0s       p(95)=0s       p(99.9)=9.13ms  
     http_req_duration..............: avg=276.69ms min=133.66ms med=266.93ms max=720.29ms p(90)=284.75ms p(95)=382.8ms  p(99.9)=609.89ms
       { expected_response:true }...: avg=276.69ms min=133.66ms med=266.93ms max=720.29ms p(90)=284.75ms p(95)=382.8ms  p(99.9)=609.89ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10913
     http_req_receiving.............: avg=122.12µs min=26.16µs  med=47.12µs  max=159.03ms p(90)=113.84µs p(95)=386.32µs p(99.9)=4.62ms  
     http_req_sending...............: avg=135.07µs min=5.7µs    med=11.12µs  max=193.37ms p(90)=37.26µs  p(95)=158.58µs p(99.9)=7.75ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=276.44ms min=133.59ms med=266.8ms  max=711.72ms p(90)=284.47ms p(95)=365.01ms p(99.9)=606.5ms 
     http_reqs......................: 10913   142.182221/s
     iteration_duration.............: avg=278.12ms min=133.92ms med=267.34ms max=736.62ms p(90)=285.33ms p(95)=386.09ms p(99.9)=650.92ms
     iterations.....................: 10813   140.879351/s
     success_rate...................: 100.00% ✓ 10813      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30531      ✗ 0    
     data_received..................: 902 MB  11 MB/s
     data_sent......................: 12 MB   147 kB/s
     http_req_blocked...............: avg=24.17µs  min=1.74µs   med=2.72µs   max=8.07ms   p(90)=3.98µs   p(95)=4.93µs   p(99.9)=6.51ms  
     http_req_connecting............: avg=20.45µs  min=0s       med=0s       max=8.04ms   p(90)=0s       p(95)=0s       p(99.9)=6.49ms  
     http_req_duration..............: avg=294.18ms min=180.98ms med=295.56ms max=692.5ms  p(90)=329.05ms p(95)=338.62ms p(99.9)=616.58ms
       { expected_response:true }...: avg=294.18ms min=180.98ms med=295.56ms max=692.5ms  p(90)=329.05ms p(95)=338.62ms p(99.9)=616.58ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10277
     http_req_receiving.............: avg=84.29µs  min=35.13µs  med=50.04µs  max=4.12ms   p(90)=97.38µs  p(95)=233µs    p(99.9)=1.67ms  
     http_req_sending...............: avg=126.68µs min=7.41µs   med=10.94µs  max=304.77ms p(90)=28.92µs  p(95)=142.11µs p(99.9)=3.32ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=293.97ms min=180.92ms med=295.37ms max=691.29ms p(90)=328.89ms p(95)=338.42ms p(99.9)=615.39ms
     http_reqs......................: 10277   126.014463/s
     iteration_duration.............: avg=295.38ms min=181.15ms med=296.17ms max=702.61ms p(90)=329.43ms p(95)=338.95ms p(99.9)=650.79ms
     iterations.....................: 10177   124.788284/s
     success_rate...................: 100.00% ✓ 10177      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20574     ✗ 0   
     data_received..................: 611 MB  7.5 MB/s
     data_sent......................: 8.1 MB  99 kB/s
     http_req_blocked...............: avg=46.51µs  min=1.37µs   med=3.28µs   max=11.69ms  p(90)=5.15µs   p(95)=5.76µs   p(99.9)=9.81ms  
     http_req_connecting............: avg=42.45µs  min=0s       med=0s       max=11.65ms  p(90)=0s       p(95)=0s       p(99.9)=9.77ms  
     http_req_duration..............: avg=434.81ms min=212.14ms med=437.53ms max=1s       p(90)=464.69ms p(95)=479.19ms p(99.9)=911.24ms
       { expected_response:true }...: avg=434.81ms min=212.14ms med=437.53ms max=1s       p(90)=464.69ms p(95)=479.19ms p(99.9)=911.24ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 6958
     http_req_receiving.............: avg=89.29µs  min=27.01µs  med=64.21µs  max=101.91ms p(90)=107.84µs p(95)=127.36µs p(99.9)=1.02ms  
     http_req_sending...............: avg=90.03µs  min=6.18µs   med=13.78µs  max=267.59ms p(90)=22.11µs  p(95)=30.86µs  p(99.9)=1.39ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=434.64ms min=212.04ms med=437.43ms max=1s       p(90)=464.56ms p(95)=478.89ms p(99.9)=910.98ms
     http_reqs......................: 6958    85.105895/s
     iteration_duration.............: avg=438.7ms  min=274.2ms  med=438.04ms max=1.04s    p(90)=465.25ms p(95)=479.93ms p(99.9)=960.52ms
     iterations.....................: 6858    83.882758/s
     success_rate...................: 100.00% ✓ 6858      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 77f2f05 into main Oct 30, 2025
34 checks passed
@ardatan ardatan deleted the renovate/apollo-graphql-packages branch October 30, 2025 14:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant