Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ignore me, testing build stuff #55267

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

jakebailey
Copy link
Member

No description provided.

@jakebailey
Copy link
Member Author

@typescript-bot pack this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 4, 2023

Heya @jakebailey, I've started to run the tarball bundle task on this PR at 63e8eae. You can monitor the build here.

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 4, 2023

Hey @jakebailey, I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/156239/artifacts?artifactName=tgz&fileId=9C693591393572DE27206905AC214EF7A645084F8DDDED5392E1E9AD1EAB369502&fileName=/typescript-5.2.0-insiders.20230804.tgz"
    }
}

and then running npm install.


There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/[email protected]".;

@jakebailey
Copy link
Member Author

@typescript-bot pack this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 4, 2023

Heya @jakebailey, I've started to run the tarball bundle task on this PR at 63e8eae. You can monitor the build here.

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 4, 2023

Hey @jakebailey, I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/156240/artifacts?artifactName=tgz&fileId=9C693591393572DE27206905AC214EF7A645084F8DDDED5392E1E9AD1EAB369502&fileName=/typescript-5.2.0-insiders.20230804.tgz"
    }
}

and then running npm install.


There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/[email protected]".;

@jakebailey
Copy link
Member Author

@typescript-bot pack this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 4, 2023

Heya @jakebailey, I've started to run the tarball bundle task on this PR at 63e8eae. You can monitor the build here.

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 4, 2023

Hey @jakebailey, I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/156246/artifacts?artifactName=tgz&fileId=1C81B256BB8001203E5CD3EF144ABC97CC87E40C0F26A924F925228CFC60433002&fileName=/typescript-5.2.0-insiders.20230804.tgz"
    }
}

and then running npm install.


There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/[email protected]".;

@jakebailey
Copy link
Member Author

@typescript-bot new perf test bun

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 30, 2023

Heya @jakebailey, I've started to run the bun perf test suite on this PR at 63e8eae. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Angular - bun (v0.7.3, x64)
Memory used 322,062k (± 0.30%) 322,686k (± 0.13%) ~ 322,195k 323,191k p=0.230 n=6
Parse Time 2.32s (± 1.18%) 2.33s (± 1.12%) ~ 2.31s 2.38s p=0.145 n=6
Bind Time 0.98s (± 6.25%) 0.96s (± 5.47%) ~ 0.87s 1.02s p=0.470 n=6
Check Time 7.88s (± 1.52%) 7.94s (± 2.39%) ~ 7.75s 8.17s p=0.873 n=6
Emit Time 6.43s (± 1.15%) 6.46s (± 0.76%) ~ 6.40s 6.53s p=0.873 n=6
Total Time 17.61s (± 0.69%) 17.68s (± 0.82%) ~ 17.54s 17.84s p=0.628 n=6
Compiler-Unions - bun (v0.7.3, x64)
Memory used 243,101k (± 2.27%) 243,636k (± 2.78%) ~ 240,454k 257,425k p=0.689 n=6
Parse Time 1.27s (± 1.89%) 1.26s (± 0.44%) ~ 1.25s 1.26s p=0.236 n=6
Bind Time 0.85s (± 1.73%) 0.85s (± 1.88%) ~ 0.83s 0.88s p=0.933 n=6
Check Time 8.92s (± 0.46%) 8.91s (± 0.48%) ~ 8.87s 8.98s p=0.808 n=6
Emit Time 2.75s (± 1.42%) 2.76s (± 0.99%) ~ 2.73s 2.80s p=0.936 n=6
Total Time 13.80s (± 0.59%) 13.77s (± 0.50%) ~ 13.70s 13.89s p=0.520 n=6
Monaco - bun (v0.7.3, x64)
Memory used 369,778k (± 0.25%) 370,498k (± 0.31%) ~ 369,470k 372,221k p=0.066 n=6
Parse Time 2.05s (± 0.48%) 2.06s (± 0.27%) ~ 2.05s 2.06s p=0.201 n=6
Bind Time 1.08s (± 1.48%) 1.09s (± 1.58%) ~ 1.07s 1.11s p=0.452 n=6
Check Time 7.20s (± 0.55%) 7.16s (± 0.87%) ~ 7.07s 7.24s p=0.149 n=6
Emit Time 3.80s (± 1.40%) 3.74s (± 0.55%) -0.06s (- 1.49%) 3.72s 3.77s p=0.044 n=6
Total Time 14.13s (± 0.41%) 14.04s (± 0.38%) -0.09s (- 0.66%) 13.99s 14.13s p=0.020 n=6
TFS - bun (v0.7.3, x64)
Memory used 318,031k (± 0.16%) 318,090k (± 0.47%) ~ 316,497k 320,296k p=0.936 n=6
Parse Time 1.80s (± 1.40%) 1.80s (± 1.04%) ~ 1.79s 1.84s p=0.357 n=6
Bind Time 1.00s (± 0.63%) 0.98s (± 2.69%) ~ 0.93s 1.00s p=0.070 n=6
Check Time 6.64s (± 0.54%) 6.64s (± 0.19%) ~ 6.62s 6.66s p=1.000 n=6
Emit Time 3.48s (± 1.15%) 3.46s (± 0.88%) ~ 3.42s 3.51s p=0.373 n=6
Total Time 12.92s (± 0.50%) 12.89s (± 0.24%) ~ 12.85s 12.93s p=0.376 n=6
material-ui - bun (v0.7.3, x64)
Memory used 511,825k (± 5.43%) 522,497k (± 4.24%) ~ 488,592k 537,875k p=0.689 n=6
Parse Time 2.50s (± 0.55%) 2.50s (± 2.14%) ~ 2.44s 2.59s p=0.465 n=6
Bind Time 0.71s (± 0.58%) 0.73s (± 4.86%) ~ 0.71s 0.80s p=0.056 n=6
Check Time 15.75s (± 0.28%) 15.81s (± 0.54%) ~ 15.70s 15.96s p=0.169 n=6
Emit Time 0.00s (± 0.00%) 0.01s (±154.76%) ~ 0.00s 0.02s p=0.174 n=6
Total Time 18.96s (± 0.21%) 19.04s (± 0.56%) ~ 18.94s 19.22s p=0.092 n=6
xstate - bun (v0.7.3, x64)
Memory used 407,574k (± 9.08%) 446,225k (±13.05%) ~ 358,909k 512,993k p=0.471 n=6
Parse Time 3.56s (± 0.75%) 3.59s (± 0.56%) ~ 3.57s 3.62s p=0.063 n=6
Bind Time 1.38s (± 1.77%) 1.38s (± 2.79%) ~ 1.30s 1.41s p=0.687 n=6
Check Time 3.54s (± 0.39%) 3.55s (± 1.03%) ~ 3.51s 3.60s p=0.871 n=6
Emit Time 0.21s (± 3.01%) 0.21s (± 1.96%) ~ 0.20s 0.21s p=0.673 n=6
Total Time 8.70s (± 0.40%) 8.72s (± 0.60%) ~ 8.66s 8.80s p=0.936 n=6
System info unknown
Hosts
  • bun (v0.7.3, x64)
Scenarios
  • Angular - bun (v0.7.3, x64)
  • Compiler-Unions - bun (v0.7.3, x64)
  • Monaco - bun (v0.7.3, x64)
  • TFS - bun (v0.7.3, x64)
  • material-ui - bun (v0.7.3, x64)
  • xstate - bun (v0.7.3, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - bun (v0.7.3, x64)
Execution time 425.46ms (± 0.06%) 424.89ms (± 0.11%) -0.57ms (- 0.13%) 423.67ms 433.14ms p=0.000 n=600
tsserverlibrary-startup - bun (v0.7.3, x64)
Execution time 661.73ms (± 0.15%) 661.61ms (± 0.14%) -0.12ms (- 0.02%) 659.60ms 677.41ms p=0.027 n=600
typescript-startup - bun (v0.7.3, x64)
Execution time 662.41ms (± 0.15%) 661.94ms (± 0.15%) -0.47ms (- 0.07%) 660.03ms 691.02ms p=0.000 n=600
System info unknown
Hosts
  • bun (v0.7.3, x64)
Scenarios
  • tsc-startup - bun (v0.7.3, x64)
  • tsserverlibrary-startup - bun (v0.7.3, x64)
  • typescript-startup - bun (v0.7.3, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@jakebailey
Copy link
Member Author

@typescript-bot new perf test vscode

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 30, 2023

Heya @jakebailey, I've started to run the vscode perf test suite on this PR at 63e8eae. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@jakebailey, the perf run you requested failed. You can check the log here.

@jakebailey
Copy link
Member Author

@typescript-bot perf test vscode

@typescript-bot
Copy link
Collaborator

typescript-bot commented Aug 30, 2023

Heya @jakebailey, I've started to run the vscode perf test suite on this PR at 63e8eae. You can monitor the build here.

Update: The results are in!

@jakebailey jakebailey changed the title ignore me, testing playground ignore me, testing build stuff Aug 30, 2023
@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Angular - vscode (1.81.1, x64)
Memory used 239,805k (± 0.82%) 239,806k (± 0.82%) ~ 235,812k 240,701k p=0.936 n=6
Parse Time 2.95s (± 0.94%) 2.96s (± 0.51%) ~ 2.94s 2.98s p=0.511 n=6
Bind Time 1.00s (± 1.03%) 1.00s (± 0.75%) ~ 0.99s 1.01s p=0.931 n=6
Check Time 7.84s (± 0.15%) 7.85s (± 0.25%) ~ 7.82s 7.87s p=0.625 n=6
Emit Time 7.20s (± 0.50%) 7.17s (± 0.42%) ~ 7.14s 7.21s p=0.195 n=6
Total Time 19.00s (± 0.29%) 18.98s (± 0.22%) ~ 18.92s 19.04s p=0.687 n=6
Compiler-Unions - vscode (1.81.1, x64)
Memory used 168,685k (± 2.27%) 168,533k (± 2.45%) ~ 160,819k 171,691k p=0.936 n=6
Parse Time 1.58s (± 1.79%) 1.57s (± 3.62%) ~ 1.48s 1.63s p=0.872 n=6
Bind Time 0.76s (± 0.99%) 0.75s (± 1.82%) ~ 0.74s 0.77s p=0.740 n=6
Check Time 8.69s (± 0.46%) 8.72s (± 0.62%) ~ 8.65s 8.81s p=0.376 n=6
Emit Time 2.60s (± 0.91%) 2.61s (± 1.07%) ~ 2.58s 2.66s p=0.418 n=6
Total Time 13.63s (± 0.45%) 13.66s (± 0.65%) ~ 13.55s 13.78s p=0.629 n=6
Monaco - vscode (1.81.1, x64)
Memory used 243,869k (± 0.19%) 246,109k (± 1.05%) ~ 243,640k 250,168k p=0.066 n=6
Parse Time 2.60s (± 1.16%) 2.64s (± 2.64%) ~ 2.58s 2.73s p=0.296 n=6
Bind Time 1.11s (± 1.23%) 1.06s (± 8.39%) ~ 0.94s 1.14s p=0.805 n=6
Check Time 6.86s (± 0.54%) 6.80s (± 0.46%) -0.06s (- 0.87%) 6.75s 6.83s p=0.023 n=6
Emit Time 3.91s (± 0.30%) 3.91s (± 0.43%) ~ 3.89s 3.94s p=0.933 n=6
Total Time 14.47s (± 0.33%) 14.41s (± 0.33%) ~ 14.34s 14.47s p=0.064 n=6
TFS - vscode (1.81.1, x64)
Memory used 196,282k (± 0.31%) 196,791k (± 0.22%) ~ 196,254k 197,224k p=0.093 n=6
Parse Time 2.08s (± 0.56%) 2.08s (± 0.90%) ~ 2.06s 2.11s p=0.807 n=6
Bind Time 1.02s (± 7.47%) 0.97s (± 7.71%) ~ 0.90s 1.04s p=0.062 n=6
Check Time 6.18s (± 1.04%) 6.22s (± 1.59%) ~ 6.12s 6.34s p=0.628 n=6
Emit Time 3.77s (± 1.80%) 3.76s (± 2.00%) ~ 3.61s 3.82s p=0.515 n=6
Total Time 13.06s (± 0.49%) 13.04s (± 0.69%) ~ 12.89s 13.16s p=0.936 n=6
material-ui - vscode (1.81.1, x64)
Memory used 303,145k (± 0.86%) 296,493k (± 4.26%) ~ 271,371k 304,638k p=0.128 n=6
Parse Time 3.22s (± 1.27%) 3.19s (± 1.39%) ~ 3.13s 3.24s p=0.418 n=6
Bind Time 0.92s (± 0.82%) 0.95s (± 5.73%) ~ 0.90s 1.02s p=0.682 n=6
Check Time 15.78s (± 0.74%) 15.81s (± 1.00%) ~ 15.63s 16.09s p=1.000 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 19.93s (± 0.73%) 19.95s (± 0.82%) ~ 19.80s 20.25s p=1.000 n=6
xstate - vscode (1.81.1, x64)
Memory used 367,863k (± 0.88%) 368,740k (± 0.67%) ~ 365,164k 371,246k p=0.810 n=6
Parse Time 3.83s (± 0.79%) 3.83s (± 0.88%) ~ 3.77s 3.87s p=0.629 n=6
Bind Time 1.34s (± 1.61%) 1.34s (± 1.33%) ~ 1.32s 1.37s p=0.745 n=6
Check Time 2.87s (± 0.58%) 2.87s (± 0.90%) ~ 2.82s 2.89s p=1.000 n=6
Emit Time 0.13s (± 3.87%) 0.14s (± 5.97%) ~ 0.13s 0.15s p=0.652 n=6
Total Time 8.18s (± 0.59%) 8.18s (± 0.39%) ~ 8.13s 8.22s p=0.872 n=6
System info unknown
Hosts
  • vscode (1.81.1, x64)
Scenarios
  • Angular - vscode (1.81.1, x64)
  • Compiler-Unions - vscode (1.81.1, x64)
  • Monaco - vscode (1.81.1, x64)
  • TFS - vscode (1.81.1, x64)
  • material-ui - vscode (1.81.1, x64)
  • xstate - vscode (1.81.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

tsserver

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsTSServer - vscode (1.81.1, x64)
Req 1 - updateOpen 2,488ms (± 0.43%) 2,451ms (± 0.95%) -38ms (- 1.51%) 2,423ms 2,480ms p=0.013 n=6
Req 2 - geterr 5,307ms (± 1.55%) 5,334ms (± 1.99%) ~ 5,139ms 5,415ms p=0.423 n=6
Req 3 - references 362ms (± 2.34%) 356ms (± 2.70%) ~ 337ms 363ms p=0.872 n=6
Req 4 - navto 307ms (± 4.39%) 317ms (± 3.58%) ~ 300ms 334ms p=0.229 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 95ms (±10.73%) 95ms (± 5.80%) ~ 90ms 102ms p=0.809 n=6
CompilerTSServer - vscode (1.81.1, x64)
Req 1 - updateOpen 2,621ms (± 0.96%) 2,625ms (± 1.44%) ~ 2,557ms 2,668ms p=0.471 n=6
Req 2 - geterr 3,871ms (± 0.55%) 3,866ms (± 0.36%) ~ 3,843ms 3,885ms p=0.748 n=6
Req 3 - references 366ms (± 2.12%) 365ms (± 2.22%) ~ 354ms 377ms p=0.873 n=6
Req 4 - navto 295ms (± 3.75%) 301ms (± 2.65%) ~ 287ms 310ms p=0.520 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 92ms (± 7.05%) 91ms (± 5.61%) ~ 81ms 95ms p=0.683 n=6
xstateTSServer - vscode (1.81.1, x64)
Req 1 - updateOpen 2,736ms (± 1.09%) 2,728ms (± 1.18%) ~ 2,674ms 2,757ms p=0.936 n=6
Req 2 - geterr 1,586ms (± 2.58%) 1,583ms (± 1.37%) ~ 1,565ms 1,622ms p=0.936 n=6
Req 3 - references 121ms (± 4.41%) 123ms (± 5.74%) ~ 115ms 135ms p=0.936 n=6
Req 4 - navto 381ms (± 2.79%) 376ms (± 1.58%) ~ 365ms 381ms p=0.575 n=6
Req 5 - completionInfo count 2,071 (± 0.00%) 2,071 (± 0.00%) ~ 2,071 2,071 p=1.000 n=6
Req 5 - completionInfo 364ms (± 9.38%) 361ms (± 5.19%) ~ 340ms 386ms p=0.936 n=6
System info unknown
Hosts
  • vscode (1.81.1, x64)
Scenarios
  • CompilerTSServer - vscode (1.81.1, x64)
  • Compiler-UnionsTSServer - vscode (1.81.1, x64)
  • xstateTSServer - vscode (1.81.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - vscode (1.81.1, x64)
Execution time 206.85ms (± 0.11%) 206.79ms (± 0.23%) -0.06ms (- 0.03%) 205.72ms 226.61ms p=0.000 n=600
tsserver-startup - vscode (1.81.1, x64)
Execution time 296.47ms (± 0.09%) 296.43ms (± 0.19%) -0.04ms (- 0.01%) 295.40ms 319.17ms p=0.000 n=600
tsserverlibrary-startup - vscode (1.81.1, x64)
Execution time 285.99ms (± 0.09%) 286.00ms (± 0.12%) ~ 284.74ms 297.62ms p=0.901 n=600
typescript-startup - vscode (1.81.1, x64)
Execution time 285.65ms (± 0.09%) 285.74ms (± 0.11%) +0.09ms (+ 0.03%) 284.58ms 295.84ms p=0.000 n=600
System info unknown
Hosts
  • vscode (1.81.1, x64)
Scenarios
  • tsc-startup - vscode (1.81.1, x64)
  • tsserver-startup - vscode (1.81.1, x64)
  • tsserverlibrary-startup - vscode (1.81.1, x64)
  • typescript-startup - vscode (1.81.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@jakebailey
Copy link
Member Author

@typescript-bot perf test vscode
@typescript-bot perf test bun

@typescript-bot
Copy link
Collaborator

typescript-bot commented Sep 7, 2023

Heya @jakebailey, I've started to run the vscode perf test suite on this PR at 63e8eae. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Angular - vscode (1.81.1, x64)
Memory used 233,325k (± 5.13%) 229,486k (± 9.40%) ~ 185,585k 240,549k p=0.936 n=6
Parse Time 2.96s (± 0.50%) 2.96s (± 0.97%) ~ 2.92s 3.00s p=0.460 n=6
Bind Time 1.01s (± 1.02%) 1.01s (± 0.74%) ~ 1.00s 1.02s p=0.348 n=6
Check Time 7.86s (± 0.50%) 7.87s (± 0.34%) ~ 7.84s 7.91s p=0.742 n=6
Emit Time 7.26s (± 1.51%) 7.23s (± 1.29%) ~ 7.15s 7.41s p=0.420 n=6
Total Time 19.09s (± 0.53%) 19.08s (± 0.39%) ~ 18.97s 19.18s p=0.873 n=6
Compiler-Unions - vscode (1.81.1, x64)
Memory used 168,183k (± 3.75%) 167,810k (± 2.89%) ~ 162,745k 173,293k p=1.000 n=6
Parse Time 1.59s (± 1.62%) 1.55s (± 2.79%) ~ 1.50s 1.61s p=0.076 n=6
Bind Time 0.76s (± 1.74%) 0.76s (± 1.07%) ~ 0.75s 0.77s p=0.865 n=6
Check Time 8.64s (± 0.52%) 8.67s (± 0.49%) ~ 8.59s 8.71s p=0.333 n=6
Emit Time 2.62s (± 3.56%) 2.71s (± 3.30%) +0.09s (+ 3.50%) 2.61s 2.82s p=0.036 n=6
Total Time 13.62s (± 0.70%) 13.70s (± 0.48%) ~ 13.62s 13.79s p=0.107 n=6
Monaco - vscode (1.81.1, x64)
Memory used 244,672k (± 0.75%) 246,239k (± 1.53%) ~ 243,530k 252,829k p=0.575 n=6
Parse Time 2.60s (± 1.45%) 2.63s (± 3.53%) ~ 2.56s 2.81s p=0.684 n=6
Bind Time 1.10s (± 1.70%) 1.09s (± 6.18%) ~ 0.95s 1.13s p=0.413 n=6
Check Time 6.83s (± 0.38%) 6.84s (± 0.43%) ~ 6.80s 6.88s p=0.871 n=6
Emit Time 3.92s (± 0.53%) 3.90s (± 0.51%) ~ 3.87s 3.93s p=0.195 n=6
Total Time 14.44s (± 0.24%) 14.45s (± 0.40%) ~ 14.34s 14.50s p=0.569 n=6
TFS - vscode (1.81.1, x64)
Memory used 196,895k (± 0.60%) 197,331k (± 0.81%) ~ 195,558k 199,286k p=0.936 n=6
Parse Time 2.10s (± 1.15%) 2.08s (± 0.59%) ~ 2.07s 2.10s p=0.100 n=6
Bind Time 0.98s (± 8.30%) 0.97s (± 8.09%) ~ 0.90s 1.06s p=1.000 n=6
Check Time 6.20s (± 1.24%) 6.19s (± 1.24%) ~ 6.09s 6.28s p=1.000 n=6
Emit Time 3.76s (± 2.37%) 3.76s (± 2.25%) ~ 3.59s 3.82s p=0.936 n=6
Total Time 13.04s (± 0.47%) 13.01s (± 0.62%) ~ 12.87s 13.10s p=0.575 n=6
material-ui - vscode (1.81.1, x64)
Memory used 299,848k (± 0.49%) 300,180k (± 0.83%) ~ 298,024k 304,273k p=1.000 n=6
Parse Time 3.20s (± 1.79%) 3.21s (± 1.24%) ~ 3.14s 3.24s p=0.683 n=6
Bind Time 0.94s (± 4.69%) 0.95s (± 4.84%) ~ 0.91s 1.01s p=0.871 n=6
Check Time 15.72s (± 0.56%) 15.75s (± 0.34%) ~ 15.69s 15.84s p=0.687 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 19.85s (± 0.28%) 19.91s (± 0.23%) ~ 19.85s 19.99s p=0.145 n=6
xstate - vscode (1.81.1, x64)
Memory used 366,852k (± 0.46%) 368,018k (± 0.49%) ~ 366,165k 370,179k p=0.298 n=6
Parse Time 3.83s (± 0.43%) 3.84s (± 0.77%) ~ 3.79s 3.87s p=0.221 n=6
Bind Time 1.34s (± 0.56%) 1.34s (± 1.37%) ~ 1.32s 1.37s p=0.934 n=6
Check Time 2.87s (± 1.31%) 2.88s (± 0.81%) ~ 2.83s 2.89s p=1.000 n=6
Emit Time 0.13s (± 7.74%) 0.13s (± 5.71%) ~ 0.12s 0.14s p=0.864 n=6
Total Time 8.18s (± 0.73%) 8.20s (± 0.26%) ~ 8.18s 8.23s p=0.227 n=6
System info unknown
Hosts
  • vscode (1.81.1, x64)
Scenarios
  • Angular - vscode (1.81.1, x64)
  • Compiler-Unions - vscode (1.81.1, x64)
  • Monaco - vscode (1.81.1, x64)
  • TFS - vscode (1.81.1, x64)
  • material-ui - vscode (1.81.1, x64)
  • xstate - vscode (1.81.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

tsserver

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-UnionsTSServer - vscode (1.81.1, x64)
Req 1 - updateOpen 2,467ms (± 0.77%) 2,487ms (± 1.38%) ~ 2,451ms 2,530ms p=0.471 n=6
Req 2 - geterr 5,327ms (± 0.97%) 5,307ms (± 1.80%) ~ 5,212ms 5,405ms p=0.810 n=6
Req 3 - references 359ms (± 1.78%) 360ms (± 0.54%) ~ 357ms 362ms p=0.809 n=6
Req 4 - navto 300ms (± 1.94%) 301ms (± 1.55%) ~ 296ms 309ms p=0.809 n=6
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) ~ 1,356 1,356 p=1.000 n=6
Req 5 - completionInfo 94ms (± 8.19%) 98ms (± 6.50%) ~ 87ms 102ms p=0.454 n=6
CompilerTSServer - vscode (1.81.1, x64)
Req 1 - updateOpen 2,610ms (± 1.55%) 2,613ms (± 1.51%) ~ 2,549ms 2,655ms p=0.810 n=6
Req 2 - geterr 3,847ms (± 0.66%) 3,857ms (± 0.93%) ~ 3,799ms 3,909ms p=0.689 n=6
Req 3 - references 364ms (± 1.08%) 370ms (± 0.78%) +5ms (+ 1.46%) 367ms 375ms p=0.043 n=6
Req 4 - navto 297ms (± 1.78%) 293ms (± 2.31%) ~ 286ms 304ms p=0.286 n=6
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) ~ 1,518 1,518 p=1.000 n=6
Req 5 - completionInfo 91ms (± 8.95%) 96ms (± 1.28%) ~ 93ms 96ms p=0.228 n=6
xstateTSServer - vscode (1.81.1, x64)
Req 1 - updateOpen 2,714ms (± 0.34%) 2,738ms (± 0.96%) +24ms (+ 0.89%) 2,707ms 2,787ms p=0.045 n=6
Req 2 - geterr 1,579ms (± 1.59%) 1,578ms (± 0.97%) ~ 1,547ms 1,590ms p=0.688 n=6
Req 3 - references 118ms (± 7.10%) 118ms (± 5.58%) ~ 107ms 127ms p=1.000 n=6
Req 4 - navto 363ms (± 4.40%) 365ms (± 1.17%) ~ 358ms 370ms p=1.000 n=6
Req 5 - completionInfo count 2,071 (± 0.00%) 2,071 (± 0.00%) ~ 2,071 2,071 p=1.000 n=6
Req 5 - completionInfo 357ms (± 6.12%) 362ms (± 8.30%) ~ 338ms 416ms p=0.873 n=6
System info unknown
Hosts
  • vscode (1.81.1, x64)
Scenarios
  • CompilerTSServer - vscode (1.81.1, x64)
  • Compiler-UnionsTSServer - vscode (1.81.1, x64)
  • xstateTSServer - vscode (1.81.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Startup

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
tsc-startup - vscode (1.81.1, x64)
Execution time 206.96ms (± 0.11%) 207.03ms (± 0.10%) +0.07ms (+ 0.03%) 206.14ms 209.35ms p=0.000 n=600
tsserver-startup - vscode (1.81.1, x64)
Execution time 296.57ms (± 0.10%) 296.50ms (± 0.09%) -0.07ms (- 0.03%) 295.14ms 299.54ms p=0.004 n=600
tsserverlibrary-startup - vscode (1.81.1, x64)
Execution time 286.19ms (± 0.08%) 286.19ms (± 0.08%) ~ 285.03ms 288.61ms p=0.989 n=600
typescript-startup - vscode (1.81.1, x64)
Execution time 286.07ms (± 0.08%) 286.09ms (± 0.09%) ~ 285.01ms 289.59ms p=0.717 n=600
System info unknown
Hosts
  • vscode (1.81.1, x64)
Scenarios
  • tsc-startup - vscode (1.81.1, x64)
  • tsserver-startup - vscode (1.81.1, x64)
  • tsserverlibrary-startup - vscode (1.81.1, x64)
  • typescript-startup - vscode (1.81.1, x64)
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@jakebailey
Copy link
Member Author

checking that things worked...

@typescript-bot perf test vscode
@typescript-bot perf test bun
@typescript-bot perf test this faster
@typescript-bot perf test vscode
@typescript-bot perf test bun
@typescript-bot perf test this faster

@typescript-bot
Copy link
Collaborator

typescript-bot commented Sep 7, 2023

Heya @jakebailey, I've started to run the tsc-only perf test suite on this PR at 63e8eae. You can monitor the build here.

@typescript-bot
Copy link
Collaborator

typescript-bot commented Sep 7, 2023

Heya @jakebailey, I've started to run the bun perf test suite on this PR at 63e8eae. You can monitor the build here.

@typescript-bot
Copy link
Collaborator

typescript-bot commented Sep 7, 2023

Heya @jakebailey, I've started to run the vscode perf test suite on this PR at 63e8eae. You can monitor the build here.

@jakebailey
Copy link
Member Author

@typescript-bot perf test this faster
@typescript-bot perf test this bun
@typescript-bot perf test this vscode

@typescript-bot
Copy link
Collaborator

typescript-bot commented Sep 8, 2023

Heya @jakebailey, I've started to run the vscode perf test suite on this PR at 63e8eae. You can monitor the build here.

@typescript-bot
Copy link
Collaborator

@jakebailey Here are the results of running the top 400 repos with tsc comparing main and refs/pull/55267/merge:

Everything looks good!

@jakebailey
Copy link
Member Author

@typescript-bot user test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Dec 12, 2024

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
user test this ✅ Started ✅ Results

@typescript-bot
Copy link
Collaborator

@jakebailey Here are the results of running the user tests with tsc comparing main and refs/pull/55267/merge:

Everything looks good!

@jakebailey
Copy link
Member Author

@typescript-bot user test this

3 similar comments
@jakebailey
Copy link
Member Author

@typescript-bot user test this

@jakebailey
Copy link
Member Author

@typescript-bot user test this

@jakebailey
Copy link
Member Author

@typescript-bot user test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jan 29, 2025

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
user test this ✅ Started

@jakebailey
Copy link
Member Author

@typescript-bot user test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jan 29, 2025

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
user test this ✅ Started

@jakebailey
Copy link
Member Author

@typescript-bot user test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jan 29, 2025

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
user test this ✅ Started

@jakebailey
Copy link
Member Author

@typescript-bot pack this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jan 29, 2025

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
pack this ✅ Started ✅ Results

@typescript-bot
Copy link
Collaborator

Hey @jakebailey, I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/164661/artifacts?artifactName=tgz&fileId=6DC7313A15761814F782AD4CA9E9707C4532CB882677EB801E359F73352984B202&fileName=/typescript-5.8.0-insiders.20250129.tgz"
    }
}

and then running npm install.

@jakebailey
Copy link
Member Author

@typescript-bot pack this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jan 29, 2025

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
pack this ✅ Started ✅ Results

@typescript-bot
Copy link
Collaborator

Hey @jakebailey, I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/164662/artifacts?artifactName=tgz&fileId=6DC7313A15761814F782AD4CA9E9707C4532CB882677EB801E359F73352984B202&fileName=/typescript-5.8.0-insiders.20250129.tgz"
    }
}

and then running npm install.

@jakebailey
Copy link
Member Author

@typescript-bot pack this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jan 29, 2025

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
pack this ✅ Started ✅ Results

@typescript-bot
Copy link
Collaborator

Hey @jakebailey, I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/164663/artifacts?artifactName=tgz&fileId=6DC7313A15761814F782AD4CA9E9707C4532CB882677EB801E359F73352984B202&fileName=/typescript-5.8.0-insiders.20250129.tgz"
    }
}

and then running npm install.

@jakebailey
Copy link
Member Author

@typescript-bot pack this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jan 29, 2025

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
pack this ✅ Started ✅ Results

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jan 29, 2025

Hey @jakebailey, I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/164664/artifacts?artifactName=tgz&fileId=6DC7313A15761814F782AD4CA9E9707C4532CB882677EB801E359F73352984B202&fileName=/typescript-5.8.0-insiders.20250129.tgz"
    }
}

and then running npm install.


There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/[email protected]".;

@jakebailey
Copy link
Member Author

@typescript-bot pack this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jan 29, 2025

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
pack this ✅ Started ✅ Results

@typescript-bot
Copy link
Collaborator

typescript-bot commented Jan 29, 2025

Hey @jakebailey, I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:

{
    "devDependencies": {
        "typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/164675/artifacts?artifactName=tgz&fileId=6DC7313A15761814F782AD4CA9E9707C4532CB882677EB801E359F73352984B202&fileName=/typescript-5.8.0-insiders.20250129.tgz"
    }
}

and then running npm install.


There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/[email protected]".;

@jakebailey
Copy link
Member Author

@typescript-bot user test this

@typescript-bot
Copy link
Collaborator

typescript-bot commented Feb 6, 2025

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
user test this ✅ Started

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants