Skip to content

Conversation

a-tarasyuk
Copy link
Contributor

Fixes #25758
Fixes #43186
Fixes #49666

@typescript-bot typescript-bot added the For Backlog Bug PRs that fix a backlog bug label Jul 10, 2022
@sandersn sandersn requested review from rbuckton and weswigham July 22, 2022 23:32
@RyanCavanaugh
Copy link
Member

@typescript-bot test top100

@typescript-bot
Copy link
Collaborator

typescript-bot commented Oct 13, 2022

Heya @RyanCavanaugh, I've started to run the diff-based top-repos suite on this PR at 69b4751. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@RyanCavanaugh Here are the results of running the top-repos suite comparing main and refs/pull/49848/merge:

Everything looks good!

@RyanCavanaugh
Copy link
Member

@typescript-bot perf test this

@typescript-bot
Copy link
Collaborator

Heya @RyanCavanaugh, I'm starting to run the perf test suite on this PR at 69b4751. Hold tight - I'll update this comment with the log link once the build has been queued.

@jakebailey
Copy link
Member

@typescript-bot perf test this but maybe work this time?

@typescript-bot
Copy link
Collaborator

typescript-bot commented Oct 14, 2022

Heya @jakebailey, I've started to run the perf test suite on this PR at 69b4751. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

Compiler

Comparison Report - main..49848
Metric main 49848 Delta Best Worst
Angular - node (v18.10.0, x64)
Memory used 352,922k (± 0.03%) 352,881k (± 0.03%) -41k (- 0.01%) 352,619k 353,078k
Parse Time 1.55s (± 0.57%) 1.55s (± 0.44%) -0.00s (- 0.26%) 1.53s 1.56s
Bind Time 0.61s (± 1.01%) 0.61s (± 1.22%) +0.00s (+ 0.33%) 0.60s 0.64s
Check Time 4.42s (± 0.60%) 4.39s (± 0.31%) -0.03s (- 0.63%) 4.36s 4.42s
Emit Time 4.92s (± 0.66%) 4.90s (± 0.77%) -0.02s (- 0.35%) 4.84s 4.98s
Total Time 11.49s (± 0.43%) 11.45s (± 0.44%) -0.04s (- 0.38%) 11.37s 11.57s
Compiler-Unions - node (v18.10.0, x64)
Memory used 200,206k (± 0.84%) 199,686k (± 0.96%) -520k (- 0.26%) 195,692k 201,514k
Parse Time 0.60s (± 0.96%) 0.60s (± 1.21%) +0.00s (+ 0.33%) 0.59s 0.62s
Bind Time 0.36s (± 1.11%) 0.36s (± 1.11%) -0.00s (- 0.55%) 0.35s 0.37s
Check Time 5.34s (± 0.55%) 5.35s (± 0.77%) +0.02s (+ 0.36%) 5.28s 5.47s
Emit Time 1.81s (± 1.13%) 1.82s (± 1.24%) +0.01s (+ 0.44%) 1.78s 1.88s
Total Time 8.11s (± 0.51%) 8.13s (± 0.60%) +0.02s (+ 0.30%) 8.01s 8.20s
Monaco - node (v18.10.0, x64)
Memory used 331,724k (± 0.01%) 331,684k (± 0.01%) -40k (- 0.01%) 331,618k 331,754k
Parse Time 1.16s (± 0.63%) 1.16s (± 0.65%) +0.01s (+ 0.52%) 1.15s 1.18s
Bind Time 0.56s (± 0.93%) 0.56s (± 0.85%) -0.00s (- 0.71%) 0.54s 0.56s
Check Time 4.30s (± 0.76%) 4.30s (± 0.74%) +0.00s (+ 0.02%) 4.22s 4.36s
Emit Time 2.63s (± 0.85%) 2.63s (± 0.62%) +0.00s (+ 0.11%) 2.60s 2.67s
Total Time 8.64s (± 0.59%) 8.65s (± 0.48%) +0.01s (+ 0.12%) 8.56s 8.74s
TFS - node (v18.10.0, x64)
Memory used 294,722k (± 0.01%) 294,725k (± 0.01%) +3k (+ 0.00%) 294,650k 294,813k
Parse Time 0.94s (± 0.95%) 0.94s (± 1.07%) +0.00s (+ 0.11%) 0.92s 0.97s
Bind Time 0.59s (± 3.49%) 0.59s (± 3.52%) +0.00s (+ 0.17%) 0.55s 0.63s
Check Time 4.00s (± 0.42%) 4.01s (± 0.43%) +0.01s (+ 0.15%) 3.97s 4.06s
Emit Time 2.63s (± 0.55%) 2.63s (± 0.71%) +0.00s (+ 0.08%) 2.59s 2.66s
Total Time 8.15s (± 0.40%) 8.16s (± 0.52%) +0.01s (+ 0.11%) 8.08s 8.24s
material-ui - node (v18.10.0, x64)
Memory used 439,000k (± 0.01%) 439,005k (± 0.02%) +5k (+ 0.00%) 438,916k 439,195k
Parse Time 1.35s (± 0.57%) 1.35s (± 0.75%) +0.00s (+ 0.30%) 1.33s 1.38s
Bind Time 0.44s (± 0.51%) 0.44s (± 1.18%) 0.00s ( 0.00%) 0.43s 0.45s
Check Time 10.85s (± 0.63%) 10.86s (± 0.58%) +0.01s (+ 0.10%) 10.77s 11.08s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 12.64s (± 0.55%) 12.66s (± 0.55%) +0.02s (+ 0.13%) 12.56s 12.90s
xstate - node (v18.10.0, x64)
Memory used 556,694k (± 0.02%) 556,683k (± 0.01%) -11k (- 0.00%) 556,550k 556,777k
Parse Time 1.92s (± 0.42%) 1.92s (± 0.40%) -0.00s (- 0.21%) 1.90s 1.93s
Bind Time 0.68s (± 1.29%) 0.69s (± 2.15%) +0.01s (+ 1.47%) 0.67s 0.73s
Check Time 1.11s (± 0.87%) 1.10s (± 0.47%) -0.01s (- 0.72%) 1.09s 1.12s
Emit Time 0.06s (± 0.00%) 0.06s (± 0.00%) 0.00s ( 0.00%) 0.06s 0.06s
Total Time 3.76s (± 0.43%) 3.76s (± 0.63%) -0.00s (- 0.03%) 3.73s 3.83s
Angular - node (v16.17.1, x64)
Memory used 352,207k (± 0.07%) 352,450k (± 0.02%) +243k (+ 0.07%) 352,189k 352,539k
Parse Time 1.91s (± 0.97%) 1.90s (± 0.61%) -0.01s (- 0.52%) 1.88s 1.93s
Bind Time 0.75s (± 0.69%) 0.75s (± 0.78%) -0.00s (- 0.27%) 0.74s 0.76s
Check Time 5.73s (± 0.87%) 5.70s (± 0.62%) -0.03s (- 0.54%) 5.63s 5.77s
Emit Time 6.13s (± 1.17%) 6.09s (± 0.77%) -0.04s (- 0.62%) 6.01s 6.24s
Total Time 14.52s (± 0.74%) 14.44s (± 0.36%) -0.08s (- 0.54%) 14.36s 14.56s
Compiler-Unions - node (v16.17.1, x64)
Memory used 198,050k (± 0.49%) 197,724k (± 0.37%) -326k (- 0.16%) 197,347k 200,646k
Parse Time 0.78s (± 0.79%) 0.79s (± 1.14%) +0.00s (+ 0.51%) 0.77s 0.80s
Bind Time 0.46s (± 1.09%) 0.45s (± 1.09%) -0.00s (- 0.22%) 0.45s 0.47s
Check Time 6.42s (± 0.29%) 6.44s (± 0.78%) +0.02s (+ 0.30%) 6.30s 6.57s
Emit Time 2.29s (± 1.52%) 2.28s (± 0.89%) -0.01s (- 0.22%) 2.25s 2.35s
Total Time 9.94s (± 0.35%) 9.96s (± 0.62%) +0.02s (+ 0.19%) 9.81s 10.11s
Monaco - node (v16.17.1, x64)
Memory used 331,135k (± 0.01%) 331,112k (± 0.01%) -23k (- 0.01%) 331,059k 331,192k
Parse Time 1.43s (± 0.74%) 1.43s (± 0.66%) +0.01s (+ 0.42%) 1.42s 1.46s
Bind Time 0.69s (± 0.75%) 0.69s (± 0.89%) +0.00s (+ 0.29%) 0.68s 0.70s
Check Time 5.47s (± 0.57%) 5.48s (± 1.10%) +0.00s (+ 0.05%) 5.42s 5.71s
Emit Time 3.25s (± 0.52%) 3.25s (± 0.48%) +0.00s (+ 0.06%) 3.23s 3.30s
Total Time 10.84s (± 0.33%) 10.85s (± 0.57%) +0.01s (+ 0.14%) 10.77s 11.09s
TFS - node (v16.17.1, x64)
Memory used 294,087k (± 0.01%) 294,096k (± 0.02%) +9k (+ 0.00%) 293,903k 294,178k
Parse Time 1.22s (± 1.05%) 1.23s (± 1.68%) +0.01s (+ 0.98%) 1.20s 1.30s
Bind Time 0.65s (± 0.58%) 0.64s (± 0.46%) -0.00s (- 0.47%) 0.64s 0.65s
Check Time 5.14s (± 0.67%) 5.10s (± 0.29%) -0.03s (- 0.66%) 5.07s 5.14s
Emit Time 3.48s (± 0.75%) 3.47s (± 0.74%) -0.01s (- 0.17%) 3.42s 3.53s
Total Time 10.48s (± 0.47%) 10.46s (± 0.41%) -0.02s (- 0.24%) 10.38s 10.55s
material-ui - node (v16.17.1, x64)
Memory used 438,366k (± 0.01%) 438,355k (± 0.01%) -11k (- 0.00%) 438,270k 438,410k
Parse Time 1.72s (± 1.18%) 1.72s (± 1.27%) +0.01s (+ 0.41%) 1.69s 1.77s
Bind Time 0.54s (± 0.68%) 0.54s (± 0.74%) +0.00s (+ 0.56%) 0.53s 0.55s
Check Time 12.48s (± 0.45%) 12.47s (± 0.85%) -0.01s (- 0.07%) 12.32s 12.84s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 14.73s (± 0.42%) 14.73s (± 0.78%) -0.00s (- 0.01%) 14.54s 15.12s
xstate - node (v16.17.1, x64)
Memory used 554,431k (± 0.02%) 554,402k (± 0.02%) -29k (- 0.01%) 554,259k 554,677k
Parse Time 2.30s (± 0.28%) 2.31s (± 0.52%) +0.00s (+ 0.22%) 2.29s 2.35s
Bind Time 0.90s (± 2.30%) 0.88s (± 1.05%) -0.02s (- 1.78%) 0.87s 0.90s
Check Time 1.43s (± 0.98%) 1.43s (± 0.43%) +0.00s (+ 0.07%) 1.42s 1.44s
Emit Time 0.07s (± 0.00%) 0.07s (± 0.00%) 0.00s ( 0.00%) 0.07s 0.07s
Total Time 4.70s (± 0.35%) 4.69s (± 0.31%) -0.01s (- 0.21%) 4.67s 4.73s
Angular - node (v14.15.1, x64)
Memory used 346,641k (± 0.01%) 346,648k (± 0.01%) +7k (+ 0.00%) 346,569k 346,703k
Parse Time 2.08s (± 0.84%) 2.08s (± 1.30%) +0.00s (+ 0.10%) 2.05s 2.18s
Bind Time 0.80s (± 0.43%) 0.80s (± 0.28%) +0.00s (+ 0.25%) 0.79s 0.80s
Check Time 5.98s (± 0.34%) 5.98s (± 0.35%) -0.00s (- 0.03%) 5.93s 6.01s
Emit Time 6.28s (± 0.56%) 6.27s (± 0.42%) -0.01s (- 0.10%) 6.22s 6.33s
Total Time 15.13s (± 0.18%) 15.13s (± 0.37%) -0.01s (- 0.03%) 15.03s 15.31s
Compiler-Unions - node (v14.15.1, x64)
Memory used 190,932k (± 0.68%) 190,945k (± 0.67%) +13k (+ 0.01%) 190,312k 196,143k
Parse Time 0.86s (± 0.95%) 0.86s (± 0.98%) +0.00s (+ 0.47%) 0.85s 0.89s
Bind Time 0.49s (± 0.60%) 0.49s (± 0.60%) 0.00s ( 0.00%) 0.49s 0.50s
Check Time 6.72s (± 0.33%) 6.71s (± 0.68%) -0.01s (- 0.16%) 6.61s 6.80s
Emit Time 2.41s (± 0.79%) 2.42s (± 0.67%) +0.01s (+ 0.46%) 2.40s 2.47s
Total Time 10.48s (± 0.28%) 10.49s (± 0.53%) +0.00s (+ 0.04%) 10.38s 10.63s
Monaco - node (v14.15.1, x64)
Memory used 326,556k (± 0.01%) 326,593k (± 0.01%) +37k (+ 0.01%) 326,528k 326,631k
Parse Time 1.58s (± 0.53%) 1.58s (± 0.79%) +0.00s (+ 0.25%) 1.56s 1.61s
Bind Time 0.73s (± 0.41%) 0.73s (± 0.71%) -0.00s (- 0.14%) 0.72s 0.74s
Check Time 5.73s (± 0.67%) 5.73s (± 0.36%) -0.00s (- 0.02%) 5.70s 5.79s
Emit Time 3.40s (± 0.77%) 3.39s (± 0.79%) -0.01s (- 0.26%) 3.34s 3.44s
Total Time 11.44s (± 0.52%) 11.44s (± 0.30%) -0.01s (- 0.05%) 11.37s 11.54s
TFS - node (v14.15.1, x64)
Memory used 289,707k (± 0.01%) 289,697k (± 0.01%) -10k (- 0.00%) 289,634k 289,741k
Parse Time 1.30s (± 0.97%) 1.29s (± 0.50%) -0.01s (- 0.69%) 1.28s 1.31s
Bind Time 0.80s (± 0.72%) 0.80s (± 0.28%) -0.00s (- 0.25%) 0.80s 0.81s
Check Time 5.41s (± 0.37%) 5.39s (± 0.64%) -0.01s (- 0.26%) 5.32s 5.50s
Emit Time 3.62s (± 0.73%) 3.63s (± 0.89%) +0.01s (+ 0.28%) 3.58s 3.73s
Total Time 11.13s (± 0.39%) 11.12s (± 0.48%) -0.01s (- 0.10%) 11.05s 11.27s
material-ui - node (v14.15.1, x64)
Memory used 434,402k (± 0.04%) 434,475k (± 0.01%) +73k (+ 0.02%) 434,396k 434,508k
Parse Time 1.88s (± 0.33%) 1.88s (± 0.51%) +0.01s (+ 0.32%) 1.86s 1.91s
Bind Time 0.59s (± 0.62%) 0.59s (± 0.58%) +0.00s (+ 0.17%) 0.58s 0.59s
Check Time 12.85s (± 0.91%) 12.90s (± 0.54%) +0.05s (+ 0.37%) 12.79s 13.15s
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) 0.00s ( NaN%) 0.00s 0.00s
Total Time 15.32s (± 0.77%) 15.37s (± 0.44%) +0.05s (+ 0.35%) 15.29s 15.62s
xstate - node (v14.15.1, x64)
Memory used 543,460k (± 0.01%) 543,473k (± 0.01%) +13k (+ 0.00%) 543,406k 543,538k
Parse Time 2.60s (± 0.36%) 2.61s (± 0.62%) +0.00s (+ 0.19%) 2.58s 2.65s
Bind Time 0.98s (± 1.11%) 0.99s (± 0.77%) +0.00s (+ 0.31%) 0.97s 1.01s
Check Time 1.50s (± 0.50%) 1.51s (± 0.49%) +0.01s (+ 0.40%) 1.50s 1.53s
Emit Time 0.07s (± 0.00%) 0.07s (± 0.00%) 0.00s ( 0.00%) 0.07s 0.07s
Total Time 5.17s (± 0.34%) 5.18s (± 0.41%) +0.01s (+ 0.19%) 5.13s 5.22s
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Angular - node (v18.10.0, x64)
  • Angular - node (v16.17.1, x64)
  • Angular - node (v14.15.1, x64)
  • Compiler-Unions - node (v18.10.0, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Compiler-Unions - node (v14.15.1, x64)
  • Monaco - node (v18.10.0, x64)
  • Monaco - node (v16.17.1, x64)
  • Monaco - node (v14.15.1, x64)
  • TFS - node (v18.10.0, x64)
  • TFS - node (v16.17.1, x64)
  • TFS - node (v14.15.1, x64)
  • material-ui - node (v18.10.0, x64)
  • material-ui - node (v16.17.1, x64)
  • material-ui - node (v14.15.1, x64)
  • xstate - node (v18.10.0, x64)
  • xstate - node (v16.17.1, x64)
  • xstate - node (v14.15.1, x64)
Benchmark Name Iterations
Current 49848 10
Baseline main 10

TSServer

Comparison Report - main..49848
Metric main 49848 Delta Best Worst
Compiler-UnionsTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,064ms (± 0.51%) 1,065ms (± 0.34%) +1ms (+ 0.06%) 1,054ms 1,074ms
Req 2 - geterr 2,700ms (± 0.40%) 2,726ms (± 0.60%) +26ms (+ 0.95%) 2,701ms 2,762ms
Req 3 - references 191ms (± 0.70%) 192ms (± 1.66%) +1ms (+ 0.68%) 189ms 203ms
Req 4 - navto 144ms (± 0.71%) 145ms (± 0.90%) +0ms (+ 0.28%) 142ms 147ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 43ms (± 0.79%) 44ms (± 1.85%) +1ms (+ 1.62%) 43ms 47ms
CompilerTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,129ms (± 0.70%) 1,136ms (± 0.49%) +7ms (+ 0.66%) 1,124ms 1,151ms
Req 2 - geterr 1,607ms (± 0.56%) 1,609ms (± 0.58%) +3ms (+ 0.16%) 1,585ms 1,628ms
Req 3 - references 198ms (± 0.50%) 198ms (± 0.67%) -0ms (- 0.15%) 196ms 201ms
Req 4 - navto 160ms (± 1.68%) 160ms (± 1.74%) -0ms (- 0.13%) 155ms 166ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 85ms (± 4.56%) 86ms (± 6.07%) +1ms (+ 0.82%) 77ms 102ms
xstateTSServer - node (v18.10.0, x64)
Req 1 - updateOpen 1,616ms (± 0.40%) 1,622ms (± 0.50%) +6ms (+ 0.36%) 1,607ms 1,640ms
Req 2 - geterr 573ms (± 0.59%) 576ms (± 0.94%) +4ms (+ 0.63%) 567ms 592ms
Req 3 - references 51ms (± 0.65%) 52ms (± 2.14%) +1ms (+ 1.37%) 51ms 56ms
Req 4 - navto 203ms (± 0.35%) 202ms (± 0.52%) -1ms (- 0.25%) 200ms 204ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,206 (± 0.00%) 0 ( 0.00%) 3,206 3,206
Req 5 - completionInfo 216ms (± 1.72%) 216ms (± 0.99%) -0ms (- 0.14%) 212ms 221ms
Compiler-UnionsTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,324ms (± 0.45%) 1,327ms (± 0.41%) +4ms (+ 0.27%) 1,314ms 1,336ms
Req 2 - geterr 3,278ms (± 0.50%) 3,270ms (± 0.67%) -8ms (- 0.25%) 3,246ms 3,344ms
Req 3 - references 222ms (± 1.21%) 222ms (± 1.02%) -0ms (- 0.09%) 218ms 228ms
Req 4 - navto 156ms (± 0.52%) 157ms (± 0.49%) +1ms (+ 0.90%) 155ms 159ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 71ms (±19.22%) 65ms (±21.08%) 🟩-6ms (- 8.29%) 52ms 99ms
CompilerTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,405ms (± 0.32%) 1,406ms (± 0.47%) +1ms (+ 0.07%) 1,391ms 1,421ms
Req 2 - geterr 2,103ms (± 0.54%) 2,104ms (± 0.37%) +1ms (+ 0.04%) 2,085ms 2,116ms
Req 3 - references 231ms (± 0.71%) 232ms (± 0.81%) +1ms (+ 0.35%) 229ms 236ms
Req 4 - navto 168ms (± 0.53%) 167ms (± 0.58%) -1ms (- 0.36%) 165ms 169ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 54ms (± 6.26%) 51ms (± 0.66%) 🟩-2ms (- 4.29%) 51ms 52ms
xstateTSServer - node (v16.17.1, x64)
Req 1 - updateOpen 1,930ms (± 0.46%) 1,926ms (± 0.31%) -5ms (- 0.25%) 1,915ms 1,941ms
Req 2 - geterr 728ms (± 0.64%) 728ms (± 0.40%) -0ms (- 0.05%) 723ms 735ms
Req 3 - references 61ms (± 1.83%) 60ms (± 0.67%) -1ms (- 0.83%) 59ms 61ms
Req 4 - navto 204ms (± 0.78%) 205ms (± 0.51%) +1ms (+ 0.64%) 203ms 207ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,206 (± 0.00%) 0 ( 0.00%) 3,206 3,206
Req 5 - completionInfo 259ms (± 0.41%) 259ms (± 0.68%) +0ms (+ 0.04%) 255ms 264ms
Compiler-UnionsTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 1,453ms (± 0.48%) 1,455ms (± 0.49%) +2ms (+ 0.17%) 1,443ms 1,476ms
Req 2 - geterr 3,507ms (± 0.50%) 3,518ms (± 0.51%) +10ms (+ 0.30%) 3,485ms 3,558ms
Req 3 - references 233ms (± 0.29%) 234ms (± 0.46%) +1ms (+ 0.34%) 231ms 236ms
Req 4 - navto 171ms (± 0.61%) 172ms (± 0.56%) +1ms (+ 0.41%) 170ms 174ms
Req 5 - completionInfo count 1,356 (± 0.00%) 1,356 (± 0.00%) 0 ( 0.00%) 1,356 1,356
Req 5 - completionInfo 56ms (± 4.20%) 56ms (± 4.93%) +0ms (+ 0.54%) 54ms 66ms
CompilerTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 1,537ms (± 0.62%) 1,531ms (± 0.62%) -7ms (- 0.44%) 1,511ms 1,551ms
Req 2 - geterr 2,324ms (± 0.47%) 2,308ms (± 0.37%) -15ms (- 0.66%) 2,289ms 2,322ms
Req 3 - references 245ms (± 0.78%) 245ms (± 0.90%) +1ms (+ 0.37%) 243ms 253ms
Req 4 - navto 181ms (± 0.84%) 180ms (± 0.72%) -2ms (- 0.99%) 177ms 183ms
Req 5 - completionInfo count 1,518 (± 0.00%) 1,518 (± 0.00%) 0 ( 0.00%) 1,518 1,518
Req 5 - completionInfo 55ms (± 1.36%) 54ms (± 0.82%) -1ms (- 0.91%) 53ms 55ms
xstateTSServer - node (v14.15.1, x64)
Req 1 - updateOpen 2,147ms (± 0.41%) 2,153ms (± 0.34%) +6ms (+ 0.27%) 2,138ms 2,168ms
Req 2 - geterr 751ms (± 0.39%) 756ms (± 0.32%) +6ms (+ 0.76%) 752ms 761ms
Req 3 - references 67ms (± 3.08%) 66ms (± 2.53%) -1ms (- 0.75%) 63ms 70ms
Req 4 - navto 228ms (± 0.54%) 235ms (± 6.29%) +7ms (+ 3.11%) 227ms 295ms
Req 5 - completionInfo count 3,206 (± 0.00%) 3,206 (± 0.00%) 0 ( 0.00%) 3,206 3,206
Req 5 - completionInfo 274ms (± 1.05%) 275ms (± 1.33%) +1ms (+ 0.47%) 268ms 282ms
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-126-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v18.10.0, x64)
  • node (v16.17.1, x64)
  • node (v14.15.1, x64)
Scenarios
  • Compiler-UnionsTSServer - node (v18.10.0, x64)
  • Compiler-UnionsTSServer - node (v16.17.1, x64)
  • Compiler-UnionsTSServer - node (v14.15.1, x64)
  • CompilerTSServer - node (v18.10.0, x64)
  • CompilerTSServer - node (v16.17.1, x64)
  • CompilerTSServer - node (v14.15.1, x64)
  • xstateTSServer - node (v18.10.0, x64)
  • xstateTSServer - node (v16.17.1, x64)
  • xstateTSServer - node (v14.15.1, x64)
Benchmark Name Iterations
Current 49848 10
Baseline main 10

Developer Information:

Download Benchmark

@jakebailey
Copy link
Member

@typescript-bot test this
@typescript-bot test top100
@typescript-bot user test this
@typescript-bot run dt
@typescript-bot perf test this faster

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 11, 2023

Heya @jakebailey, I've started to run the extended test suite on this PR at 80dccc9. You can monitor the build here.

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 11, 2023

Heya @jakebailey, I've started to run the diff-based top-repos suite on this PR at 80dccc9. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 11, 2023

Heya @jakebailey, I've started to run the diff-based user code test suite on this PR at 80dccc9. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 11, 2023

Heya @jakebailey, I've started to run the parallelized Definitely Typed test suite on this PR at 80dccc9. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

typescript-bot commented Mar 11, 2023

Heya @jakebailey, I've started to run the abridged perf test suite on this PR at 80dccc9. You can monitor the build here.

Update: The results are in!

@typescript-bot
Copy link
Collaborator

@jakebailey Here are the results of running the user test suite comparing main and refs/pull/49848/merge:

Everything looks good!

@typescript-bot
Copy link
Collaborator

@jakebailey
The results of the perf run you requested are in!

Here they are:

Comparison Report - main..49848

Metric main 49848 Delta Best Worst p-value
Angular - node (v16.17.1, x64)
Memory used 363,011k (± 0.00%) 362,994k (± 0.01%) ~ 362,964k 363,015k p=0.173 n=6
Parse Time 3.52s (± 0.59%) 3.52s (± 0.80%) ~ 3.49s 3.56s p=0.871 n=6
Bind Time 1.18s (± 0.44%) 1.18s (± 0.99%) ~ 1.16s 1.19s p=0.929 n=6
Check Time 9.45s (± 0.61%) 9.45s (± 0.39%) ~ 9.42s 9.52s p=0.686 n=6
Emit Time 7.93s (± 0.54%) 7.93s (± 0.31%) ~ 7.90s 7.96s p=0.686 n=6
Total Time 22.09s (± 0.45%) 22.08s (± 0.15%) ~ 22.05s 22.14s p=0.936 n=6
Compiler-Unions - node (v16.17.1, x64)
Memory used 192,680k (± 0.04%) 193,264k (± 0.73%) ~ 192,589k 196,143k p=0.575 n=6
Parse Time 1.57s (± 1.63%) 1.58s (± 2.43%) ~ 1.50s 1.60s p=0.624 n=6
Bind Time 0.82s (± 0.92%) 0.82s (± 0.00%) ~ 0.82s 0.82s p=0.598 n=6
Check Time 10.12s (± 0.32%) 10.05s (± 0.59%) ~ 9.99s 10.15s p=0.106 n=6
Emit Time 3.00s (± 0.88%) 2.99s (± 1.19%) ~ 2.95s 3.05s p=0.418 n=6
Total Time 15.51s (± 0.20%) 15.44s (± 0.42%) ~ 15.35s 15.52s p=0.077 n=6
Monaco - node (v16.17.1, x64)
Memory used 346,714k (± 0.00%) 346,716k (± 0.01%) ~ 346,690k 346,763k p=0.936 n=6
Parse Time 2.73s (± 0.61%) 2.73s (± 0.15%) ~ 2.72s 2.73s p=0.924 n=6
Bind Time 1.09s (± 0.37%) 1.09s (± 1.25%) ~ 1.08s 1.12s p=0.753 n=6
Check Time 7.75s (± 0.45%) 7.76s (± 0.42%) ~ 7.71s 7.79s p=0.685 n=6
Emit Time 4.48s (± 0.76%) 4.45s (± 0.45%) ~ 4.44s 4.49s p=0.165 n=6
Total Time 16.05s (± 0.40%) 16.03s (± 0.26%) ~ 15.96s 16.08s p=0.520 n=6
TFS - node (v16.17.1, x64)
Memory used 300,142k (± 0.01%) 300,140k (± 0.01%) ~ 300,124k 300,178k p=0.470 n=6
Parse Time 2.17s (± 0.45%) 2.17s (± 0.24%) ~ 2.17s 2.18s p=0.504 n=6
Bind Time 1.24s (± 0.61%) 1.24s (± 0.33%) ~ 1.24s 1.25s p=1.000 n=6
Check Time 7.21s (± 0.49%) 7.18s (± 0.55%) ~ 7.14s 7.25s p=0.167 n=6
Emit Time 4.36s (± 0.69%) 4.34s (± 0.61%) ~ 4.30s 4.37s p=0.329 n=6
Total Time 14.99s (± 0.44%) 14.94s (± 0.24%) ~ 14.90s 14.99s p=0.170 n=6
material-ui - node (v16.17.1, x64)
Memory used 477,755k (± 0.00%) 477,754k (± 0.01%) ~ 477,661k 477,827k p=1.000 n=6
Parse Time 3.22s (± 0.75%) 3.23s (± 0.36%) ~ 3.21s 3.24s p=0.418 n=6
Bind Time 0.95s (± 0.86%) 0.96s (± 0.43%) ~ 0.95s 0.96s p=0.248 n=6
Check Time 18.12s (± 0.76%) 18.10s (± 0.51%) ~ 18.00s 18.21s p=1.000 n=6
Emit Time 0.00s (± 0.00%) 0.00s (± 0.00%) ~ 0.00s 0.00s p=1.000 n=6
Total Time 22.30s (± 0.61%) 22.29s (± 0.44%) ~ 22.19s 22.41s p=0.873 n=6
xstate - node (v16.17.1, x64)
Memory used 550,664k (± 0.02%) 550,691k (± 0.02%) ~ 550,599k 550,905k p=0.688 n=6
Parse Time 3.96s (± 0.58%) 3.95s (± 0.30%) ~ 3.93s 3.96s p=1.000 n=6
Bind Time 1.79s (± 0.42%) 1.79s (± 0.65%) ~ 1.77s 1.80s p=0.933 n=6
Check Time 2.99s (± 0.46%) 3.01s (± 0.54%) ~ 2.99s 3.03s p=0.123 n=6
Emit Time 0.09s (± 0.00%) 0.09s (± 0.00%) ~ 0.09s 0.09s p=1.000 n=6
Total Time 8.83s (± 0.30%) 8.84s (± 0.31%) ~ 8.80s 8.88s p=0.627 n=6
System
Machine Namets-ci-ubuntu
Platformlinux 5.4.0-135-generic
Architecturex64
Available Memory16 GB
Available Memory15 GB
CPUs4 × Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz
Hosts
  • node (v16.17.1, x64)
Scenarios
  • Angular - node (v16.17.1, x64)
  • Compiler-Unions - node (v16.17.1, x64)
  • Monaco - node (v16.17.1, x64)
  • TFS - node (v16.17.1, x64)
  • material-ui - node (v16.17.1, x64)
  • xstate - node (v16.17.1, x64)
Benchmark Name Iterations
Current 49848 6
Baseline main 6

Developer Information:

Download Benchmark

@typescript-bot
Copy link
Collaborator

@jakebailey Here are the results of running the top-repos suite comparing main and refs/pull/49848/merge:

Everything looks good!

@typescript-bot
Copy link
Collaborator

Hey @jakebailey, the results of running the DT tests are ready.
There were interesting changes:

Errors that changed:

Package: dom-mediacapture-record
Nightly error:

Error: Errors in typescript@local for external dependencies:
../../../node_modules/typescript/lib/lib.dom.d.ts(19298,6): error TS2300: Duplicate identifier 'BitrateMode'.

    at testTypesVersion (/home/vsts/work/1/s/DefinitelyTyped-tools/packages/dtslint-runner/node_modules/@definitelytyped/dtslint/dist/index.js:194:15)
    at async runTests (/home/vsts/work/1/s/DefinitelyTyped-tools/packages/dtslint-runner/node_modules/@definitelytyped/dtslint/dist/index.js:151:9)

Branch error:

Error: Errors in typescript@local for external dependencies:
../../../../../../built/local/lib.dom.d.ts(19298,6): error TS2300: Duplicate identifier 'BitrateMode'.

    at testTypesVersion (/home/vsts/work/1/s/DefinitelyTyped-tools/packages/dtslint-runner/node_modules/@definitelytyped/dtslint/dist/index.js:194:15)
    at async runTests (/home/vsts/work/1/s/DefinitelyTyped-tools/packages/dtslint-runner/node_modules/@definitelytyped/dtslint/dist/index.js:151:9)

You can check the log here.

@jakebailey
Copy link
Member

Checking https://github.com/microsoft/TypeScript/pull/49848/files?w=1 this feels okay to me. This has been in review for a while. Are there any other concerns here?

@weswigham weswigham merged commit 9e1f0ad into microsoft:main Mar 20, 2023
@a-tarasyuk
Copy link
Contributor Author

@weswigham Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
For Backlog Bug PRs that fix a backlog bug
Projects
Archived in project
5 participants