engineering/un-inception
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

perf: Update aggregated performance analysis [ci skip]

Browse source
This commit is contained in:
GitLab CI 2026-01-24 16:08:30 -05:00
parent 35b2cd79fe
commit ac59c105f9
1 changed files with 73 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

73
AGGREGATED-PERFORMANCE.md
View file

@ -1,13 +1,22 @@
# UN Inception: Aggregated Performance Analysis # UN Inception: Aggregated Performance Analysis
<<<<<<< Updated upstream
**Analysis Date:** 1769288671.067574 **Analysis Date:** 1769288671.067574
**Reports Analyzed:** 4.2.0, 4.2.10, 4.2.11, 4.2.12, 4.2.13, 4.2.14, 4.2.15, 4.2.16, 4.2.17, 4.2.18, 4.2.19, 4.2.20, 4.2.21, 4.2.22, 4.2.23, 4.2.24, 4.2.25, 4.2.3, 4.2.4, 4.2.5, 4.2.6, 4.2.7, 4.2.8, 4.2.9 **Reports Analyzed:** 4.2.0, 4.2.10, 4.2.11, 4.2.12, 4.2.13, 4.2.14, 4.2.15, 4.2.16, 4.2.17, 4.2.18, 4.2.19, 4.2.20, 4.2.21, 4.2.22, 4.2.23, 4.2.24, 4.2.25, 4.2.3, 4.2.4, 4.2.5, 4.2.6, 4.2.7, 4.2.8, 4.2.9
=======
**Analysis Date:** 1769288907.928872
**Reports Analyzed:** 4.2.0, 4.2.10, 4.2.11, 4.2.12, 4.2.13, 4.2.14, 4.2.15, 4.2.16, 4.2.17, 4.2.18, 4.2.19, 4.2.20, 4.2.21, 4.2.22, 4.2.23, 4.2.24, 4.2.25, 4.2.26, 4.2.3, 4.2.4, 4.2.5, 4.2.6, 4.2.7, 4.2.8, 4.2.9
>>>>>>> Stashed changes
--- ---
## Executive Summary ## Executive Summary
<<<<<<< Updated upstream
Analysis of 24 performance reports reveals **significant variance** in execution metrics across releases. Different languages rank as slowest/fastest in different runs, indicating **non-deterministic execution patterns** likely caused by: Analysis of 24 performance reports reveals **significant variance** in execution metrics across releases. Different languages rank as slowest/fastest in different runs, indicating **non-deterministic execution patterns** likely caused by:
=======
Analysis of 25 performance reports reveals **significant variance** in execution metrics across releases. Different languages rank as slowest/fastest in different runs, indicating **non-deterministic execution patterns** likely caused by:
>>>>>>> Stashed changes
1. **Orchestrator placement on CPU-bound pool** (not an SRE best practice) 1. **Orchestrator placement on CPU-bound pool** (not an SRE best practice)
2. **Resource contention** between the orchestrator & test jobs 2. **Resource contention** between the orchestrator & test jobs
@ -39,7 +48,12 @@ Analysis of 24 performance reports reveals **significant variance** in execution
| 4.2.23 | 373s | zig (1058s) | perl (8s) | +73s (+24.3%) | | 4.2.23 | 373s | zig (1058s) | perl (8s) | +73s (+24.3%) |
| 4.2.24 | 129s | python (494s) | clojure (8s) | -244s (-65.4%) | | 4.2.24 | 129s | python (494s) | clojure (8s) | -244s (-65.4%) |
| 4.2.25 | 97s | fortran (151s) | bash (58s) | -32s (-24.8%) | | 4.2.25 | 97s | fortran (151s) | bash (58s) | -32s (-24.8%) |
<<<<<<< Updated upstream
| 4.2.3 | 63s | rust (142s) | v (40s) | -34s (-35.1%) | | 4.2.3 | 63s | rust (142s) | v (40s) | -34s (-35.1%) |
=======
| 4.2.26 | 78s | cpp (130s) | python (25s) | -19s (-19.6%) |
| 4.2.3 | 63s | rust (142s) | v (40s) | -15s (-19.2%) |
>>>>>>> Stashed changes
| 4.2.4 | 70s | python (110s) | c (23s) | +7s (+11.1%) | | 4.2.4 | 70s | python (110s) | c (23s) | +7s (+11.1%) |
| 4.2.5 | 67s | v (114s) | erlang (44s) | -3s (-4.3%) | | 4.2.5 | 67s | v (114s) | erlang (44s) | -3s (-4.3%) |
| 4.2.6 | 54s | haskell (128s) | awk (23s) | -13s (-19.4%) | | 4.2.6 | 54s | haskell (128s) | awk (23s) | -13s (-19.4%) |
@ -79,6 +93,10 @@ The same language changes dramatically in rank between runs:
- 4.2.23: 425s - 4.2.23: 425s
- 4.2.24: 242s - 4.2.24: 242s
- 4.2.25: 74s - 4.2.25: 74s
<<<<<<< Updated upstream
=======
- 4.2.26: 114s
>>>>>>> Stashed changes
- 4.2.3: 75s - 4.2.3: 75s
- 4.2.4: 109s - 4.2.4: 109s
- 4.2.5: 60s - 4.2.5: 60s
@ -106,6 +124,10 @@ The same language changes dramatically in rank between runs:
- 4.2.23: 9s - 4.2.23: 9s
- 4.2.24: 434s - 4.2.24: 434s
- 4.2.25: 65s - 4.2.25: 65s
<<<<<<< Updated upstream
=======
- 4.2.26: 66s
>>>>>>> Stashed changes
- 4.2.3: 64s - 4.2.3: 64s
- 4.2.4: 74s - 4.2.4: 74s
- 4.2.5: 52s - 4.2.5: 52s
@ -133,6 +155,10 @@ The same language changes dramatically in rank between runs:
- 4.2.23: 286s - 4.2.23: 286s
- 4.2.24: 8s - 4.2.24: 8s
- 4.2.25: 100s - 4.2.25: 100s
<<<<<<< Updated upstream
=======
- 4.2.26: 53s
>>>>>>> Stashed changes
- 4.2.3: 52s - 4.2.3: 52s
- 4.2.4: 76s - 4.2.4: 76s
- 4.2.5: 58s - 4.2.5: 58s
@ -160,6 +186,10 @@ The same language changes dramatically in rank between runs:
- 4.2.23: 1058s - 4.2.23: 1058s
- 4.2.24: 8s - 4.2.24: 8s
- 4.2.25: 108s - 4.2.25: 108s
<<<<<<< Updated upstream
=======
- 4.2.26: 55s
>>>>>>> Stashed changes
- 4.2.3: 61s - 4.2.3: 61s
- 4.2.4: 60s - 4.2.4: 60s
- 4.2.5: 59s - 4.2.5: 59s
@ -187,6 +217,10 @@ The same language changes dramatically in rank between runs:
- 4.2.23: 1040s - 4.2.23: 1040s
- 4.2.24: 101s - 4.2.24: 101s
- 4.2.25: 97s - 4.2.25: 97s
<<<<<<< Updated upstream
=======
- 4.2.26: 54s
>>>>>>> Stashed changes
- 4.2.3: 40s - 4.2.3: 40s
- 4.2.4: 49s - 4.2.4: 49s
- 4.2.5: 114s - 4.2.5: 114s
@ -220,6 +254,10 @@ The same language changes dramatically in rank between runs:
4.2.23: perl, r, d, groovy, powershell 4.2.23: perl, r, d, groovy, powershell
4.2.24: zig, nim, kotlin, fortran, forth 4.2.24: zig, nim, kotlin, fortran, forth
4.2.25: bash, powershell, forth, r, prolog 4.2.25: bash, powershell, forth, r, prolog
<<<<<<< Updated upstream
=======
4.2.26: python, fsharp, ocaml, haskell, julia
>>>>>>> Stashed changes
4.2.3: v, d, kotlin, awk, raku 4.2.3: v, d, kotlin, awk, raku
4.2.4: c, d, cobol, raku, v 4.2.4: c, d, cobol, raku, v
4.2.5: erlang, awk, bash, deno, tcl 4.2.5: erlang, awk, bash, deno, tcl
@ -247,6 +285,10 @@ The same language changes dramatically in rank between runs:
4.2.23: zig, v, commonlisp, deno, elixir 4.2.23: zig, v, commonlisp, deno, elixir
4.2.24: python, php, r, elixir, deno 4.2.24: python, php, r, elixir, deno
4.2.25: fortran, crystal, perl, awk, cpp 4.2.25: fortran, crystal, perl, awk, cpp
<<<<<<< Updated upstream
=======
4.2.26: cpp, raku, cobol, javascript, ruby
>>>>>>> Stashed changes
4.2.3: rust, c, python, typescript, javascript 4.2.3: rust, c, python, typescript, javascript
4.2.4: python, javascript, elixir, scheme, bash 4.2.4: python, javascript, elixir, scheme, bash
4.2.5: v, haskell, scheme, ocaml, powershell 4.2.5: v, haskell, scheme, ocaml, powershell
@ -406,6 +448,7 @@ Keep it as-is for stress testing, but in separate test environment.
| Language | Min (s) | Max (s) | Avg (s) | Range (s) | Variance % | | Language | Min (s) | Max (s) | Avg (s) | Range (s) | Variance % |
|----------|---------|---------|---------|-----------|------------| |----------|---------|---------|---------|-----------|------------|
<<<<<<< Updated upstream
| R | 9 | 1834 | 191.7 | 1825 | 20277.8% | | R | 9 | 1834 | 191.7 | 1825 | 20277.8% |
| NIM | 8 | 1217 | 132.8 | 1209 | 15112.5% | | NIM | 8 | 1217 | 132.8 | 1209 | 15112.5% |
| ZIG | 8 | 1058 | 190.5 | 1050 | 13125.0% | | ZIG | 8 | 1058 | 190.5 | 1050 | 13125.0% |
@ -426,6 +469,28 @@ Keep it as-is for stress testing, but in separate test environment.
| PHP | 23 | 824 | 150.1 | 801 | 3482.6% | | PHP | 23 | 824 | 150.1 | 801 | 3482.6% |
| TCL | 20 | 712 | 116.0 | 692 | 3460.0% | | TCL | 20 | 712 | 116.0 | 692 | 3460.0% |
| COMMONLISP | 27 | 956 | 122.1 | 929 | 3440.7% | | COMMONLISP | 27 | 956 | 122.1 | 929 | 3440.7% |
=======
| R | 9 | 1834 | 186.6 | 1825 | 20277.8% |
| NIM | 8 | 1217 | 129.6 | 1209 | 15112.5% |
| ZIG | 8 | 1058 | 185.0 | 1050 | 13125.0% |
| LUA | 9 | 975 | 153.4 | 966 | 10733.3% |
| FORTH | 8 | 628 | 112.7 | 620 | 7750.0% |
| DOTNET | 5 | 360 | 94.0 | 355 | 7100.0% |
| JAVASCRIPT | 32 | 2173 | 217.0 | 2141 | 6690.6% |
| PERL | 8 | 468 | 110.2 | 460 | 5750.0% |
| V | 21 | 1040 | 115.3 | 1019 | 4852.4% |
| CSHARP | 8 | 385 | 100.2 | 377 | 4712.5% |
| ELIXIR | 20 | 917 | 159.6 | 897 | 4485.0% |
| OBJC | 17 | 693 | 108.2 | 676 | 3976.5% |
| KOTLIN | 8 | 313 | 94.4 | 305 | 3812.5% |
| CLOJURE | 8 | 310 | 107.0 | 302 | 3775.0% |
| DENO | 24 | 926 | 158.5 | 902 | 3758.3% |
| COBOL | 20 | 759 | 139.3 | 739 | 3695.0% |
| HASKELL | 21 | 754 | 127.9 | 733 | 3490.5% |
| PHP | 23 | 824 | 148.4 | 801 | 3482.6% |
| TCL | 20 | 712 | 115.4 | 692 | 3460.0% |
| COMMONLISP | 27 | 956 | 120.8 | 929 | 3440.7% |
>>>>>>> Stashed changes
--- ---
@ -497,6 +562,10 @@ Individual Reports → Aggregation Script → Chart Generation (via UN) → Fina
- `reports/4.2.23/perf.json` - 713 tests, generated 2026-01-24T19:14:09Z - `reports/4.2.23/perf.json` - 713 tests, generated 2026-01-24T19:14:09Z
- `reports/4.2.24/perf.json` - 665 tests, generated 2026-01-24T19:13:51Z - `reports/4.2.24/perf.json` - 665 tests, generated 2026-01-24T19:13:51Z
- `reports/4.2.25/perf.json` - 681 tests, generated 2026-01-24T21:04:06Z - `reports/4.2.25/perf.json` - 681 tests, generated 2026-01-24T21:04:06Z
<<<<<<< Updated upstream
=======
- `reports/4.2.26/perf.json` - 661 tests, generated 2026-01-24T21:08:03Z
>>>>>>> Stashed changes
- `reports/4.2.3/perf.json` - 642 tests, generated 2026-01-19T11:58:45Z - `reports/4.2.3/perf.json` - 642 tests, generated 2026-01-19T11:58:45Z
- `reports/4.2.4/perf.json` - 682 tests, generated 2026-01-19T12:02:14Z - `reports/4.2.4/perf.json` - 682 tests, generated 2026-01-19T12:02:14Z
- `reports/4.2.5/perf.json` - 658 tests, generated 2026-01-19T19:10:23Z - `reports/4.2.5/perf.json` - 658 tests, generated 2026-01-19T19:10:23Z
@ -700,5 +769,9 @@ For questions about this methodology or to report issues:
--- ---
**Generated by UN Inception Performance Analysis Pipeline** **Generated by UN Inception Performance Analysis Pipeline**
<<<<<<< Updated upstream
**Analysis Date:** 2026-01-24T16:04:31.155396 **Analysis Date:** 2026-01-24T16:04:31.155396
=======
**Analysis Date:** 2026-01-24T16:08:28.054661
>>>>>>> Stashed changes
**Report Version:** 1.0.0 **Report Version:** 1.0.0