un-inception/reports/4.2.32/perf.md

3.6 KiB

Performance Report: 4.2.32

Generated: 2026-01-28T22:23:28Z Pipeline: #13308

Summary

Metric Value
Total Tests 776
Passed 776
Failed 0
Pass Rate 100.0%
Languages 43
Avg Duration 99s
Slowest kotlin (159s)
Fastest cpp (32s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • KOTLIN and COBOL are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • CPP is the fastest at 32 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (kotlin, cobol)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): KOTLIN, COBOL, FORTRAN, D, ZIG Fastest (right): CPP, C, RAKU, GO, PYTHON


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - kotlin and cobol took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
kotlin Passed 159s
cobol Passed 156s
fortran Passed 154s
d Passed 153s
zig Passed 152s
nim Passed 151s
v Passed 147s
objc Passed 146s
julia Passed 144s
dart Passed 144s
ocaml Passed 143s
haskell Passed 143s
fsharp Passed 143s
csharp Passed 128s
dotnet Passed 127s
prolog Passed 126s
forth Passed 125s
java Passed 108s
tcl Passed 99s
scheme Passed 98s
rust Passed 93s
typescript Passed 86s
bash Passed 84s
r Passed 82s
perl Passed 82s
javascript Passed 81s
ruby Passed 78s
elixir Passed 76s
powershell Passed 75s
php Passed 75s
clojure Passed 75s
lua Passed 72s
erlang Passed 72s
commonlisp Passed 64s
crystal Passed 63s
groovy Passed 62s
awk Passed 60s
deno Passed 59s
python Passed 55s
go Passed 45s
raku Passed 36s
c Passed 35s
cpp Passed 32s

Report generated by UN Inception CI pipeline