un-inception/reports/4.2.8/perf.md

3.6 KiB

Performance Report: 4.2.8

Generated: 2026-01-23T10:01:33Z Pipeline: #12055

Summary

Metric Value
Total Tests 645
Passed 644
Failed 1
Pass Rate 99.8%
Languages 43
Avg Duration 111s
Slowest kotlin (313s)
Fastest fortran (28s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • KOTLIN and PYTHON are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • FORTRAN is the fastest at 28 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (kotlin, python)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): KOTLIN, PYTHON, JAVASCRIPT, TCL, RAKU Fastest (right): FORTRAN, GROOVY, CRYSTAL, JAVA, POWERSHELL


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - kotlin and python took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
kotlin Passed 313s
python Passed 253s
javascript Passed 253s
tcl Passed 247s
raku Passed 240s
cobol Passed 199s
zig Passed 187s
haskell Passed 168s
ocaml Passed 167s
fsharp Passed 165s
bash Passed 155s
elixir Passed 127s
r Passed 126s
d Passed 120s
v Passed 109s
dotnet Passed 102s
typescript Passed 94s
ruby Passed 93s
nim Passed 93s
php Passed 91s
perl Passed 91s
dart Passed 90s
objc Passed 89s
julia Passed 88s
csharp Passed 87s
lua Passed 84s
prolog Passed 81s
forth Passed 78s
erlang Failed 75s
cpp Passed 66s
c Passed 66s
go Passed 64s
awk Passed 64s
rust Passed 63s
scheme Passed 55s
commonlisp Passed 53s
clojure Passed 53s
deno Passed 52s
powershell Passed 51s
java Passed 45s
crystal Passed 44s
groovy Passed 41s
fortran Passed 28s

Report generated by UN Inception CI pipeline