un-inception/reports/4.2.20/perf.md

3.6 KiB

Performance Report: 4.2.20

Generated: 2026-01-23T20:41:23Z Pipeline: #12241

Summary

Metric Value
Total Tests 685
Passed 685
Failed 0
Pass Rate 100.0%
Languages 43
Avg Duration 114s
Slowest java (272s)
Fastest crystal (49s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • JAVA and ZIG are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • CRYSTAL is the fastest at 49 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (java, zig)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): JAVA, ZIG, COBOL, PERL, HASKELL Fastest (right): CRYSTAL, DENO, V, R, CSHARP


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - java and zig took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
java Passed 272s
zig Passed 224s
cobol Passed 198s
perl Passed 191s
haskell Passed 187s
bash Passed 186s
objc Passed 155s
raku Passed 154s
elixir Passed 150s
awk Passed 145s
c Passed 144s
rust Passed 142s
fortran Passed 139s
typescript Passed 138s
lua Passed 133s
dart Passed 127s
go Passed 126s
kotlin Passed 109s
cpp Passed 107s
nim Passed 103s
d Passed 99s
commonlisp Passed 99s
ocaml Passed 98s
dotnet Passed 94s
prolog Passed 91s
ruby Passed 89s
python Passed 88s
javascript Passed 87s
julia Passed 86s
php Passed 84s
tcl Passed 80s
erlang Passed 79s
scheme Passed 75s
groovy Passed 75s
clojure Passed 75s
fsharp Passed 73s
forth Passed 73s
powershell Passed 72s
csharp Passed 58s
r Passed 57s
v Passed 56s
deno Passed 56s
crystal Passed 49s

Report generated by UN Inception CI pipeline