un-inception/reports/4.2.6/perf.md

3.5 KiB

Performance Report: 4.2.6

Generated: 2026-01-19T20:22:16Z Pipeline: #11363

Summary

Metric Value
Total Tests 642
Passed 642
Failed 0
Pass Rate 100.0%
Languages 42
Avg Duration 54s
Slowest haskell (128s)
Fastest awk (23s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • HASKELL and GO are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • AWK is the fastest at 23 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 42 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (haskell, go)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): HASKELL, GO, CPP, RUST, FORTH Fastest (right): AWK, POWERSHELL, CRYSTAL, RAKU, DENO


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - haskell and go took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
haskell Passed 128s
go Passed 107s
cpp Passed 93s
rust Passed 91s
forth Passed 75s
c Passed 74s
java Passed 70s
kotlin Passed 69s
cobol Passed 66s
fortran Passed 62s
csharp Passed 61s
zig Passed 59s
prolog Passed 59s
v Passed 58s
nim Passed 58s
d Passed 58s
objc Passed 56s
dart Passed 56s
julia Passed 54s
typescript Passed 53s
ocaml Passed 53s
python Passed 52s
fsharp Passed 52s
javascript Passed 50s
ruby Passed 48s
php Passed 48s
r Passed 47s
perl Passed 44s
tcl Passed 42s
scheme Passed 42s
elixir Passed 41s
groovy Passed 40s
clojure Passed 40s
lua Passed 36s
commonlisp Passed 35s
bash Passed 35s
erlang Passed 34s
deno Passed 34s
raku Passed 33s
crystal Passed 28s
powershell Passed 26s
awk Passed 23s

Report generated by UN Inception CI pipeline