un-inception/reports/4.2.25/perf.md

3.6 KiB

Performance Report: 4.2.25

Generated: 2026-01-24T21:04:06Z Pipeline: #12475

Summary

Metric Value
Total Tests 681
Passed 681
Failed 0
Pass Rate 100.0%
Languages 43
Avg Duration 97s
Slowest fortran (151s)
Fastest bash (58s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • FORTRAN and CRYSTAL are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • BASH is the fastest at 58 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (fortran, crystal)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): FORTRAN, CRYSTAL, PERL, AWK, CPP Fastest (right): BASH, POWERSHELL, FORTH, R, PROLOG


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - fortran and crystal took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
fortran Passed 151s
crystal Passed 145s
perl Passed 142s
awk Passed 140s
cpp Passed 136s
erlang Passed 131s
go Passed 130s
groovy Passed 115s
deno Passed 115s
julia Passed 113s
cobol Passed 112s
ruby Passed 111s
raku Passed 111s
dart Passed 111s
kotlin Passed 110s
elixir Passed 109s
zig Passed 108s
d Passed 107s
haskell Passed 103s
fsharp Passed 102s
nim Passed 100s
rust Passed 99s
ocaml Passed 99s
v Passed 97s
c Passed 94s
objc Passed 93s
java Passed 86s
tcl Passed 82s
commonlisp Passed 80s
typescript Passed 79s
csharp Passed 77s
python Passed 76s
scheme Passed 74s
javascript Passed 74s
php Passed 73s
lua Passed 72s
dotnet Passed 72s
clojure Passed 69s
prolog Passed 67s
r Passed 65s
forth Passed 63s
powershell Passed 61s
bash Passed 58s

Report generated by UN Inception CI pipeline