un-inception/reports/4.2.28/perf.md

3.6 KiB

Performance Report: 4.2.28

Generated: 2026-01-24T23:31:17Z Pipeline: #12507

Summary

Metric Value
Total Tests 645
Passed 645
Failed 0
Pass Rate 100.0%
Languages 43
Avg Duration 116s
Slowest commonlisp (145s)
Fastest awk (102s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • COMMONLISP and PERL are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • AWK is the fastest at 102 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (commonlisp, perl)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): COMMONLISP, PERL, LUA, R, BASH Fastest (right): AWK, COBOL, D, FORTRAN, JAVA


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - commonlisp and perl took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
commonlisp Passed 145s
perl Passed 143s
lua Passed 140s
r Passed 137s
bash Passed 137s
elixir Passed 131s
tcl Passed 130s
scheme Passed 129s
erlang Passed 129s
julia Passed 128s
raku Passed 127s
dart Passed 127s
c Passed 126s
haskell Passed 124s
fsharp Passed 124s
ocaml Passed 123s
cpp Passed 123s
groovy Passed 117s
python Passed 114s
javascript Passed 113s
go Passed 113s
typescript Passed 112s
ruby Passed 112s
crystal Passed 112s
clojure Passed 112s
deno Passed 111s
php Passed 110s
rust Passed 109s
csharp Passed 109s
prolog Passed 106s
dotnet Passed 106s
forth Passed 105s
v Passed 104s
kotlin Passed 104s
zig Passed 103s
powershell Passed 103s
objc Passed 103s
nim Passed 103s
java Passed 103s
fortran Passed 103s
d Passed 103s
cobol Passed 103s
awk Passed 102s

Report generated by UN Inception CI pipeline