un-inception/reports/4.2.27/perf.md

3.6 KiB

Performance Report: 4.2.27

Generated: 2026-01-24T23:27:26Z Pipeline: #12505

Summary

Metric Value
Total Tests 653
Passed 653
Failed 0
Pass Rate 100.0%
Languages 43
Avg Duration 119s
Slowest commonlisp (176s)
Fastest php (50s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • COMMONLISP and FORTRAN are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • PHP is the fastest at 50 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (commonlisp, fortran)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): COMMONLISP, FORTRAN, D, ZIG, POWERSHELL Fastest (right): PHP, LUA, BASH, PERL, R


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - commonlisp and fortran took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
commonlisp Passed 176s
fortran Passed 175s
d Passed 171s
zig Passed 169s
powershell Passed 162s
deno Passed 157s
clojure Passed 154s
crystal Passed 153s
cobol Passed 153s
groovy Passed 152s
raku Passed 150s
c Passed 149s
tcl Passed 148s
go Passed 147s
cpp Passed 147s
rust Passed 146s
scheme Passed 145s
java Passed 145s
kotlin Passed 144s
nim Passed 139s
v Passed 133s
awk Passed 125s
objc Passed 122s
dart Passed 120s
julia Passed 119s
ocaml Passed 118s
haskell Passed 117s
fsharp Passed 117s
csharp Passed 117s
dotnet Passed 116s
prolog Passed 115s
forth Passed 114s
python Passed 65s
erlang Passed 61s
elixir Passed 61s
typescript Passed 58s
ruby Passed 58s
javascript Passed 58s
r Passed 54s
perl Passed 53s
bash Passed 52s
lua Passed 51s
php Passed 50s

Report generated by UN Inception CI pipeline