un-inception/reports/4.2.26/perf.md

3.6 KiB

Performance Report: 4.2.26

Generated: 2026-01-24T21:08:03Z Pipeline: #12477

Summary

Metric Value
Total Tests 661
Passed 661
Failed 0
Pass Rate 100.0%
Languages 43
Avg Duration 78s
Slowest cpp (130s)
Fastest python (25s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • CPP and RAKU are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • PYTHON is the fastest at 25 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (cpp, raku)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): CPP, RAKU, COBOL, JAVASCRIPT, RUBY Fastest (right): PYTHON, FSHARP, OCAML, HASKELL, DART


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - cpp and raku took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
cpp Passed 130s
raku Passed 126s
cobol Passed 119s
javascript Passed 114s
ruby Passed 110s
perl Passed 108s
php Passed 107s
elixir Passed 107s
typescript Passed 104s
lua Passed 103s
tcl Passed 101s
bash Passed 101s
scheme Passed 100s
clojure Passed 96s
erlang Passed 95s
powershell Passed 89s
crystal Passed 89s
commonlisp Passed 88s
groovy Passed 86s
deno Passed 86s
csharp Passed 85s
awk Passed 78s
dotnet Passed 69s
c Passed 67s
r Passed 66s
prolog Passed 65s
rust Passed 63s
java Passed 62s
go Passed 62s
kotlin Passed 59s
fortran Passed 59s
forth Passed 58s
d Passed 58s
zig Passed 55s
v Passed 54s
objc Passed 54s
nim Passed 53s
julia Passed 52s
dart Passed 52s
haskell Passed 51s
ocaml Passed 49s
fsharp Passed 34s
python Passed 25s

Report generated by UN Inception CI pipeline