un-inception/reports/4.2.9/perf.md

3.5 KiB

Performance Report: 4.2.9

Generated: 2026-01-23T10:05:34Z Pipeline: #12060

Summary

Metric Value
Total Tests 645
Passed 645
Failed 0
Pass Rate 100.0%
Languages 43
Avg Duration 107s
Slowest ruby (279s)
Fastest d (19s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • RUBY and DENO are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • D is the fastest at 19 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (ruby, deno)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): RUBY, DENO, RUST, CRYSTAL, JAVA Fastest (right): D, CSHARP, JULIA, NIM, OBJC


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - ruby and deno took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
ruby Passed 279s
deno Passed 253s
rust Passed 234s
crystal Passed 221s
java Passed 219s
cpp Passed 167s
javascript Passed 166s
python Passed 165s
php Passed 158s
perl Passed 158s
zig Passed 153s
scheme Passed 153s
commonlisp Passed 147s
raku Passed 141s
powershell Passed 135s
typescript Passed 118s
ocaml Passed 115s
erlang Passed 105s
awk Passed 99s
haskell Passed 98s
groovy Passed 98s
go Passed 92s
kotlin Passed 89s
dart Passed 82s
fsharp Passed 73s
dotnet Passed 71s
prolog Passed 69s
forth Passed 69s
elixir Passed 59s
bash Passed 58s
lua Passed 56s
clojure Passed 56s
tcl Passed 54s
r Passed 54s
c Passed 48s
cobol Passed 46s
fortran Passed 45s
v Passed 42s
objc Passed 42s
nim Passed 42s
julia Passed 40s
csharp Passed 40s
d Passed 19s

Report generated by UN Inception CI pipeline