un-inception/reports/4.2.0/perf.md
2026-01-19 15:26:09 -05:00

3.5 KiB

Performance Report: 4.2.0

Generated: 2026-01-19T01:08:20Z Pipeline: #11105

Summary

Metric Value
Total Tests 642
Passed 642
Failed 0
Pass Rate 100.0%
Languages 42
Avg Duration 33s
Slowest raku (93s)
Fastest ocaml (19s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • RAKU and JAVASCRIPT are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • OCAML is the fastest at 19 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 42 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (raku, javascript)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): RAKU, JAVASCRIPT, CPP, RUST, GO Fastest (right): OCAML, COBOL, CSHARP, ELIXIR, TCL


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - raku and javascript took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
raku Passed 93s
javascript Passed 90s
cpp Passed 66s
rust Passed 64s
go Passed 53s
prolog Passed 50s
bash Passed 43s
forth Passed 42s
python Passed 40s
powershell Passed 39s
java Passed 36s
ruby Passed 35s
d Passed 33s
zig Passed 32s
lua Passed 32s
julia Passed 32s
nim Passed 31s
commonlisp Passed 30s
typescript Passed 29s
objc Passed 29s
erlang Passed 29s
dart Passed 28s
kotlin Passed 27s
perl Passed 26s
fsharp Passed 26s
r Passed 25s
fortran Passed 25s
deno Passed 25s
awk Passed 25s
scheme Passed 24s
crystal Passed 24s
php Passed 23s
groovy Passed 23s
c Passed 23s
v Passed 22s
haskell Passed 21s
clojure Passed 21s
tcl Passed 20s
elixir Passed 20s
csharp Passed 20s
cobol Passed 20s
ocaml Passed 19s

Report generated by UN Inception CI pipeline