un-inception/reports/4.2.18/perf.md

3.5 KiB

Performance Report: 4.2.18

Generated: 2026-01-23T16:05:03Z Pipeline: #12188

Summary

Metric Value
Total Tests 665
Passed 665
Failed 0
Pass Rate 100.0%
Languages 43
Avg Duration 100s
Slowest r (298s)
Fastest scheme (48s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • R and GO are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • SCHEME is the fastest at 48 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (r, go)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): R, GO, ELIXIR, RUST, FORTH Fastest (right): SCHEME, TCL, FORTRAN, C, ERLANG


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - r and go took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
r Passed 298s
go Passed 237s
elixir Passed 187s
rust Passed 174s
forth Passed 161s
groovy Passed 150s
ruby Passed 135s
php Passed 133s
cpp Passed 119s
v Passed 115s
deno Passed 114s
csharp Passed 114s
dotnet Passed 106s
typescript Passed 104s
powershell Passed 102s
commonlisp Passed 102s
clojure Passed 102s
crystal Passed 101s
perl Passed 93s
java Passed 92s
kotlin Passed 84s
d Passed 82s
javascript Passed 79s
dart Passed 79s
python Passed 77s
haskell Passed 75s
lua Passed 73s
zig Passed 72s
cobol Passed 72s
nim Passed 71s
julia Passed 71s
objc Passed 70s
bash Passed 68s
ocaml Passed 67s
awk Passed 66s
fsharp Passed 64s
prolog Passed 62s
raku Passed 60s
erlang Passed 60s
c Passed 59s
fortran Passed 55s
tcl Passed 49s
scheme Passed 48s

Report generated by UN Inception CI pipeline