un-inception/reports/4.2.21/perf.md

3.5 KiB

Performance Report: 4.2.21

Generated: 2026-01-23T21:16:07Z Pipeline: #12250

Summary

Metric Value
Total Tests 661
Passed 661
Failed 0
Pass Rate 100.0%
Languages 43
Avg Duration 102s
Slowest nim (215s)
Fastest erlang (22s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • NIM and DART are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • ERLANG is the fastest at 22 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (nim, dart)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): NIM, DART, JAVA, CPP, RUST Fastest (right): ERLANG, R, RUBY, AWK, TYPESCRIPT


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - nim and dart took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
nim Passed 215s
dart Passed 208s
java Passed 204s
cpp Passed 204s
rust Passed 199s
zig Passed 192s
lua Passed 183s
forth Passed 142s
haskell Passed 129s
php Passed 127s
fsharp Passed 125s
fortran Passed 125s
ocaml Passed 124s
csharp Passed 123s
v Passed 121s
objc Passed 121s
perl Passed 104s
bash Passed 104s
elixir Passed 102s
tcl Passed 98s
go Passed 94s
deno Passed 85s
raku Passed 83s
julia Passed 80s
d Passed 80s
scheme Passed 79s
commonlisp Passed 77s
clojure Passed 77s
kotlin Passed 76s
crystal Passed 76s
c Passed 76s
groovy Passed 75s
powershell Passed 74s
dotnet Passed 64s
prolog Passed 62s
cobol Passed 62s
python Passed 43s
javascript Passed 42s
typescript Passed 39s
awk Passed 33s
ruby Passed 30s
r Passed 24s
erlang Passed 22s

Report generated by UN Inception CI pipeline