un-inception/reports/4.2.5/perf.md

3.5 KiB

Performance Report: 4.2.5

Generated: 2026-01-19T19:10:23Z Pipeline: #11336

Summary

Metric Value
Total Tests 658
Passed 658
Failed 0
Pass Rate 100.0%
Languages 42
Avg Duration 67s
Slowest v (114s)
Fastest erlang (44s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • V and HASKELL are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • ERLANG is the fastest at 44 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 42 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (v, haskell)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): V, HASKELL, SCHEME, OCAML, POWERSHELL Fastest (right): ERLANG, AWK, BASH, DENO, TCL


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - v and haskell took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
v Passed 114s
haskell Passed 106s
scheme Passed 102s
ocaml Passed 94s
powershell Passed 91s
julia Passed 88s
crystal Passed 88s
fsharp Passed 85s
forth Passed 80s
objc Passed 79s
clojure Passed 75s
prolog Passed 74s
groovy Passed 70s
commonlisp Passed 70s
dart Passed 68s
c Passed 68s
go Passed 65s
cpp Passed 65s
rust Passed 64s
csharp Passed 63s
java Passed 62s
python Passed 61s
kotlin Passed 61s
cobol Passed 61s
ruby Passed 60s
javascript Passed 60s
zig Passed 59s
typescript Passed 59s
nim Passed 58s
fortran Passed 57s
php Passed 55s
elixir Passed 55s
d Passed 55s
raku Passed 54s
perl Passed 53s
r Passed 52s
lua Passed 52s
tcl Passed 51s
deno Passed 50s
bash Passed 47s
awk Passed 46s
erlang Passed 44s

Report generated by UN Inception CI pipeline