un-inception/reports/4.2.15/perf.md

3.5 KiB

Performance Report: 4.2.15

Generated: 2026-01-23T15:14:36Z Pipeline: #12159

Summary

Metric Value
Total Tests 657
Passed 656
Failed 1
Pass Rate 99.8%
Languages 43
Avg Duration 103s
Slowest d (203s)
Fastest cobol (49s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • D and CPP are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • COBOL is the fastest at 49 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (d, cpp)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): D, CPP, RUBY, BASH, LUA Fastest (right): COBOL, CSHARP, OCAML, OBJC, KOTLIN


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - d and cpp took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
d Passed 203s
cpp Passed 186s
ruby Passed 183s
bash Passed 167s
lua Passed 166s
r Passed 164s
julia Passed 164s
elixir Passed 157s
zig Passed 151s
prolog Passed 150s
tcl Passed 138s
javascript Passed 130s
typescript Passed 127s
go Failed 115s
deno Passed 114s
dart Passed 107s
haskell Passed 105s
fsharp Passed 105s
dotnet Passed 102s
fortran Passed 101s
nim Passed 99s
forth Passed 99s
commonlisp Passed 96s
powershell Passed 93s
scheme Passed 77s
crystal Passed 74s
clojure Passed 73s
awk Passed 71s
groovy Passed 69s
erlang Passed 68s
raku Passed 67s
php Passed 65s
perl Passed 64s
c Passed 64s
v Passed 63s
python Passed 62s
rust Passed 60s
java Passed 60s
kotlin Passed 59s
objc Passed 57s
ocaml Passed 55s
csharp Passed 52s
cobol Passed 49s

Report generated by UN Inception CI pipeline