un-inception/reports/4.2.16/perf.md

3.6 KiB

Performance Report: 4.2.16

Generated: 2026-01-23T15:25:53Z Pipeline: #12168

Summary

Metric Value
Total Tests 665
Passed 664
Failed 1
Pass Rate 99.8%
Languages 43
Avg Duration 98s
Slowest javascript (361s)
Fastest c (40s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • JAVASCRIPT and CLOJURE are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • C is the fastest at 40 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (javascript, clojure)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): JAVASCRIPT, CLOJURE, CRYSTAL, LUA, FSHARP Fastest (right): C, CPP, AWK, RAKU, GROOVY


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - javascript and clojure took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
javascript Passed 361s
clojure Passed 275s
crystal Passed 273s
lua Passed 242s
fsharp Passed 209s
commonlisp Passed 156s
zig Passed 131s
python Passed 130s
kotlin Passed 127s
php Passed 115s
go Passed 111s
rust Passed 108s
julia Passed 108s
ocaml Passed 105s
powershell Failed 93s
typescript Passed 84s
ruby Passed 83s
cobol Passed 83s
perl Passed 82s
d Passed 81s
nim Passed 80s
haskell Passed 80s
v Passed 78s
objc Passed 67s
dart Passed 67s
r Passed 64s
csharp Passed 60s
bash Passed 58s
elixir Passed 57s
erlang Passed 56s
tcl Passed 53s
scheme Passed 53s
java Passed 52s
fortran Passed 52s
prolog Passed 50s
dotnet Passed 50s
forth Passed 49s
deno Passed 48s
groovy Passed 44s
raku Passed 41s
awk Passed 41s
cpp Passed 40s
c Passed 40s

Report generated by UN Inception CI pipeline