un-inception/reports/4.2.4/perf.md

3.5 KiB

Performance Report: 4.2.4

Generated: 2026-01-19T12:02:14Z Pipeline: #11256

Summary

Metric Value
Total Tests 682
Passed 682
Failed 0
Pass Rate 100.0%
Languages 42
Avg Duration 70s
Slowest python (110s)
Fastest c (23s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • PYTHON and JAVASCRIPT are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • C is the fastest at 23 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 42 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (python, javascript)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): PYTHON, JAVASCRIPT, ELIXIR, SCHEME, BASH Fastest (right): C, D, COBOL, RAKU, CPP


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - python and javascript took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
python Passed 110s
javascript Passed 109s
elixir Passed 105s
scheme Passed 100s
bash Passed 100s
erlang Passed 97s
clojure Passed 97s
tcl Passed 96s
powershell Passed 96s
rust Passed 94s
go Passed 94s
typescript Passed 80s
ruby Passed 79s
perl Passed 77s
nim Passed 76s
r Passed 74s
php Passed 74s
lua Passed 71s
objc Passed 70s
julia Passed 68s
haskell Passed 66s
ocaml Passed 64s
csharp Passed 63s
fsharp Passed 62s
prolog Passed 61s
zig Passed 60s
crystal Passed 60s
commonlisp Passed 60s
groovy Passed 59s
dart Passed 58s
java Passed 57s
deno Passed 56s
kotlin Passed 54s
fortran Passed 51s
awk Passed 51s
v Passed 49s
forth Passed 49s
cpp Passed 49s
raku Passed 45s
cobol Passed 43s
d Passed 40s
c Passed 23s

Report generated by UN Inception CI pipeline