un-inception/reports/4.2.24/perf.md

3.5 KiB

Performance Report: 4.2.24

Generated: 2026-01-24T19:13:51Z Pipeline: #12445

Summary

Metric Value
Total Tests 665
Passed 665
Failed 0
Pass Rate 100.0%
Languages 43
Avg Duration 129s
Slowest python (494s)
Fastest clojure (8s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • PYTHON and PHP are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • CLOJURE is the fastest at 8 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (python, php)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): PYTHON, PHP, R, ELIXIR, DENO Fastest (right): CLOJURE, CSHARP, D, FORTH, FORTRAN


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - python and php took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
python Passed 494s
php Passed 471s
r Passed 434s
elixir Passed 404s
deno Passed 282s
typescript Passed 281s
groovy Passed 281s
raku Passed 252s
javascript Passed 242s
bash Passed 230s
c Passed 222s
perl Passed 205s
go Passed 196s
cobol Passed 192s
powershell Passed 126s
awk Passed 116s
ruby Passed 111s
v Passed 101s
cpp Passed 100s
crystal Passed 77s
scheme Passed 76s
dart Passed 73s
haskell Passed 71s
ocaml Passed 70s
objc Passed 70s
julia Passed 70s
fsharp Passed 70s
tcl Passed 42s
java Passed 40s
commonlisp Passed 36s
erlang Passed 29s
dotnet Passed 10s
rust Passed 9s
prolog Passed 9s
lua Passed 9s
zig Passed 8s
nim Passed 8s
kotlin Passed 8s
fortran Passed 8s
forth Passed 8s
d Passed 8s
csharp Passed 8s
clojure Passed 8s

Report generated by UN Inception CI pipeline