un-inception/reports/4.2.17/perf.md

3.6 KiB

Performance Report: 4.2.17

Generated: 2026-01-23T15:34:55Z Pipeline: #12173

Summary

Metric Value
Total Tests 665
Passed 665
Failed 0
Pass Rate 100.0%
Languages 43
Avg Duration 104s
Slowest ruby (270s)
Fastest objc (17s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • RUBY and TYPESCRIPT are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • OBJC is the fastest at 17 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (ruby, typescript)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): RUBY, TYPESCRIPT, PHP, COBOL, COMMONLISP Fastest (right): OBJC, PYTHON, ERLANG, CSHARP, PERL


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - ruby and typescript took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
ruby Passed 270s
typescript Passed 249s
php Passed 243s
cobol Passed 220s
commonlisp Passed 198s
zig Passed 175s
deno Passed 175s
awk Passed 175s
v Passed 167s
groovy Passed 151s
kotlin Passed 144s
c Passed 135s
cpp Passed 134s
javascript Passed 127s
forth Passed 123s
scheme Passed 106s
fortran Passed 100s
d Passed 100s
prolog Passed 98s
nim Passed 98s
bash Passed 95s
r Passed 94s
elixir Passed 87s
fsharp Passed 85s
java Passed 84s
haskell Passed 83s
tcl Passed 67s
dotnet Passed 66s
julia Passed 65s
dart Passed 65s
clojure Passed 61s
crystal Passed 55s
go Passed 46s
rust Passed 45s
raku Passed 41s
powershell Passed 41s
lua Passed 40s
ocaml Passed 39s
perl Passed 38s
csharp Passed 36s
erlang Passed 26s
python Passed 19s
objc Passed 17s

Report generated by UN Inception CI pipeline