un-inception/reports/4.2.7/perf.md

3.6 KiB

Performance Report: 4.2.7

Generated: 2026-01-23T09:36:18Z Pipeline: #12043

Summary

Metric Value
Total Tests 631
Passed 630
Failed 0
Pass Rate 99.8%
Languages 43
Avg Duration 117s
Slowest typescript (319s)
Fastest dotnet (5s)

Test Duration by Language

The primary performance metric - how long each language takes to run its full test suite (15 tests per language).

Duration by Language

Key observations:

  • TYPESCRIPT and RUBY are outliers at 90+ seconds
  • Most languages cluster between 20-40 seconds
  • Compiled languages (red) tend to be faster than interpreted (blue)
  • DOTNET is the fastest at 5 seconds

Compiled vs Interpreted

Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).

Category Comparison

Findings:

  • 20 compiled languages vs 22 interpreted
  • Compiled languages have lower median execution time
  • Interpreted languages show more variance (wider spread)
  • The white diamond marks the mean for each category

Duration Distribution

Histogram showing how test durations are distributed across all 43 languages.

Duration Histogram

Distribution analysis:

  • Most languages complete in 20-35 seconds (the peak)
  • Mean (green dashed) and median (blue dotted) are close together
  • Long tail on the right from slow outliers (typescript, ruby)

Speed Leaders

Side-by-side comparison of the 10 slowest and 10 fastest languages.

Speed Leaders

Slowest (left): TYPESCRIPT, RUBY, R, ELIXIR, CRYSTAL Fastest (right): DOTNET, AWK, DENO, COMMONLISP, FORTRAN


Queue vs Execution Time

Scatter plot showing the relationship between CI queue wait time and actual test execution time.

Queue vs Execution

Notes:

  • Queue time is how long the job waited for a runner
  • Most jobs had similar queue times (clustered vertically)
  • Outliers labeled - typescript and ruby took longest to execute regardless of queue time

Dashboard

Summary dashboard combining key metrics and visualizations.

Dashboard


Raw Data

Per-Language Performance

Language Status Duration
typescript Passed 319s
ruby Passed 318s
r Passed 313s
elixir Passed 313s
crystal Passed 260s
php Passed 235s
bash Passed 233s
julia Passed 226s
objc Passed 223s
perl Passed 155s
javascript Passed 155s
lua Passed 152s
tcl Passed 148s
erlang Passed 148s
scheme Passed 146s
powershell Passed 141s
dart Passed 110s
raku Passed 92s
go Passed 86s
zig Passed 79s
d Passed 78s
nim Passed 77s
v Passed 76s
haskell Passed 76s
cpp Passed 75s
c Passed 72s
forth Passed 71s
rust Passed 69s
ocaml Passed 68s
python Passed 58s
prolog Passed 56s
fsharp Passed 54s
csharp Passed 54s
cobol Passed 50s
kotlin Passed 49s
clojure Passed 48s
groovy Passed 36s
java Passed 33s
fortran Passed 27s
commonlisp Passed 27s
deno Passed 24s
awk Passed 24s
dotnet Passed 5s

Report generated by UN Inception CI pipeline