un-inception/reports/4.2.5/perf.md

145 lines
3.5 KiB
Markdown

# Performance Report: 4.2.5
**Generated:** 2026-01-19T19:10:23Z
**Pipeline:** [#11336](https://git.unturf.com/engineering/unturf/un-inception/-/pipelines/11336)
## Summary
| Metric | Value |
|--------|-------|
| Total Tests | 658 |
| Passed | 658 |
| Failed | 0 |
| Pass Rate | 100.0% |
| Languages | 42 |
| Avg Duration | 67s |
| Slowest | v (114s) |
| Fastest | erlang (44s) |
---
## Test Duration by Language
The primary performance metric - how long each language takes to run its full test suite (15 tests per language).
![Duration by Language](chart-duration-by-language.png)
**Key observations:**
- **V** and **HASKELL** are outliers at 90+ seconds
- Most languages cluster between 20-40 seconds
- Compiled languages (red) tend to be faster than interpreted (blue)
- **ERLANG** is the fastest at 44 seconds
---
## Compiled vs Interpreted
Comparing performance between compiled languages (C, Go, Rust, etc.) and interpreted languages (Python, Ruby, JavaScript, etc.).
![Category Comparison](chart-category-comparison.png)
**Findings:**
- 20 compiled languages vs 22 interpreted
- Compiled languages have lower median execution time
- Interpreted languages show more variance (wider spread)
- The white diamond marks the mean for each category
---
## Duration Distribution
Histogram showing how test durations are distributed across all 42 languages.
![Duration Histogram](chart-duration-histogram.png)
**Distribution analysis:**
- Most languages complete in 20-35 seconds (the peak)
- Mean (green dashed) and median (blue dotted) are close together
- Long tail on the right from slow outliers (v, haskell)
---
## Speed Leaders
Side-by-side comparison of the 10 slowest and 10 fastest languages.
![Speed Leaders](chart-speed-leaders.png)
**Slowest (left):** V, HASKELL, SCHEME, OCAML, POWERSHELL
**Fastest (right):** ERLANG, AWK, BASH, DENO, TCL
---
## Queue vs Execution Time
Scatter plot showing the relationship between CI queue wait time and actual test execution time.
![Queue vs Execution](chart-queue-vs-execution.png)
**Notes:**
- Queue time is how long the job waited for a runner
- Most jobs had similar queue times (clustered vertically)
- Outliers labeled - v and haskell took longest to execute regardless of queue time
---
## Dashboard
Summary dashboard combining key metrics and visualizations.
![Dashboard](chart-dashboard.png)
---
## Raw Data
### Per-Language Performance
| Language | Status | Duration |
|----------|--------|----------|
| v | Passed | 114s |
| haskell | Passed | 106s |
| scheme | Passed | 102s |
| ocaml | Passed | 94s |
| powershell | Passed | 91s |
| julia | Passed | 88s |
| crystal | Passed | 88s |
| fsharp | Passed | 85s |
| forth | Passed | 80s |
| objc | Passed | 79s |
| clojure | Passed | 75s |
| prolog | Passed | 74s |
| groovy | Passed | 70s |
| commonlisp | Passed | 70s |
| dart | Passed | 68s |
| c | Passed | 68s |
| go | Passed | 65s |
| cpp | Passed | 65s |
| rust | Passed | 64s |
| csharp | Passed | 63s |
| java | Passed | 62s |
| python | Passed | 61s |
| kotlin | Passed | 61s |
| cobol | Passed | 61s |
| ruby | Passed | 60s |
| javascript | Passed | 60s |
| zig | Passed | 59s |
| typescript | Passed | 59s |
| nim | Passed | 58s |
| fortran | Passed | 57s |
| php | Passed | 55s |
| elixir | Passed | 55s |
| d | Passed | 55s |
| raku | Passed | 54s |
| perl | Passed | 53s |
| r | Passed | 52s |
| lua | Passed | 52s |
| tcl | Passed | 51s |
| deno | Passed | 50s |
| bash | Passed | 47s |
| awk | Passed | 46s |
| erlang | Passed | 44s |
---
*Report generated by UN Inception CI pipeline*