russell@unturf.com
9e4e9b48f9
Fox decision: don't routine-fan-out to ai.foxhop.net (4090) when qwen LLM holds GPU residency. The radix-sort 4090 OOM caveat surfaced today demonstrated the cost of casual co-residency — secp daemon parked 24 GiB up front leaving 47 MiB free. bend.lsp's *bend-workers* default already empty (single-host fallback). Updated the docstring example to drop the ai.foxhop.net entry; multi-host fan-out is OPT-IN per call via bend-set-workers! or BEND_WORKERS env. bend.html fleet section now reflects the policy: - 3090-ai.foxhop.net:9091 active production worker - ai.foxhop.net:9092 reserved for qwen; bend per workload ai.foxhop.net worker process killed; 4090 VRAM returned to qwen (1.6 GiB free post-kill vs 47 MiB while bend was running). When we have a long-running parallel sweep that justifies the 4090's marginal throughput, the caller opts in explicitly. Don't auto-route. |
||
|---|---|---|
| .. | ||
| fonts/chunkfive | ||
| 404.html | ||
| bend.html | ||
| index.html | ||
| lumbda-logo-green.png | ||
| lumbda-logo.png | ||
| lumbda-whitepaper.html | ||
| lumbda-whitepaper.pdf | ||
| robots.txt | ||
| style.css | ||
