bend runs on a 2-host LAN cluster; round-robin selection lives in bend.lsp via *bend-workers* + BEND_WORKERS env.
Production default: single host. Multi-host fan-out is built (round-robin in bend.lsp via *bend-workers* + BEND_WORKERS env), available on demand for long-running parallel workloads — not used routinely.
| host | GPU | arch | port | coexists with |
|---|---|---|---|---|
| host | GPU | arch | port | status |
3090-ai.foxhop.net | RTX 3090 (24 GB) | sm_86 | 9091 | idle |
ai.foxhop.net | RTX 4090 (24 GB) | sm_89 | 9092 | qwen LLM (llama.cpp) on GPU |
3090-ai.foxhop.net | RTX 3090 (24 GB) | sm_86 | 9091 | active — production worker |
ai.foxhop.net | RTX 4090 (24 GB) | sm_89 | 9092 | reserved for qwen LLM (llama.cpp); bend worker enabled per workload |
The 4090 box shares its GPU with a qwen LLM — bend kernels burn SMs for milliseconds then release; qwen keeps its weights resident; 24 GB VRAM holds both. Cluster aggregate (sequential round-robin dispatcher): 1.6× at 200 × n=1k mod-mul, 1.2× at 6 × n=100k; an async dispatcher unlocks the remaining 2× headroom.
Multi-host fan-out was validated at 1.6× aggregate throughput on small workloads, but routine round-robin against the 4090 would steal VRAM from qwen. Caller opts in explicitly when a workload justifies fan-out: (bend-set-workers! '(("3090-ai.foxhop.net" . 9091) ("ai.foxhop.net" . 9092))) brings the 4090 online for that call.