engineering/uncloseai.com
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Remove redundant TTS Setup section

Browse source
This commit is contained in:
Russell Ballestrini 2025-12-02 15:53:12 -05:00
parent 6590f9eb4c
commit 9730fff7f4
1 changed files with 0 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

4
public/inference.html
View file

@ -105,9 +105,6 @@ pip install vllm
python -m vllm.entrypoints.openai.api_server --model adamo1139/Hermes-3-Llama-3.1-8B-FP8-Dynamic --host 0.0.0.0 --port 18888 --max-model-len 82000 --enable-auto-tool-choice --tool-call-parser hermes
</code></pre>
<h3 id="tts-setup">TTS Setup</h3>
<p>For usage examples and documentation, see the <a href="/text-to-speech.html">Text-to-Speech page</a>.</p>
<h3 id="proxy-setup">Proxy Setup</h3>
<p>If you want to see how we setup the proxy, check out <a href="https://git.unturf.com/-/snippets/3" target="_blank">/etc/caddy/Caddyfile</a></p>
@ -250,7 +247,6 @@ curl https://qwen.ai.unturf.com/v1/models
<ul>
<li><a href="#inference-intro" class="active">Overview</a></li>
<li><a href="#vllm-setup">vLLM Setup</a></li>
<li><a href="#tts-setup">TTS Setup</a></li>
<li><a href="#proxy-setup">Proxy Setup</a></li>
<li><a href="#model-discovery">Model Discovery</a></li>
<li><a href="#rate-limiting">Rate Limiting</a></li>