engineering/uncloseai.com
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Add qwen and qwen-vl endpoints to inference page, remove ai.unturf.com block

Browse source
This commit is contained in:
russell@unturf.com 2026-02-16 18:03:35 -05:00
parent 3258cac2a3
commit 3289b9b7be
1 changed files with 23 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

30
public/inference.html
View file

@ -110,11 +110,10 @@ python -m vllm.entrypoints.openai.api_server --model adamo1139/Hermes-3-Llama-3.
<h3 id="proxy-setup">Proxy Setup</h3>
<p>If you want to see how we setup the proxy, check out <a href="https://git.unturf.com/-/snippets/3" target="_blank">/etc/caddy/Caddyfile</a></p>
<pre><code>ai.unturf.com {
root * /opt/www
file_server
<pre><code>hermes.ai.unturf.com {
reverse_proxy &lt;removed&gt;:18888
log {
output file /var/log/caddy/ai.unturf.com.log {
output file /var/log/caddy/hermes.ai.unturf.com.log {
roll_size 50mb
roll_keep 5
}
@ -124,10 +123,23 @@ python -m vllm.entrypoints.openai.api_server --model adamo1139/Hermes-3-Llama-3.
}
}
hermes.ai.unturf.com {
reverse_proxy &lt;removed&gt;:18888
qwen.ai.unturf.com {
reverse_proxy &lt;removed&gt;:18889
log {
output file /var/log/caddy/hermes.ai.unturf.com.log {
output file /var/log/caddy/qwen.ai.unturf.com.log {
roll_size 50mb
roll_keep 5
}
}
tls {
on_demand
}
}
qwen-vl.ai.unturf.com {
reverse_proxy &lt;removed&gt;:18890
log {
output file /var/log/caddy/qwen-vl.ai.unturf.com.log {
roll_size 50mb
roll_keep 5
}
@ -157,6 +169,8 @@ speech.ai.unturf.com {
<h4>Swagger Documentation</h4>
<p>Access the interactive API docs at the <code>/docs</code> endpoint:</p>
<p><a href="https://hermes.ai.unturf.com/docs" target="_blank">hermes.ai.unturf.com/docs</a> - Hermes endpoint Swagger docs</p>
<p><a href="https://qwen.ai.unturf.com/docs" target="_blank">qwen.ai.unturf.com/docs</a> - Qwen endpoint Swagger docs</p>
<p><a href="https://qwen-vl.ai.unturf.com/docs" target="_blank">qwen-vl.ai.unturf.com/docs</a> - Qwen VL endpoint Swagger docs</p>
<p>The Swagger UI lets you explore all available endpoints, see request/response schemas, and test API calls directly in your browser.</p>
<h4>Model Discovery</h4>
@ -164,10 +178,12 @@ speech.ai.unturf.com {
<ul>
<li><a href="https://hermes.ai.unturf.com/v1/models" target="_blank">hermes.ai.unturf.com/v1/models</a> - Hermes models</li>
<li><a href="https://qwen.ai.unturf.com/v1/models" target="_blank">qwen.ai.unturf.com/v1/models</a> - Qwen models</li>
<li><a href="https://qwen-vl.ai.unturf.com/v1/models" target="_blank">qwen-vl.ai.unturf.com/v1/models</a> - Qwen VL (vision) models</li>
</ul>
<p>Or via curl:</p>
<pre><code class="language-bash">curl https://hermes.ai.unturf.com/v1/models
curl https://qwen.ai.unturf.com/v1/models
curl https://qwen-vl.ai.unturf.com/v1/models
</code></pre>
<p>Example response:</p>