russellballestrini/russell.ballestrini.net
1
0
Fork 0
Code Issues Pull requests 1 Projects Releases Packages Wiki Activity Actions

Update 2025-02-19-free-llm-endpoints-dynamic-distributed-model-inference-client-uncloseai.rst

Browse source
This commit is contained in:
Russell Ballestrini 2025-02-28 18:11:50 +00:00
parent 00524a31f3
commit 3005683287
1 changed files with 10 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

17
content/2025-02-19-free-llm-endpoints-dynamic-distributed-model-inference-client-uncloseai.rst
View file

@ -20,21 +20,24 @@ Dynamic Model & Endpoint Discovery
------------------------------------
Instead of maintaining a static list of models—which can quickly become outdated—our service is designed for dynamic discovery. Each of our model server endpoints offers an API route that returns the current list of supported models. This means you can always retrieve the latest model roster directly from the source.
We encourage you to review the dynamic model querying approaches used by both `uncloseai.js` and `opencompletion.com <https://opencompletion.com`_ to see how they simplify integration & keep things current. Here’s where you can find the model lists for each endpoint:
We encourage you to review the dynamic model querying approaches used by both `uncloseai.js` and `opencompletion.com <https://opencompletion.com`_ to see how they simplify integration & keep things current.
Here’s where you can find the model lists for each endpoint:
- **Hermes Endpoint:**
`https://hermes.ai.unturf.com/v1 <https://hermes.ai.unturf.com/v1>`_
`https://hermes.ai.unturf.com/v1/models <https://hermes.ai.unturf.com/v1/models>`_
* `https://hermes.ai.unturf.com/v1 <https://hermes.ai.unturf.com/v1>`_
* `https://hermes.ai.unturf.com/v1/models <https://hermes.ai.unturf.com/v1/models>`_
- **Node2 Endpoint:**
`https://node2.naptha.ai/inference <https://node2.naptha.ai/inference>`_
`https://node2.naptha.ai/inference/models <https://node2.naptha.ai/inference/models>`_
* `https://node2.naptha.ai/inference <https://node2.naptha.ai/inference>`_
* `https://node2.naptha.ai/inference/models <https://node2.naptha.ai/inference/models>`_
- **Node3 Endpoint:**
`https://node2.naptha.ai/inference <https://node2.naptha.ai/inference>`_
`https://node3.naptha.ai/inference/models <https://node3.naptha.ai/inference/models>`_
* `https://node2.naptha.ai/inference <https://node2.naptha.ai/inference>`_
* `https://node3.naptha.ai/inference/models <https://node3.naptha.ai/inference/models>`_
By dynamically querying each endpoint for its supported models, you ensure your integration remains up to date without needing to hardcode model names.