diff --git a/public/crawler.html b/public/crawler.html index c1b40e2..b713fbf 100644 --- a/public/crawler.html +++ b/public/crawler.html @@ -165,7 +165,7 @@ Disallow: /
If you have questions about our crawler or want to discuss our access to your site, please reach out:
At uncloseai., we offer free AI services powered by multiple AI models and a TTS (Text-to-Speech) endpoint. Our mission is to provide accessible AI tools for everyone, embodying the principles of both free as in beer & free as in freedom. You can interact with our models without any cost, and you are encouraged to contribute and build upon the open-source code & models that we use.
-Available Models:
+Available Endpoints:
https://hermes.ai.unturf.com/v1https://qwen.ai.unturf.com/v1See our Model Discovery docs to query the current model IDs being hosted.
+We intend to be a drop in replacement, you can use the existing open source OpenAI client to communicate with us.
📚 Purchase the uncloseai. book on unturf.com Shop →
Comprehensive reference guide covering inference clients, streaming implementations, and best practices for all 42 programming languages.
-All examples use the OpenAI-compatible API interface, making it easy to integrate with existing code. Simply change the base_url to point to our endpoints:
https://hermes.ai.unturf.com/v1https://qwen.ai.unturf.com/v1https://speech.ai.unturf.com/v1All examples use the OpenAI-compatible API interface, making it easy to integrate with existing code. Simply change the base_url to point to our endpoints. See our Model Discovery docs for endpoint URLs and how to query current model IDs.
Want to contribute idle GPU time or reproduce everything in your own cluster?
diff --git a/public/inference.html b/public/inference.html index 8146e97..f4e5312 100644 --- a/public/inference.html +++ b/public/inference.html @@ -152,9 +152,55 @@ speech.ai.unturf.com { } +vLLM provides an OpenAI-compatible API with built-in documentation. You can discover available models and explore the full API using these endpoints:
+ +Access the interactive API docs at the /docs endpoint:
The Swagger UI lets you explore all available endpoints, see request/response schemas, and test API calls directly in your browser.
+ +To get the current model ID being hosted, query the /v1/models endpoint:
Or via curl:
+curl https://hermes.ai.unturf.com/v1/models
+curl https://qwen.ai.unturf.com/v1/models
+
+
+ Example response:
+{
+ "object": "list",
+ "data": [
+ {
+ "id": "adamo1139/Hermes-3-Llama-3.1-8B-FP8-Dynamic",
+ "object": "model",
+ "created": 1735689600,
+ "owned_by": "vllm",
+ "root": "adamo1139/Hermes-3-Llama-3.1-8B-FP8-Dynamic",
+ "max_model_len": 82000
+ }
+ ]
+}
+
+
+ The id field contains the model name you should use in your API calls. The max_model_len field tells you the maximum context length supported.
Tip: Always query /v1/models programmatically rather than hardcoding model names. This ensures your code works even when models are updated or swapped.
Rate limiting is configured based on client IP address: 3 requests per second per IP per endpoint.
+Ready to add text-to-speech to your application?
+ +