From adc202125e6eaed152816e4fa0c1bdcdb202096f Mon Sep 17 00:00:00 2001 From: Russell Ballestrini Date: Sat, 25 Jan 2025 14:40:14 -0500 Subject: [PATCH] free endpoints for open public domain ai modified: README.rst --- README.rst | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/README.rst b/README.rst index a50355c..c24ec1b 100644 --- a/README.rst +++ b/README.rst @@ -72,6 +72,8 @@ To set up the project, follow these steps: Usage ----- + + Set up optional environment variables for your AWS, OpenAI, MistralAI, or together.ai API keys:: export AWS_ACCESS_KEY_ID="your_access_key" @@ -86,6 +88,12 @@ Set up optional environment variables for your AWS, OpenAI, MistralAI, or togeth export VLLM_API_KEY="not-needed" export VLLM_ENDPOINT="http://localhost:18888/v1" +Here are some free endpoint for research only!:: + + export VLLM_ENDPOINT=https://hermes.ai.unturf.com/v1 + export VLLM_ENDPOINT2=https://qwq.ai.unturf.com/v1 + export VLLM_ENDPOINT3=https://r1.ai.unturf.com/v1 + To start the application with socket.io run:: python app.py