engineering/opencompletion.com
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

free endpoints for open public domain ai

Browse source 
modified:   README.rst
This commit is contained in:
Russell Ballestrini 2025-01-25 14:40:14 -05:00
parent 0492d5b329
commit adc202125e
1 changed files with 8 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

8
README.rst
View file

@ -72,6 +72,8 @@ To set up the project, follow these steps:
Usage
-----
Set up optional environment variables for your AWS, OpenAI, MistralAI, or together.ai API keys::
export AWS_ACCESS_KEY_ID="your_access_key"
@ -86,6 +88,12 @@ Set up optional environment variables for your AWS, OpenAI, MistralAI, or togeth
export VLLM_API_KEY="not-needed"
export VLLM_ENDPOINT="http://localhost:18888/v1"
Here are some free endpoint for research only!::
export VLLM_ENDPOINT=https://hermes.ai.unturf.com/v1
export VLLM_ENDPOINT2=https://qwq.ai.unturf.com/v1
export VLLM_ENDPOINT3=https://r1.ai.unturf.com/v1
To start the application with socket.io run::
python app.py