Commit graph

30 commits

Author SHA1 Message Date
Russell Ballestrini
b0fa97ffc3 gpt-4o-2024-08-06 is the cheapest version of gpt-4 yet!
modified:   README.rst
	modified:   app.py
2024-08-07 18:59:18 -04:00
257e5a6a04 /activity metadata
modified:   README.rst
	modified:   app.py
	modified:   research/activity16.yaml
2024-08-02 18:49:50 -04:00
2fc774d85c /activity cancel
modified:   README.rst
	modified:   app.py
2024-07-28 13:59:25 -04:00
0462de7368 Activity Mode documented 2024-07-28 13:13:57 -04:00
Russell Ballestrini
698455fb40 gpt-4o-mini as gpt-mini alias
modified:   README.rst
	modified:   app.py
2024-07-18 17:12:05 -04:00
Russell Ballestrini
da5a8cbcfa gpt-4o for titles and add claude-opus
modified:   README.rst
	modified:   app.py
2024-07-08 17:33:12 -04:00
d882a14a8c update to hermes 2 llama 3 8B
modified:   README.rst
	modified:   app.py
2024-05-08 17:35:37 -04:00
dbcdad6838 Additional groq models
modified:   README.rst
	modified:   app.py
2024-04-21 09:46:35 -04:00
4037872e7e anthropic.claude-3-haiku-20240307-v1:0
modified:   README.rst
	modified:   app.py
2024-03-15 10:12:58 -04:00
Russell Ballestrini
f365e45821 Claude 3 sonnet working properly now.
modified:   README.rst
	modified:   app.py
2024-03-11 10:35:05 -04:00
Russell Ballestrini
36336234c5 claude-sonnet
modified:   README.rst
	modified:   app.py
2024-03-04 11:11:41 -05:00
751dd80cc1 mistral-large
modified:   README.rst
	modified:   app.py
2024-03-02 10:46:41 -05:00
Russell Ballestrini
23e844baf9 Added groq platform support for ultra fast LLM inference
modified:   README.rst
	modified:   app.py
	modified:   requirements.txt
2024-02-28 10:32:31 -05:00
1b605568b2 vllm support hacked in
modified:   README.rst
	modified:   app.py
2024-01-25 08:12:01 -05:00
6a42dacf65 localhost openchat is working. lol
I replaced gpt-3.5-turbo workloads with openchat a local GPU powered inference server

The openchat inference server supports using the latest and official openai python client.

This means you can replace both standard and streaming workloads with an "offline" LLM.

	modified:   README.rst
	modified:   app.py
2024-01-07 14:57:40 -05:00
c40f961fc3
Update README.rst 2023-12-29 14:12:36 -05:00
Russell Ballestrini
d666efb162 implement together/solar
modified:   README.rst
	modified:   app.py
2023-12-29 13:28:53 -05:00
Russell Ballestrini
12abd02978 modified: README.rst 2023-12-20 09:18:35 -05:00
Russell Ballestrini
c95f2722e9 modified: README.rst 2023-12-20 08:11:54 -05:00
efbb6d7c26
Update README.rst 2023-12-16 11:40:00 -05:00
5918295320
Update README.rst 2023-12-16 11:38:54 -05:00
Russell Ballestrini
6c0a09e0c2 modified: README.rst 2023-12-14 14:21:08 -05:00
42b91a28da
Update README.rst 2023-12-05 18:30:46 -05:00
f41e9e5bd9 dall-e-3
modified:   README.rst
	modified:   app.py
	new file:   flask-socketio-llm-completions-2.png
2023-12-04 08:39:13 -05:00
ae2e39beac /s3 ls * command
modified:   README.rst
	modified:   app.py
2023-12-03 15:34:22 -05:00
8beacd5ac8 new /cancel command to stop generation in the middle of streaming to
chat
	modified:   README.rst
	modified:   app.py
2023-12-03 12:47:46 -05:00
7b2f34b934 modified: README.rst
new file:   flask-socketio-llm-completions.png
2023-12-03 11:40:11 -05:00
392e451746 modified: README.rst
new file:   init_db.py
2023-12-03 11:24:52 -05:00
849dc1978d
Update README.rst 2023-10-28 16:12:03 -04:00
Russell Ballestrini
d9cccdc06d new file: README.rst 2023-10-28 13:48:50 -04:00