a11df86f6c
cut over from eventlet to gevent. use monkey patching
...
modified: app.py
modified: requirements.txt
2024-04-20 13:40:26 -04:00
4037872e7e
anthropic.claude-3-haiku-20240307-v1:0
...
modified: README.rst
modified: app.py
2024-03-15 10:12:58 -04:00
Russell Ballestrini
f365e45821
Claude 3 sonnet working properly now.
...
modified: README.rst
modified: app.py
2024-03-11 10:35:05 -04:00
Russell Ballestrini
e81a68c5d9
claude 3 sonnet
...
modified: app.py
2024-03-04 11:57:24 -05:00
Russell Ballestrini
36336234c5
claude-sonnet
...
modified: README.rst
modified: app.py
2024-03-04 11:11:41 -05:00
ad84d9a1ec
nvim refactors
...
modified: app.py
2024-03-04 08:36:58 -05:00
f4da537d88
mistral-large-latest is the actual model name.
...
modified: app.py
2024-03-02 11:05:11 -05:00
751dd80cc1
mistral-large
...
modified: README.rst
modified: app.py
2024-03-02 10:46:41 -05:00
Russell Ballestrini
0c856a17a4
clean up import
...
modified: app.py
2024-03-01 10:33:26 -05:00
Russell Ballestrini
23e844baf9
Added groq platform support for ultra fast LLM inference
...
modified: README.rst
modified: app.py
modified: requirements.txt
2024-02-28 10:32:31 -05:00
Russell Ballestrini
6cc066ecb4
upgrade to the newest gpt-4
...
modified: app.py
2024-01-26 08:21:42 -05:00
9418fe5673
black
2024-01-25 08:25:31 -05:00
1b605568b2
vllm support hacked in
...
modified: README.rst
modified: app.py
2024-01-25 08:12:01 -05:00
a72511be5d
messing with running vLLM open hermes
...
modified: app.py
2024-01-23 18:06:19 -05:00
0efbe93910
modified: app.py
2024-01-19 08:59:11 -05:00
f256d65391
modified: app.py
2024-01-13 11:06:41 -05:00
2f8a6c502d
hacked in ability to run local llama2 models like mistral
...
modified: app.py
new file: install-llama.sh
modified: requirements.txt
2024-01-13 10:05:02 -05:00
6a42dacf65
localhost openchat is working. lol
...
I replaced gpt-3.5-turbo workloads with openchat a local GPU powered inference server
The openchat inference server supports using the latest and official openai python client.
This means you can replace both standard and streaming workloads with an "offline" LLM.
modified: README.rst
modified: app.py
2024-01-07 14:57:40 -05:00
560d0a1ae5
small refactor
2024-01-06 11:34:53 -05:00
6f70dcfc42
allow cancel on all LLMs
...
modified: app.py
2024-01-06 08:12:54 -05:00
Russell Ballestrini
d666efb162
implement together/solar
...
modified: README.rst
modified: app.py
2023-12-29 13:28:53 -05:00
79cc174b28
modified: app.py
2023-12-22 09:05:01 -05:00
Russell Ballestrini
e38c565eaa
add other mistralai models
...
modified: app.py
2023-12-20 09:17:12 -05:00
71f8d9d15c
make openchat a math assistant
...
modified: app.py
2023-12-20 06:30:54 -05:00
Russell Ballestrini
12f1abc4b7
together ai integration
...
modified: app.py
modified: requirements.txt
2023-12-19 12:55:13 -05:00
2b7999a857
fix claude
...
modified: app.py
2023-12-15 10:00:20 -05:00
Russell Ballestrini
d42234f407
mistralai api support
...
modified: app.py
modified: requirements.txt
2023-12-14 13:42:16 -05:00
Russell Ballestrini
caa4cd234f
consolidate around data.content instead of message
...
modified: app.py
modified: templates/chat.html
2023-12-12 13:52:05 -05:00
Russell Ballestrini
bc378ce0dd
Edit button, with save and cancel.
...
modified: app.py
modified: templates/chat.html
2023-12-12 10:28:05 -05:00
7d6fe1b27b
fix dall-e-3 don't try to run marked on base64 images.
...
modified: app.py
modified: templates/chat.html
2023-12-10 10:50:30 -05:00
Russell Ballestrini
8a626501b3
install-ubuntu.sh use a separate application user instead of root
...
fix memory leak where were didn't clean up cancellation_requests
modified: app.py
modified: install-ubuntu.sh
2023-12-08 12:14:53 -05:00
Russell Ballestrini
c2aaac9768
make count_tokens public on Message
...
modified: app.py
modified: migrations/versions/190d5ef26e20_add_token_count_to_message.py
2023-12-07 13:01:42 -05:00
43317fb1a6
modified: app.py
...
new file: migrate.py
modified: requirements.txt
2023-12-07 10:09:57 -05:00
06a0867161
token count to message object
...
modified: app.py
new file: migrations/versions/190d5ef26e20_add_token_count_to_message.py
2023-12-07 09:33:35 -05:00
Russell Ballestrini
7369b6c25f
reorder
...
modified: app.py
2023-12-06 12:16:35 -05:00
Russell Ballestrini
30e5442fed
better error logging when completions fail
...
modified: app.py
2023-12-06 12:06:16 -05:00
f41e9e5bd9
dall-e-3
...
modified: README.rst
modified: app.py
new file: flask-socketio-llm-completions-2.png
2023-12-04 08:39:13 -05:00
d5db3b274b
dall-e-3 support
...
modified: app.py
2023-12-04 08:19:45 -05:00
34a1381f1c
black
2023-12-03 15:39:27 -05:00
ae2e39beac
/s3 ls * command
...
modified: README.rst
modified: app.py
2023-12-03 15:34:22 -05:00
8beacd5ac8
new /cancel command to stop generation in the middle of streaming to
...
chat
modified: README.rst
modified: app.py
2023-12-03 12:47:46 -05:00
1f67f264fa
/title new for generating new room titles
...
modified: app.py
modified: templates/chat.html
2023-12-03 08:52:01 -05:00
27dc7918f3
refactor
...
modified: app.py
2023-12-03 08:14:41 -05:00
005218671b
save mst recent code block to s3
...
modified: app.py
2023-12-02 20:53:52 -05:00
7cab44653a
modified: app.py
...
modified: templates/chat.html
2023-12-02 17:55:30 -05:00
e00e4315d4
Not working
...
modified: app.py
2023-12-02 16:55:35 -05:00
bef9252530
modified: app.py
2023-12-02 14:20:35 -05:00
7f9432ea9f
upgrade openai chunked streaming
...
new file: .dockerignore
modified: .gitignore
modified: app.py
new file: docker-compose.yml
2023-12-02 13:46:50 -05:00
25efdb0720
modified: app.py
2023-11-14 07:25:10 -05:00
d90de32eaf
modified: app.py
2023-11-12 09:59:54 -05:00
