0efbe93910
modified: app.py
2024-01-19 08:59:11 -05:00
f256d65391
modified: app.py
2024-01-13 11:06:41 -05:00
2f8a6c502d
hacked in ability to run local llama2 models like mistral
...
modified: app.py
new file: install-llama.sh
modified: requirements.txt
2024-01-13 10:05:02 -05:00
6a42dacf65
localhost openchat is working. lol
...
I replaced gpt-3.5-turbo workloads with openchat a local GPU powered inference server
The openchat inference server supports using the latest and official openai python client.
This means you can replace both standard and streaming workloads with an "offline" LLM.
modified: README.rst
modified: app.py
2024-01-07 14:57:40 -05:00
560d0a1ae5
small refactor
2024-01-06 11:34:53 -05:00
6f70dcfc42
allow cancel on all LLMs
...
modified: app.py
2024-01-06 08:12:54 -05:00
Russell Ballestrini
d666efb162
implement together/solar
...
modified: README.rst
modified: app.py
2023-12-29 13:28:53 -05:00
79cc174b28
modified: app.py
2023-12-22 09:05:01 -05:00
Russell Ballestrini
e38c565eaa
add other mistralai models
...
modified: app.py
2023-12-20 09:17:12 -05:00
71f8d9d15c
make openchat a math assistant
...
modified: app.py
2023-12-20 06:30:54 -05:00
Russell Ballestrini
12f1abc4b7
together ai integration
...
modified: app.py
modified: requirements.txt
2023-12-19 12:55:13 -05:00
2b7999a857
fix claude
...
modified: app.py
2023-12-15 10:00:20 -05:00
Russell Ballestrini
d42234f407
mistralai api support
...
modified: app.py
modified: requirements.txt
2023-12-14 13:42:16 -05:00
Russell Ballestrini
caa4cd234f
consolidate around data.content instead of message
...
modified: app.py
modified: templates/chat.html
2023-12-12 13:52:05 -05:00
Russell Ballestrini
bc378ce0dd
Edit button, with save and cancel.
...
modified: app.py
modified: templates/chat.html
2023-12-12 10:28:05 -05:00
7d6fe1b27b
fix dall-e-3 don't try to run marked on base64 images.
...
modified: app.py
modified: templates/chat.html
2023-12-10 10:50:30 -05:00
Russell Ballestrini
8a626501b3
install-ubuntu.sh use a separate application user instead of root
...
fix memory leak where were didn't clean up cancellation_requests
modified: app.py
modified: install-ubuntu.sh
2023-12-08 12:14:53 -05:00
Russell Ballestrini
c2aaac9768
make count_tokens public on Message
...
modified: app.py
modified: migrations/versions/190d5ef26e20_add_token_count_to_message.py
2023-12-07 13:01:42 -05:00
43317fb1a6
modified: app.py
...
new file: migrate.py
modified: requirements.txt
2023-12-07 10:09:57 -05:00
06a0867161
token count to message object
...
modified: app.py
new file: migrations/versions/190d5ef26e20_add_token_count_to_message.py
2023-12-07 09:33:35 -05:00
Russell Ballestrini
7369b6c25f
reorder
...
modified: app.py
2023-12-06 12:16:35 -05:00
Russell Ballestrini
30e5442fed
better error logging when completions fail
...
modified: app.py
2023-12-06 12:06:16 -05:00
f41e9e5bd9
dall-e-3
...
modified: README.rst
modified: app.py
new file: flask-socketio-llm-completions-2.png
2023-12-04 08:39:13 -05:00
d5db3b274b
dall-e-3 support
...
modified: app.py
2023-12-04 08:19:45 -05:00
34a1381f1c
black
2023-12-03 15:39:27 -05:00
ae2e39beac
/s3 ls * command
...
modified: README.rst
modified: app.py
2023-12-03 15:34:22 -05:00
8beacd5ac8
new /cancel command to stop generation in the middle of streaming to
...
chat
modified: README.rst
modified: app.py
2023-12-03 12:47:46 -05:00
1f67f264fa
/title new for generating new room titles
...
modified: app.py
modified: templates/chat.html
2023-12-03 08:52:01 -05:00
27dc7918f3
refactor
...
modified: app.py
2023-12-03 08:14:41 -05:00
005218671b
save mst recent code block to s3
...
modified: app.py
2023-12-02 20:53:52 -05:00
7cab44653a
modified: app.py
...
modified: templates/chat.html
2023-12-02 17:55:30 -05:00
e00e4315d4
Not working
...
modified: app.py
2023-12-02 16:55:35 -05:00
bef9252530
modified: app.py
2023-12-02 14:20:35 -05:00
7f9432ea9f
upgrade openai chunked streaming
...
new file: .dockerignore
modified: .gitignore
modified: app.py
new file: docker-compose.yml
2023-12-02 13:46:50 -05:00
25efdb0720
modified: app.py
2023-11-14 07:25:10 -05:00
d90de32eaf
modified: app.py
2023-11-12 09:59:54 -05:00
844bddfd18
black
2023-11-11 09:03:33 -05:00
7e687c6b41
rename data["room"] to data["room_name"]
...
modified: app.py
modified: templates/chat.html
2023-11-11 08:39:02 -05:00
f93c9e4abd
room listing
...
modified: app.py
modified: templates/chat.html
2023-11-10 16:32:30 -05:00
1200404ce3
make titles on load
...
modified: app.py
2023-11-10 15:18:32 -05:00
03b11ff4c4
modified: app.py
2023-11-10 15:02:02 -05:00
6e3f1f7a60
gpt-4 title creation
...
modified: app.py
modified: templates/chat.html
2023-11-10 13:24:55 -05:00
2639a2f99c
room table so we can dedupe the name and title
...
modified: app.py
new file: migrations/README
new file: migrations/alembic.ini
new file: migrations/env.py
new file: migrations/script.py.mako
new file: migrations/versions/a9e886c56482_create_room_table.py
2023-11-10 12:05:30 -05:00
4e893dc4d2
remove old imports
2023-11-07 14:37:15 -05:00
4b4744551d
implement dompurify instead of bleach
...
modified: app.py
modified: requirements.txt
modified: templates/chat.html
2023-11-07 12:31:50 -05:00
0ad8589122
allow images
...
modified: app.py
2023-11-04 09:47:37 -04:00
f4a5e657fc
use bleach to clean messages
...
modified: app.py
modified: requirements.txt
2023-11-04 09:13:08 -04:00
51462ea414
claude-v1 support
...
modified: app.py
2023-11-03 18:15:47 -04:00
d7f720997f
modified: app.py
2023-11-02 08:21:59 -04:00
14d98018e1
modified: app.py
2023-11-02 08:09:01 -04:00
