4037872e7e
anthropic.claude-3-haiku-20240307-v1:0
...
modified: README.rst
modified: app.py
2024-03-15 10:12:58 -04:00
Russell Ballestrini
f365e45821
Claude 3 sonnet working properly now.
...
modified: README.rst
modified: app.py
2024-03-11 10:35:05 -04:00
Russell Ballestrini
e81a68c5d9
claude 3 sonnet
...
modified: app.py
2024-03-04 11:57:24 -05:00
Russell Ballestrini
36336234c5
claude-sonnet
...
modified: README.rst
modified: app.py
2024-03-04 11:11:41 -05:00
ad84d9a1ec
nvim refactors
...
modified: app.py
2024-03-04 08:36:58 -05:00
f4da537d88
mistral-large-latest is the actual model name.
...
modified: app.py
2024-03-02 11:05:11 -05:00
751dd80cc1
mistral-large
...
modified: README.rst
modified: app.py
2024-03-02 10:46:41 -05:00
Russell Ballestrini
0c856a17a4
clean up import
...
modified: app.py
2024-03-01 10:33:26 -05:00
Russell Ballestrini
23e844baf9
Added groq platform support for ultra fast LLM inference
...
modified: README.rst
modified: app.py
modified: requirements.txt
2024-02-28 10:32:31 -05:00
Russell Ballestrini
6cc066ecb4
upgrade to the newest gpt-4
...
modified: app.py
2024-01-26 08:21:42 -05:00
9418fe5673
black
2024-01-25 08:25:31 -05:00
1b605568b2
vllm support hacked in
...
modified: README.rst
modified: app.py
2024-01-25 08:12:01 -05:00
a72511be5d
messing with running vLLM open hermes
...
modified: app.py
2024-01-23 18:06:19 -05:00
0efbe93910
modified: app.py
2024-01-19 08:59:11 -05:00
f256d65391
modified: app.py
2024-01-13 11:06:41 -05:00
2f8a6c502d
hacked in ability to run local llama2 models like mistral
...
modified: app.py
new file: install-llama.sh
modified: requirements.txt
2024-01-13 10:05:02 -05:00
6a42dacf65
localhost openchat is working. lol
...
I replaced gpt-3.5-turbo workloads with openchat a local GPU powered inference server
The openchat inference server supports using the latest and official openai python client.
This means you can replace both standard and streaming workloads with an "offline" LLM.
modified: README.rst
modified: app.py
2024-01-07 14:57:40 -05:00
560d0a1ae5
small refactor
2024-01-06 11:34:53 -05:00
47d0b24fc4
add a link to the docs
...
modified: templates/chat.html
2024-01-06 08:37:46 -05:00
6f70dcfc42
allow cancel on all LLMs
...
modified: app.py
2024-01-06 08:12:54 -05:00
c40f961fc3
Update README.rst
2023-12-29 14:12:36 -05:00
Russell Ballestrini
d666efb162
implement together/solar
...
modified: README.rst
modified: app.py
2023-12-29 13:28:53 -05:00
79cc174b28
modified: app.py
2023-12-22 09:05:01 -05:00
Russell Ballestrini
12abd02978
modified: README.rst
2023-12-20 09:18:35 -05:00
Russell Ballestrini
e38c565eaa
add other mistralai models
...
modified: app.py
2023-12-20 09:17:12 -05:00
Russell Ballestrini
c95f2722e9
modified: README.rst
2023-12-20 08:11:54 -05:00
71f8d9d15c
make openchat a math assistant
...
modified: app.py
2023-12-20 06:30:54 -05:00
Russell Ballestrini
12f1abc4b7
together ai integration
...
modified: app.py
modified: requirements.txt
2023-12-19 12:55:13 -05:00
efbb6d7c26
Update README.rst
2023-12-16 11:40:00 -05:00
5918295320
Update README.rst
2023-12-16 11:38:54 -05:00
65e904b286
don't duplicate previous messages if they already exist (reconnects)
...
modified: templates/chat.html
2023-12-16 08:25:01 -05:00
9c3bbe169f
don't scroll when users join.
...
modified: templates/chat.html
2023-12-15 10:33:56 -05:00
2b7999a857
fix claude
...
modified: app.py
2023-12-15 10:00:20 -05:00
Russell Ballestrini
6c0a09e0c2
modified: README.rst
2023-12-14 14:21:08 -05:00
Russell Ballestrini
d42234f407
mistralai api support
...
modified: app.py
modified: requirements.txt
2023-12-14 13:42:16 -05:00
Russell Ballestrini
caa4cd234f
consolidate around data.content instead of message
...
modified: app.py
modified: templates/chat.html
2023-12-12 13:52:05 -05:00
Russell Ballestrini
b778c7e53c
modified: templates/chat.html
2023-12-12 12:14:13 -05:00
Russell Ballestrini
31a2f306e1
allow edits of streamed message chunks
...
modified: templates/chat.html
2023-12-12 11:28:46 -05:00
Russell Ballestrini
bc378ce0dd
Edit button, with save and cancel.
...
modified: app.py
modified: templates/chat.html
2023-12-12 10:28:05 -05:00
Russell Ballestrini
434db03ab0
show less for large blocks
2023-12-11 13:30:18 -05:00
7d6fe1b27b
fix dall-e-3 don't try to run marked on base64 images.
...
modified: app.py
modified: templates/chat.html
2023-12-10 10:50:30 -05:00
Russell Ballestrini
8a626501b3
install-ubuntu.sh use a separate application user instead of root
...
fix memory leak where were didn't clean up cancellation_requests
modified: app.py
modified: install-ubuntu.sh
2023-12-08 12:14:53 -05:00
Russell Ballestrini
0b1a09c6f1
remove sudo assume running as root.
...
modified: install-ubuntu.sh
2023-12-08 07:06:13 -05:00
Russell Ballestrini
dfbdbe9b0e
sqlite3 for ubuntu deploys
2023-12-08 06:55:29 -05:00
Russell Ballestrini
c2aaac9768
make count_tokens public on Message
...
modified: app.py
modified: migrations/versions/190d5ef26e20_add_token_count_to_message.py
2023-12-07 13:01:42 -05:00
Russell Ballestrini
caf4c76ceb
deleted: migrate.py
2023-12-07 10:13:49 -05:00
43317fb1a6
modified: app.py
...
new file: migrate.py
modified: requirements.txt
2023-12-07 10:09:57 -05:00
06a0867161
token count to message object
...
modified: app.py
new file: migrations/versions/190d5ef26e20_add_token_count_to_message.py
2023-12-07 09:33:35 -05:00
Russell Ballestrini
243bd4084f
modified: .gitignore
2023-12-06 12:48:56 -05:00
Russell Ballestrini
7369b6c25f
reorder
...
modified: app.py
2023-12-06 12:16:35 -05:00
