Commit Graph

11 Commits

Author SHA1 Message Date
Webifi c473d731ce Properly close websocket connections. 2023-07-28 18:10:45 -05:00
Webifi bb2a177f22 remove debug 2023-07-28 16:48:36 -05:00
Webifi 4c37969635 remove debug 2023-07-28 16:48:07 -05:00
Webifi 0f12fcdb95 Format LLama-2-chat prompts to spec. 2023-07-28 16:46:50 -05:00
Webifi 1ef08110c3 Add aggressive stop setting 2023-07-25 14:53:29 -05:00
Webifi 38d38bf948 Fix some issues with stop sequences and role sequences 2023-07-24 19:48:28 -05:00
Webifi ca19bab19d Don't allow too low of temp or top_p 2023-07-22 17:21:01 -05:00
Webifi 7aadca3c5c Better error handling for Petals 2023-07-22 17:08:40 -05:00
Webifi 15dcd27e8f Get temp and top_p working for Petals 2023-07-22 16:48:26 -05:00
Webifi 6d35a46d50 Allow user to adjust message chaining strings 2023-07-22 14:40:12 -05:00
Webifi 9a6004c55d More changes for Petals integration 2023-07-22 13:24:18 -05:00