4 Commits

Author SHA1 Message Date
Ozan Armağan
6e24c06e35
Add support for vLLM RAG (#1563)
* Add support for vLLM RAG

* Add `max_bytes` propety for conversation models

* Fix truncate conversation test

* Refactoring
2024-02-26 11:18:14 +05:30
ozanarmagan
f742417443 Make ``ConversationManager`` singleton & update conversation garbage collector thread 2023-12-01 23:44:36 +03:00
ozanarmagan
90f38987dd Use UUID for conversation ids 2023-11-03 00:47:40 +03:00
ozanarmagan
230308958b Add TTL for conversations 2023-09-16 18:39:06 +03:00