Commit Graph

6 Commits

Author SHA1 Message Date
Tendo33
fd2e6dec58 1.Change the name of is_fastapi_available function
2. Added the log of printing requests when deploying using vllm
2024-05-09 14:28:01 +08:00
hiyouga
09f3ef1de4 fix stop param 2024-05-07 00:41:04 +08:00
zhaonx96
80645751bc ”add stop parameter in chat.py“ 2024-05-06 10:10:00 +08:00
hiyouga
e984ba3167 remove empty stream response 2024-05-04 16:13:52 +08:00
hiyouga
941924fdbd fix async stream api response 2024-05-04 16:11:18 +08:00
hiyouga
ed8f8be752 update api and support abort eval in webui 2024-05-04 15:59:15 +08:00