Commit Graph

4 Commits

Author SHA1 Message Date
hiyouga
d52fae2fa8 fix chat engines
do not use pop(key, default) since api assigns None to dict values
2024-05-20 00:36:43 +08:00
hoshi-hiyouga
a0e8d3d159 Update vllm_engine.py 2024-05-20 00:31:04 +08:00
juejuezi
b20d62ba3c feat: pass the max_lora_rank parameter to vLLM backend 2024-05-17 16:07:39 +08:00
hiyouga
308edbc426 rename package 2024-05-16 18:39:08 +08:00