3 Commits
Author SHA1 Message Date
hiyouga 207f8b069c support qwen2vl vllm infer 2024-12-05 10:17:26 +00:00
hiyouga eb3e147d19 fix scripts 2024-12-05 03:47:32 +00:00
hiyouga 1324d158f9 support batch infer in vllm 2024-12-04 13:50:00 +00:00