kyy/llm_trainer
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

support batch infer in vllm

Browse Source
This commit is contained in:
hiyouga committed 2024-12-04 13:50:00 +00:00
1 parent dc78355002
commit 1324d158f9
29 files changed
+148 -407
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

.gitignore
+1
View File
@@ -171,3 +171,4 @@ config/
saves/
output/
wandb/
generated_predictions.jsonl