kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
a86ae1724114fe9634d8a80f9cccdc948f7766e4
llm_trainer/examples/merge_lora
History
hiyouga d07ad5cc1c support vllm
2024-03-07 20:26:31 +08:00
..
merge.sh
support vllm
2024-03-07 20:26:31 +08:00
quantize.sh
support vllm
2024-03-07 20:26:31 +08:00
README.md
support vllm
2024-03-07 20:26:31 +08:00

README.md

Usage:

  • merge.sh: merge the lora weights
  • quantize.sh: quantize the model with AutoGPTQ (must after merge.sh, optional)
Reference in New Issue View Git Blame Copy Permalink