kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,912 Commits 1 Branch 0 Tags
5da54deb50d50385197a5aa9743e6695c066088a
Commit Graph
1316 Commits
Author SHA1 Message Date
hoshi-hiyougaandGitHub 5da54deb50 Merge pull request #4781 from hzhaoy/fix-dockerfile-cuda 
Fix cuda Dockerfile
 2024-07-13 22:25:32 +08:00
hiyouga 6b48308ef9 fix #4792 2024-07-13 22:07:58 +08:00
hzhaoy 8bab99c582 tiny fix 2024-07-12 00:28:44 +08:00
hoshi-hiyougaandGitHub 555194e150 Merge pull request #4700 from marko1616/patch-1 
Fix Windows command preview
 2024-07-10 13:51:50 +08:00
hoshi-hiyougaandGitHub 39cd89ce17 Update callbacks.py 2024-07-10 13:32:20 +08:00
-.- cff89a2e89 fix src/llamafactory/train/callbacks.py 2024-07-10 12:05:51 +08:00
hiyouga 51942acee8 fix #4731 2024-07-10 11:32:36 +08:00
hiyouga fb0c400116 fix ppo trainer 2024-07-10 11:05:45 +08:00
hiyouga 2f09520c0d fix #4742 2024-07-09 23:24:24 +08:00
hoshi-hiyougaandGitHub f84b007ebb Update packages.py 2024-07-07 15:48:29 +08:00
Lian Junhong 322663bf90 chore: Update vllm_engine.py to support vllm version >= 0.5.1 2024-07-07 15:08:12 +08:00
hiyouga a15782cb9f fix #4705 2024-07-07 13:10:06 +08:00
marko1616andGitHub e0562521bb Update utils.py 
In windows mutiline command should like
command --arg1 xxx `
--arg2 xxx `
 2024-07-06 20:40:13 +08:00
hiyouga 53b1002fb7 add codegeex4, internlm2.5 2024-07-06 16:16:47 +08:00
hiyouga 9f33f1edf5 fix processors 2024-07-05 08:33:22 +08:00
hiyouga e43809bced fix #4683 2024-07-05 00:58:05 +08:00
hiyouga ed232311e8 fix #4674 2024-07-05 00:41:03 +08:00
hiyouga 226a9e563f Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory 2024-07-04 14:23:37 +08:00
hiyouga 1e27e8c776 fix #4677 2024-07-04 14:22:07 +08:00
hzhaoy 738df47748 tiny fix 2024-07-04 10:20:28 +08:00
hiyouga 0c699de39d tiny fix 2024-07-04 03:47:05 +08:00
hiyouga 44747cebd2 tiny fix 2024-07-04 03:02:23 +08:00
hiyouga b5d101e1bf fix data map for packing 2024-07-04 03:01:31 +08:00
hiyouga 6fd6aa4530 fix packing for eager/sdpa attn 2024-07-04 01:52:43 +08:00
hoshi-hiyougaandGitHub 87d9b2d005 Merge pull request #4224 from chuan298/main 
Implement efficient packing without cross-contamination attention
 2024-07-04 01:18:54 +08:00
hiyouga cce7083024 update packing 2024-07-04 01:10:55 +08:00
hoshi-hiyougaandGitHub a36e8f2dd5 Update packing.py 2024-07-03 23:36:01 +08:00
hiyouga c346f79f99 update func name 2024-07-03 23:29:33 +08:00
hiyouga 8a6a7b9c8a update arg name 2024-07-03 23:23:24 +08:00
hiyouga 575a02a23d update hparams 2024-07-03 23:18:58 +08:00
hiyouga 7f770f6895 update ui 2024-07-03 23:13:49 +08:00
hiyouga 8845e94f91 fix #4609 
unwrap_model_for_generation(reward_model) is necessary for zero3 training
 2024-07-03 19:45:51 +08:00
hiyouga 8b1172b910 tiny fix 2024-07-03 02:31:50 +08:00
hiyouga 71cdf8956e tiny fix 2024-07-02 23:06:13 +08:00
hiyouga 821bb6660e remove rlhf support for chatglm2&3 2024-07-02 23:03:17 +08:00
hiyouga c13ae2df19 upcast logits 2024-07-02 22:32:05 +08:00
hiyouga c47ab6c072 improve rlhf 2024-07-02 22:23:08 +08:00
ancv e8e13b0942 move efficient_packing from data_args to model_args 2024-07-02 18:37:55 +07:00
hoshi-hiyougaandGitHub 4e4b3cc905 Merge pull request #4651 from hzhaoy/add-telechat-1b 
Add TeleChat-1B
 2024-07-02 17:56:43 +08:00
hzhaoy 57b7c00430 add TeleChat-1B 2024-07-02 17:49:04 +08:00
hiyouga 4c296001c4 fix ppo callbacks 2024-07-02 17:34:56 +08:00
hoshi-hiyougaandGitHub e8e6af2651 Merge branch 'main' into main 2024-07-01 21:01:09 +08:00
hiyouga 73280b7dc7 tiny fix 2024-07-01 05:43:17 +08:00
hiyouga 8c41a0aa6d tiny fix 2024-07-01 03:55:20 +08:00
hiyouga 1856a08e87 add eval acc 2024-07-01 03:51:20 +08:00
hiyouga 1771251ce3 fix #4402 #4617 
Deprecate reserved_label_len arg
 2024-07-01 01:19:27 +08:00
hiyouga d74244d568 fix #4398 #4592 2024-06-30 21:28:51 +08:00
hiyouga 2f4b89ace1 loose gemma2 attention 2024-06-29 01:42:14 +08:00
hiyouga 4d35e218b1 bf16 by default, gemma2 attns 
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674
 2024-06-28 06:00:26 +08:00
hiyouga 64f4337dac increase pissa_iter for stability 2024-06-28 03:18:54 +08:00