kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,664 Commits 1 Branch 0 Tags
3f24337a8a995b145b1e8075bc23878eaa363844
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hiyouga 3f24337a8a tiny fix 2024-06-11 01:04:16 +08:00
hiyouga 91e62a098f set dev version 2024-06-11 00:50:53 +08:00
hiyouga 2b6ebd6b51 release v0.8.1 2024-06-11 00:44:26 +08:00
hiyouga a793e8456b fix #4160 
The split heads should be concatenated in dim=2
 2024-06-11 00:37:17 +08:00
hiyouga 949e9908ad fix #4145 
Fix the docker image
 2024-06-11 00:19:17 +08:00
hiyouga 0012762b04 update evaluator 2024-06-10 23:56:00 +08:00
hiyouga c907d81667 fix #2666 2024-06-10 21:24:15 +08:00
hiyouga b61d25cd70 add pr ci 2024-06-08 21:25:35 +08:00
hiyouga 25c635ef28 Update tests.yml 2024-06-08 21:15:36 +08:00
hiyouga 4c4f950f39 update git workflows 2024-06-08 21:11:32 +08:00
hiyouga 972ec9c668 fix llamafactory-cli env 2024-06-08 07:15:45 +08:00
hiyouga 3ac11e77cc set dev version 2024-06-08 06:46:09 +08:00
hiyouga 5aa4ce4756 release v0.8.0 2024-06-08 05:20:54 +08:00
hiyouga 12d79f89c5 add ultrafeedback and fineweb #4085 #4132 2024-06-08 02:42:34 +08:00
hiyouga 42d9b26fc8 fix ci 2024-06-08 02:00:44 +08:00
hiyouga 7f20e4722a fix ci 2024-06-08 01:57:36 +08:00
hiyouga aa2578bea0 add ci 2024-06-08 01:48:30 +08:00
hiyouga 1c7f0ab519 init unittest 2024-06-08 01:35:58 +08:00
hiyouga 4b55f35662 Delete .readthedocs.yaml 2024-06-08 00:58:10 +08:00
hiyouga 54cd743ebf reorganize adapter code 2024-06-08 00:47:23 +08:00
hiyouga 06e5d136a4 add resume args in webui 2024-06-08 00:22:16 +08:00
hiyouga 8bf9da659c fix #4137 2024-06-07 19:16:06 +08:00
hiyouga cce0fad91c Update wechat.jpg 2024-06-07 19:04:16 +08:00
hiyouga f8d8690bf4 tiny fix 2024-06-07 05:19:21 +08:00
hiyouga 4489d73ac7 fix ppo trainer save zero3 model 
accelerator.get_state_dict(ds_model) should be called at all ranks
 2024-06-07 05:14:19 +08:00
hiyouga 2702d7e952 fix ppo in trl 0.8.6 2024-06-07 04:48:29 +08:00
hiyouga f9e818d79c fix #4120 2024-06-07 04:18:05 +08:00
hiyouga ccc8b64cc2 update data processors 2024-06-07 04:15:40 +08:00
hiyouga 8e95648850 add qwen2 models 2024-06-07 00:22:57 +08:00
hiyouga 74f96efef9 rename files 2024-06-07 00:09:06 +08:00
hiyouga 45d8be8f93 add DISABLE_TORCHRUN option 2024-06-06 23:44:58 +08:00
hiyouga 76c61905b2 fix ppo+zero3 #3108 2024-06-06 23:30:07 +08:00
hiyouga 451b6693c0 fix torch gc 2024-06-06 20:30:25 +08:00
hiyouga 149610c636 fix ppo dataset bug #4012 2024-06-06 19:03:20 +08:00
hiyouga fad2591e31 update trainers 2024-06-06 18:45:49 +08:00
hiyouga 67aa78cde0 fix base64 image read #4061 2024-06-06 17:29:19 +08:00
hiyouga 53eb2de75e update readme 2024-06-06 16:59:18 +08:00
hiyouga 87a7822b98 update readme 2024-06-06 16:25:42 +08:00
hiyouga cae4737907 lora modules: all by default 2024-06-06 03:53:28 +08:00
hiyouga c23cc63d3d add codestral 22B 2024-06-06 03:42:50 +08:00
hiyouga 7daf8366db lint 2024-06-06 03:33:44 +08:00
hiyouga 8fcc79e1e6 add vllm_dtype arg #3387 #3717 2024-06-06 02:53:27 +08:00
hiyouga a12a506c3d support train from scratch #4033 #4075 2024-06-06 02:43:19 +08:00
hiyouga 946f601136 support image input in api #3971 #4061 2024-06-06 02:29:55 +08:00
hiyouga dc4a00dd63 update train hparams 2024-06-06 01:49:20 +08:00
hiyouga 4dc0632145 fix setup 2024-06-06 01:39:02 +08:00
hiyouga d4908d5708 add llamafactory-cli env 2024-06-06 01:28:14 +08:00
hiyouga 67fe822324 fix #4090 2024-06-06 00:50:32 +08:00
hiyouga 83a005e3d4 fix #4079 2024-06-05 16:56:54 +08:00
hiyouga eef1e542a9 update readme 2024-06-05 16:32:32 +08:00
hiyouga f48f5e646e support glm-4 2024-06-05 15:16:38 +08:00
hiyouga 82a565362c update wechat 2024-06-04 15:52:56 +08:00
hiyouga 5a13b3baa6 tiny fix 2024-06-04 00:31:10 +08:00
hiyouga 91611d68c4 fix #3873 2024-06-04 00:21:50 +08:00
hiyouga a18acf2abe fix #3992 2024-06-04 00:17:36 +08:00
hiyouga 2187518762 fix abort in webui DDP mode 2024-06-04 00:10:24 +08:00
hiyouga 79784ebeb6 fix #4043 2024-06-03 23:30:37 +08:00
hiyouga f9a206509e remove gc warnings in DPO&KTO 2024-06-03 22:53:54 +08:00
hiyouga 88681d3357 update placeholder in issue template 2024-06-03 19:24:10 +08:00
hiyouga eed33862bc fix #4005 #4013 2024-06-03 19:12:29 +08:00
hiyouga 24e1c0e2ee fix #4022 2024-06-03 18:38:36 +08:00
hiyouga 876bc92865 bump versions 
transformers 4.37.2->4.41.2
datasets 2.14.3->2.16.0
accelerate 0.27.2->0.30.1
peft 0.10.0->0.11.1
trl 0.8.1->0.8.6
 2024-06-03 18:29:38 +08:00
hiyouga 49b1e88e3d fix data loader hint 2024-06-03 18:28:27 +08:00
hiyouga c4f50865ad update readme 2024-05-30 16:40:17 +08:00
hiyouga 3404e8f302 fix #3837 2024-05-30 00:52:26 +08:00
hiyouga 8070871732 better llamaboard 
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui
 2024-05-29 23:55:38 +08:00
hiyouga d0aa36b8ad fix cohere system 2024-05-29 20:58:23 +08:00
hiyouga 0930f58699 fix #3965 2024-05-29 20:55:51 +08:00
hiyouga 89ca832740 update readme 2024-05-29 18:39:11 +08:00
hiyouga 97346c1d3d fix hf chat engine 2024-05-29 01:20:07 +08:00
hiyouga e4b420c146 add ds config to webui 2024-05-29 01:13:17 +08:00
hiyouga 65cd8bdbdb 10x generate in ppo w/ zero3 
https://github.com/huggingface/trl/pull/1483
 2024-05-29 00:23:23 +08:00
hiyouga 7c8e01bb74 update dpo, kto trainer 2024-05-29 00:14:29 +08:00
hiyouga 900e1ea622 clean kto trainer 2024-05-28 21:43:26 +08:00
hiyouga 1e80a3a638 bump vllm version to 0.4.1 2024-05-28 21:27:27 +08:00
hiyouga 087b9faa39 update readme 2024-05-28 19:35:52 +08:00
hiyouga 7c016b22aa support DDP in webui 2024-05-28 19:24:22 +08:00
hiyouga c8765349ba update readme 2024-05-28 16:41:34 +08:00
hiyouga 99ee0dadd9 update readme 2024-05-28 16:19:56 +08:00
hiyouga 5d45adf47d fix #3931 2024-05-28 13:44:22 +08:00
hiyouga c1fdf81df6 tiny fix 2024-05-27 20:54:26 +08:00
hiyouga 08564838bd fix full/freeze tuning for mllm 2024-05-27 20:37:57 +08:00
hiyouga e626e26446 support Aya23 2024-05-27 20:23:24 +08:00
hiyouga 08bd0440b5 add llava 1k datasets 2024-05-27 19:57:33 +08:00
hiyouga 30e1c8e745 update dpo examples 2024-05-27 19:56:04 +08:00
hiyouga efa4b196ca add phi-3 7b/14b, mistral v0.3 models 2024-05-27 18:20:16 +08:00
hiyouga 5581cb2e4e update readme 2024-05-27 18:14:02 +08:00
hiyouga cb63b32986 support SimPO #3900 2024-05-26 23:46:33 +08:00
hiyouga 063f91cc80 fix #3853 2024-05-24 23:29:45 +08:00
hiyouga 3a023bca2a refactor data preprocessing, fix mllm rlhf 2024-05-24 04:08:25 +08:00
hiyouga de0e67aff1 fix paligemma sft 
requires transformers>=4.41.1
 2024-05-24 00:23:40 +08:00
hiyouga 67ebc7b388 fix oom issues in export 2024-05-23 23:32:45 +08:00
hiyouga 7134fb02bb fix paligemma sft 2024-05-21 20:03:09 +08:00
hiyouga 4d647ddba5 Update README_zh.md 2024-05-21 18:30:59 +08:00
hiyouga 2670f6fb3d update wechat 2024-05-21 18:22:32 +08:00
hiyouga 335501e228 fix #3847 2024-05-21 17:53:06 +08:00
hiyouga 789e73b0f4 Update wechat.jpg 2024-05-21 17:09:43 +08:00
hiyouga 2a67457e39 support paligemma 2024-05-21 00:01:22 +08:00
hiyouga e55c85ac72 fix paligemma data preprocess 2024-05-20 23:51:32 +08:00
hiyouga 542229abb3 fix paligemma inference 2024-05-20 23:36:43 +08:00