kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,566 Commits 1 Branch 0 Tags
3404e8f302d0b0308825fccedec82d8781b8c39e
Commit Graph
59 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hiyouga 3404e8f302 fix #3837 2024-05-30 00:52:26 +08:00
hiyouga 8070871732 better llamaboard 
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui
 2024-05-29 23:55:38 +08:00
hiyouga d0aa36b8ad fix cohere system 2024-05-29 20:58:23 +08:00
hiyouga 0930f58699 fix #3965 2024-05-29 20:55:51 +08:00
hiyouga 89ca832740 update readme 2024-05-29 18:39:11 +08:00
hiyouga 97346c1d3d fix hf chat engine 2024-05-29 01:20:07 +08:00
hiyouga e4b420c146 add ds config to webui 2024-05-29 01:13:17 +08:00
hiyouga 65cd8bdbdb 10x generate in ppo w/ zero3 
https://github.com/huggingface/trl/pull/1483
 2024-05-29 00:23:23 +08:00
hiyouga 7c8e01bb74 update dpo, kto trainer 2024-05-29 00:14:29 +08:00
hiyouga 900e1ea622 clean kto trainer 2024-05-28 21:43:26 +08:00
hiyouga 1e80a3a638 bump vllm version to 0.4.1 2024-05-28 21:27:27 +08:00
hiyouga 087b9faa39 update readme 2024-05-28 19:35:52 +08:00
hiyouga 7c016b22aa support DDP in webui 2024-05-28 19:24:22 +08:00
hiyouga c8765349ba update readme 2024-05-28 16:41:34 +08:00
hiyouga 99ee0dadd9 update readme 2024-05-28 16:19:56 +08:00
hiyouga 5d45adf47d fix #3931 2024-05-28 13:44:22 +08:00
hiyouga c1fdf81df6 tiny fix 2024-05-27 20:54:26 +08:00
hiyouga 08564838bd fix full/freeze tuning for mllm 2024-05-27 20:37:57 +08:00
hiyouga e626e26446 support Aya23 2024-05-27 20:23:24 +08:00
hiyouga 08bd0440b5 add llava 1k datasets 2024-05-27 19:57:33 +08:00
hiyouga 30e1c8e745 update dpo examples 2024-05-27 19:56:04 +08:00
hiyouga efa4b196ca add phi-3 7b/14b, mistral v0.3 models 2024-05-27 18:20:16 +08:00
hiyouga 5581cb2e4e update readme 2024-05-27 18:14:02 +08:00
hiyouga cb63b32986 support SimPO #3900 2024-05-26 23:46:33 +08:00
hiyouga 063f91cc80 fix #3853 2024-05-24 23:29:45 +08:00
hiyouga 3a023bca2a refactor data preprocessing, fix mllm rlhf 2024-05-24 04:08:25 +08:00
hiyouga de0e67aff1 fix paligemma sft 
requires transformers>=4.41.1
 2024-05-24 00:23:40 +08:00
hiyouga 67ebc7b388 fix oom issues in export 2024-05-23 23:32:45 +08:00
hiyouga 7134fb02bb fix paligemma sft 2024-05-21 20:03:09 +08:00
hiyouga 4d647ddba5 Update README_zh.md 2024-05-21 18:30:59 +08:00
hiyouga 2670f6fb3d update wechat 2024-05-21 18:22:32 +08:00
hiyouga 335501e228 fix #3847 2024-05-21 17:53:06 +08:00
hiyouga 789e73b0f4 Update wechat.jpg 2024-05-21 17:09:43 +08:00
hiyouga 2a67457e39 support paligemma 2024-05-21 00:01:22 +08:00
hiyouga e55c85ac72 fix paligemma data preprocess 2024-05-20 23:51:32 +08:00
hiyouga 542229abb3 fix paligemma inference 2024-05-20 23:36:43 +08:00
hiyouga 7262679666 fix #3818 2024-05-20 21:43:19 +08:00
hiyouga 9b0f4d7602 add kto to webui 2024-05-20 21:20:25 +08:00
hiyouga d52fae2fa8 fix chat engines 
do not use pop(key, default) since api assigns None to dict values
 2024-05-20 00:36:43 +08:00
hiyouga 10573e1639 fix jinja template 2024-05-19 23:38:30 +08:00
hiyouga 31a0564d4f fix zero2 high ram usage 2024-05-19 21:53:54 +08:00
hiyouga 70214b71b1 fix hf gen args 2024-05-19 19:39:32 +08:00
hiyouga 8ee8ac6eba fix envs 2024-05-19 18:27:18 +08:00
hiyouga 1ebc890a5f fix #3807 2024-05-19 17:07:57 +08:00
hiyouga 2bec28e328 update readme 2024-05-18 23:09:03 +08:00
hiyouga 3c2a992caa safe output path in webui 2024-05-18 22:42:28 +08:00
hiyouga d43822fcc2 fix jetmoe z3 block 2024-05-18 22:28:45 +08:00
hiyouga a851056229 improve data process logger 2024-05-18 22:02:42 +08:00
hiyouga ca48f90f1e update data readme 2024-05-18 21:37:38 +08:00
hiyouga 18cbf8561d update data readme 2024-05-18 21:15:20 +08:00
hiyouga 0edc16769f fix #3803 2024-05-18 16:13:14 +08:00
hiyouga c450ee87a3 improve KTO impl., replace datasets 2024-05-18 03:44:56 +08:00
hiyouga 8af9817605 add deepseek v2 lite model 2024-05-17 13:25:36 +08:00
hiyouga 84415492bf Update wechat.jpg 2024-05-17 12:18:03 +08:00
hiyouga e5bba7cf1b update badam example #3764 2024-05-17 02:21:10 +08:00
hiyouga d9f190ff1e better dtype handle in loading 2024-05-17 02:14:56 +08:00
hiyouga ddec9e1b84 update examples 2024-05-17 01:02:00 +08:00
hiyouga 694a05fd04 enable inbrowser in webui 2024-05-17 00:08:56 +08:00
hiyouga d77bed4091 add falcon 11b 2024-05-17 00:08:33 +08:00