kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,592 Commits 1 Branch 0 Tags
f48f5e646e2da9e02333d027033141b0e75dfcf8
Commit Graph
1120 Commits
Author SHA1 Message Date
hiyouga f48f5e646e support glm-4 2024-06-05 15:16:38 +08:00
hiyouga 5a13b3baa6 tiny fix 2024-06-04 00:31:10 +08:00
hiyouga 91611d68c4 fix #3873 2024-06-04 00:21:50 +08:00
hiyouga a18acf2abe fix #3992 2024-06-04 00:17:36 +08:00
hiyouga 2187518762 fix abort in webui DDP mode 2024-06-04 00:10:24 +08:00
hoshi-hiyougaandGitHub ae18e1e251 Merge pull request #3987 from injet-zhou/main 
Fix cann't interrupt training when using multi GPUs in webui
 2024-06-04 00:04:07 +08:00
hiyouga 79784ebeb6 fix #4043 2024-06-03 23:30:37 +08:00
hiyouga f9a206509e remove gc warnings in DPO&KTO 2024-06-03 22:53:54 +08:00
hoshi-hiyougaandGitHub 24499f40dc Update trainer.py 2024-06-03 22:08:38 +08:00
enji.zhou 34a2c5087a fix KTO Trainer Sampler 2024-06-03 21:32:38 +08:00
hoshi-hiyougaandGitHub 0f01500b68 Merge pull request #4006 from Uminosachi/scheduler-kwargs 
Set scheduler_specific_kwargs to get_scheduler
 2024-06-03 19:27:53 +08:00
hiyouga eed33862bc fix #4005 #4013 2024-06-03 19:12:29 +08:00
hoshi-hiyougaandGitHub 1539c72b94 Merge pull request #4007 from xu-song/patch-3 
Update model_args.py
 2024-06-03 18:54:37 +08:00
hiyouga 24e1c0e2ee fix #4022 2024-06-03 18:38:36 +08:00
hiyouga 876bc92865 bump versions 
transformers 4.37.2->4.41.2
datasets 2.14.3->2.16.0
accelerate 0.27.2->0.30.1
peft 0.10.0->0.11.1
trl 0.8.1->0.8.6
 2024-06-03 18:29:38 +08:00
hiyouga 49b1e88e3d fix data loader hint 2024-06-03 18:28:27 +08:00
Xu SongandGitHub dade2f083d Update model_args.py 2024-05-31 14:35:48 +08:00
Uminosachi 14e97dc119 Set scheduler_specific_kwargs to get_scheduler 2024-05-31 13:45:39 +09:00
faddddeout b13d03946e fix cann't interrupt training when using multi GPUs in webui 2024-05-30 08:39:21 +00:00
hoshi-hiyougaandGitHub 483eb47e5d Merge pull request #3829 from seanzhang-zhichen/add_dataset_sample_num 
Add dataset sample num
 2024-05-30 00:25:45 +08:00
hoshi-hiyougaandGitHub ca5dd7c6c1 Update loader.py 2024-05-30 00:20:20 +08:00
hoshi-hiyougaandGitHub f9a88b89ca Update loader.py 2024-05-30 00:17:21 +08:00
hoshi-hiyougaandGitHub b55fb611c5 Update loader.py 2024-05-30 00:12:12 +08:00
hoshi-hiyougaandGitHub 51dd454337 Update parser.py 2024-05-30 00:05:20 +08:00
hiyouga 8070871732 better llamaboard 
* easily resume from checkpoint
* support full and freeze checkpoints
* faster ui
 2024-05-29 23:55:38 +08:00
hiyouga d0aa36b8ad fix cohere system 2024-05-29 20:58:23 +08:00
hiyouga 0930f58699 fix #3965 2024-05-29 20:55:51 +08:00
hiyouga 89ca832740 update readme 2024-05-29 18:39:11 +08:00
hzhaoy 0dd632fe9e add TeleChat-12B/TeleChat-12B-v2 models 2024-05-29 15:00:37 +08:00
hiyouga 97346c1d3d fix hf chat engine 2024-05-29 01:20:07 +08:00
hiyouga e4b420c146 add ds config to webui 2024-05-29 01:13:17 +08:00
hiyouga 65cd8bdbdb 10x generate in ppo w/ zero3 
https://github.com/huggingface/trl/pull/1483
 2024-05-29 00:23:23 +08:00
hiyouga 7c8e01bb74 update dpo, kto trainer 2024-05-29 00:14:29 +08:00
hiyouga 900e1ea622 clean kto trainer 2024-05-28 21:43:26 +08:00
hiyouga 1e80a3a638 bump vllm version to 0.4.1 2024-05-28 21:27:27 +08:00
hiyouga 087b9faa39 update readme 2024-05-28 19:35:52 +08:00
hiyouga 7c016b22aa support DDP in webui 2024-05-28 19:24:22 +08:00
Yimi81 dc07413e7d fix yi template 2024-05-27 13:11:25 +00:00
hiyouga c1fdf81df6 tiny fix 2024-05-27 20:54:26 +08:00
hoshi-hiyougaandGitHub 87ea0a8bcd Merge pull request #3921 from gusye1234/main 
Add openchat-3.6-8B support
 2024-05-27 20:52:37 +08:00
hoshi-hiyougaandGitHub f1002b9f93 Update template.py 2024-05-27 20:51:56 +08:00
hoshi-hiyougaandGitHub 122213a7a7 Update template.py 2024-05-27 20:51:26 +08:00
Jianbai Ye cff815391f add openchat-3.6-8B support 2024-05-27 20:42:08 +08:00
hiyouga 08564838bd fix full/freeze tuning for mllm 2024-05-27 20:37:57 +08:00
hoshi-hiyougaandGitHub 838f2fb3e4 Merge pull request #3835 from BUAADreamer/main 
fix some features in llava-style training
 2024-05-27 20:23:45 +08:00
hiyouga e626e26446 support Aya23 2024-05-27 20:23:24 +08:00
BUAADreamerandGitHub ea2afd429e Merge branch 'hiyouga:main' into main 2024-05-27 19:00:48 +08:00
BUAADreamer 57eb13b75d add regex of only tune lm and mm_proj 2024-05-27 18:59:00 +08:00
hiyouga efa4b196ca add phi-3 7b/14b, mistral v0.3 models 2024-05-27 18:20:16 +08:00
hiyouga 5581cb2e4e update readme 2024-05-27 18:14:02 +08:00