kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
577 Commits 1 Branch 0 Tags
5021062493ed63ad1f6133cfb543e4e7f528d2cc
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hiyouga 5021062493 update ppo trainer 2023-11-20 21:39:15 +08:00
hoshi-hiyougaandGitHub 48211e3799 Merge pull request #1553 from hannlp/hans 
Change the default argument settings for PPO training
 2023-11-20 20:32:55 +08:00
hiyouga 2a36fd5064 fix value head model resuming 2023-11-20 19:01:37 +08:00
hiyouga 99a3f06377 fix #1567 2023-11-20 18:46:36 +08:00
hiyouga 00baaa990e better data streaming 2023-11-19 23:32:47 +08:00
hiyouga 211b2db5a8 fix model card network issue 2023-11-19 23:03:19 +08:00
hiyouga bfb9433165 fix Mistral template 
https://github.com/lm-sys/FastChat/pull/2547
 2023-11-19 16:29:30 +08:00
hiyouga 065bfaeed4 fix #1263 2023-11-19 16:05:18 +08:00
hiyouga 1740131d63 fix #1558 2023-11-19 14:15:47 +08:00
hiyouga ff6056405d fix evaluator and cached_file in 4.31.0 2023-11-18 19:39:23 +08:00
hiyouga a2019c8b61 update benchmark 2023-11-18 11:30:01 +08:00
hiyouga 90212280d6 update readme 2023-11-18 11:15:56 +08:00
hiyouga 329134f58c add benchmark 2023-11-18 11:09:52 +08:00
hiyouga 7b1aa6f63c update dataset 2023-11-17 23:19:12 +08:00
hiyouga ccb0f58e22 fix quantization 2023-11-17 22:21:29 +08:00
hiyouga 1bbc1be95e fix #1550 2023-11-17 17:23:13 +08:00
hiyouga 999bc0ed93 fix packages 2023-11-17 16:11:48 +08:00
hoshi-hiyougaandGitHub 7f9770b2c6 Merge #1544 from Outsider565/main, fix #1548 
Fix: Change rouge-chinese package name to rouge_chinese
 2023-11-17 16:09:42 +08:00
hiyouga ed9f7705ef fix chatglm template 2023-11-16 22:54:15 +08:00
hiyouga 438c374567 Update bug-report.yml 2023-11-16 19:37:35 +08:00
hiyouga 9e0bfcfc14 add issue template 2023-11-16 19:35:30 +08:00
hoshi-hiyougaandGitHub dea176f88e Update issue templates 2023-11-16 18:56:30 +08:00
hiyouga 10ce87e088 fix web ui demo 2023-11-16 18:41:55 +08:00
hiyouga 1c80e9a09e fix web ui demo 2023-11-16 17:12:23 +08:00
hiyouga c4facc03af release v0.3.0 2023-11-16 16:00:11 +08:00
hiyouga 72e6699547 update readme 2023-11-16 15:58:37 +08:00
hoshi-hiyougaandGitHub f04bc2a428 Merge #1525 from hiyouga/dev, fix #224 #336 #931 #936 #1011 
Refactor llmtuner, support full-parameter RLHF
 2023-11-16 15:47:13 +08:00
hiyouga 08f3c11429 fix css 2023-11-16 15:45:38 +08:00
hiyouga 6efa38be46 fix bug in web ui 2023-11-16 15:21:24 +08:00
hiyouga 7537dd434f update ppo and demo in webui 2023-11-16 14:55:26 +08:00
hiyouga ff52b1779c fix bug in freeze tuning 2023-11-16 14:25:11 +08:00
hiyouga 83cee2a604 tiny fix 2023-11-16 03:27:19 +08:00
hiyouga 1817ffc86f fix rlhf callback 2023-11-16 03:26:19 +08:00
hiyouga 856522a3df fix bug in PPO training 2023-11-16 02:32:54 +08:00
hiyouga 35b91ea34c fix import bug 2023-11-16 02:27:03 +08:00
hiyouga ce78303600 support full-parameter PPO 2023-11-16 02:08:04 +08:00
hiyouga 8350bcf85d add demo mode for web UI 2023-11-15 23:51:26 +08:00
hoshi-hiyougaandGitHub 01b9f63465 Create CODE_OF_CONDUCT.md 2023-11-15 20:42:15 +08:00
hiyouga 1e19cf242a update readme and constants 2023-11-15 18:04:37 +08:00
hiyouga 4907452d95 support multiple modules in freeze training #1514 2023-11-15 17:08:18 +08:00
hiyouga bbbce1f516 fix imports 2023-11-15 16:47:45 +08:00
hiyouga 4736344eb1 disentangle model from tuner and rename modules 2023-11-15 16:29:09 +08:00
hiyouga 2f02f688e1 fix #1507 2023-11-15 16:22:32 +08:00
hiyouga 829e879e04 Update cal_lr.py 2023-11-14 21:14:42 +08:00
hiyouga 5619e76dc5 Update cal_lr.py 2023-11-14 21:13:01 +08:00
hiyouga fcb2daf7f3 Update cal_lr.py 2023-11-14 21:09:30 +08:00
hiyouga 42c8fc4fb9 add cal_lr.py 2023-11-14 20:58:37 +08:00
hiyouga d125ef5535 fix #1494 2023-11-14 18:07:20 +08:00
hiyouga 3743b7420b fix #1489 2023-11-14 15:27:05 +08:00
hiyouga 2d42be32c1 support eval remote dataset 2023-11-14 02:42:30 +08:00
hiyouga 88ab33254e fix dc link 2023-11-13 23:22:56 +08:00
hiyouga 35cc1e28f6 release v0.2.2, fix #1478 #1466 2023-11-13 23:09:05 +08:00
hiyouga 87390ae3b7 fix #424 2023-11-13 22:42:23 +08:00
hiyouga 442aefb925 refactor evaluation, upgrade trl to 074 2023-11-13 22:20:35 +08:00
hiyouga 528d91192a Update wechat.jpg 2023-11-12 22:34:19 +08:00
hiyouga 4bd8e3906d fix flashattn warning 2023-11-10 18:34:54 +08:00
hiyouga a0c31c68c4 add todo 2023-11-10 14:38:18 +08:00
hiyouga 3697a3dc9a refactor constants 2023-11-10 14:16:10 +08:00
hiyouga 415bca900e tiny fix 2023-11-09 17:20:49 +08:00
hoshi-hiyougaandGitHub 462730cbd7 Merge pull request #1454 from yyq/main 
Update finetuning_args.py
 2023-11-09 17:12:18 +08:00
hiyouga 0e86527d7f fix #1452 2023-11-09 16:41:32 +08:00
hiyouga b3572659f5 update readme 2023-11-09 16:00:24 +08:00
hiyouga 1db59832fd release v0.2.1 2023-11-09 15:54:16 +08:00
hiyouga 386f590209 add template, modify datasets 2023-11-09 15:53:23 +08:00
hoshi-hiyougaandGitHub 7ca32d8e69 Merge pull request #1436 from lvzii/main 
fix tokenizer config changed after pretrain
 2023-11-09 14:30:50 +08:00
hiyouga 3df90b988b support parquet format #1446 2023-11-09 14:17:40 +08:00
hiyouga 33422e1fef fix #1438 #1439 2023-11-09 13:45:10 +08:00
hiyouga 01260d9754 fix ppo train and dpo eval 2023-11-07 22:48:51 +08:00
hiyouga 11c1e1e157 fix #1422 2023-11-07 19:42:01 +08:00
hiyouga c52336d144 fix reward model loading 2023-11-07 17:20:51 +08:00
hiyouga d92f112951 fix args 2023-11-07 16:36:06 +08:00
hiyouga 17c64a0579 update info 2023-11-07 16:28:21 +08:00
hiyouga 479d0af2dc delete file 2023-11-07 16:20:12 +08:00
hiyouga 7ebd63a609 fix #1418 2023-11-07 16:17:22 +08:00
hiyouga b2a60905f3 upgrade peft, fix #1088 #1411 2023-11-07 16:13:36 +08:00
hiyouga 66a91e1fe3 update requirements 2023-11-06 19:01:21 +08:00
hiyouga de95b69282 use seed in evaluate.py 2023-11-06 18:17:51 +08:00
hiyouga e1e04cb1f1 update readme (list in alphabetical order) 2023-11-06 17:18:12 +08:00
hiyouga a7eeb8e17c update templates 2023-11-06 12:25:47 +08:00
hiyouga 2e77a5718a fix #1383 2023-11-06 11:42:23 +08:00
hiyouga d08f5e8a14 fix deepseek template 2023-11-05 13:08:46 +08:00
hiyouga 2a8a258195 support deepseek coder #1378 2023-11-05 12:51:03 +08:00
hiyouga 63ff909310 fix #1365 2023-11-05 12:21:07 +08:00
hiyouga 5227e18c44 Update wechat.jpg 2023-11-05 10:25:59 +08:00
hiyouga 05d9fc7eff tiny fix 2023-11-03 01:26:06 +08:00
hiyouga eb9d9e104a fix #1290 2023-11-03 00:44:53 +08:00
hiyouga b355f6cac9 fix bug in data loader, support dpo eval 2023-11-03 00:34:26 +08:00
hiyouga 2b5e33c338 update data readme 2023-11-03 00:15:23 +08:00
hiyouga cc8ffa10d8 update data readme (zh) 2023-11-02 23:42:49 +08:00
hiyouga a837172413 support sharegpt format, add datasets 2023-11-02 23:10:04 +08:00
hiyouga c1edb0cf1b support pagination in webui preview 2023-11-02 21:21:45 +08:00
hiyouga 34d8b2e56c fix webui 2023-11-02 18:03:14 +08:00
hiyouga 9cde5e8af6 support warning in webui 2023-11-02 17:57:04 +08:00
hiyouga f8703aac08 fix #1349 2023-11-02 17:02:44 +08:00
hiyouga dff128c7e3 fix #1356 2023-11-02 16:51:52 +08:00
hiyouga 083787dbfe fix #1325 2023-11-01 23:38:49 +08:00
hiyouga 8b912690e3 fix chat 2023-11-01 23:07:58 +08:00
hiyouga 84af10cec9 update gradio, support multiple resp in api 2023-11-01 23:02:16 +08:00
hiyouga d8cf8cfdeb fix SFT trainer 2023-10-31 21:52:52 +08:00
hiyouga f4e4a04529 fix #1316 2023-10-31 11:32:08 +08:00