kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,890 Commits 1 Branch 0 Tags
53b1002fb74123095e7466c75b941a31a7cfba4d
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hiyouga 53b1002fb7 add codegeex4, internlm2.5 2024-07-06 16:16:47 +08:00
hiyouga c9bb0757ec update pissa example 2024-07-06 15:47:32 +08:00
hiyouga 9f33f1edf5 fix processors 2024-07-05 08:33:22 +08:00
hiyouga e43809bced fix #4683 2024-07-05 00:58:05 +08:00
hiyouga ed232311e8 fix #4674 2024-07-05 00:41:03 +08:00
hiyouga 226a9e563f Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory 2024-07-04 14:23:37 +08:00
hiyouga 1e27e8c776 fix #4677 2024-07-04 14:22:07 +08:00
hiyouga 636bb9c1e6 update tests 2024-07-04 04:00:12 +08:00
hiyouga 0c699de39d tiny fix 2024-07-04 03:47:05 +08:00
hiyouga 44747cebd2 tiny fix 2024-07-04 03:02:23 +08:00
hiyouga b5d101e1bf fix data map for packing 2024-07-04 03:01:31 +08:00
hiyouga b03e4a74ba update wechat 2024-07-04 01:55:05 +08:00
hiyouga 6fd6aa4530 fix packing for eager/sdpa attn 2024-07-04 01:52:43 +08:00
hiyouga cce7083024 update packing 2024-07-04 01:10:55 +08:00
hiyouga c346f79f99 update func name 2024-07-03 23:29:33 +08:00
hiyouga 8a6a7b9c8a update arg name 2024-07-03 23:23:24 +08:00
hiyouga 575a02a23d update hparams 2024-07-03 23:18:58 +08:00
hiyouga 7f770f6895 update ui 2024-07-03 23:13:49 +08:00
hiyouga a4a1ddbcb9 test 2024-07-03 23:05:39 +08:00
hiyouga 1e0c860c8c update scripts 2024-07-03 20:07:44 +08:00
hiyouga 8845e94f91 fix #4609 
unwrap_model_for_generation(reward_model) is necessary for zero3 training
 2024-07-03 19:45:51 +08:00
hiyouga 87346c0946 update readme 2024-07-03 19:39:05 +08:00
hiyouga 8b1172b910 tiny fix 2024-07-03 02:31:50 +08:00
hiyouga 71cdf8956e tiny fix 2024-07-02 23:06:13 +08:00
hiyouga 821bb6660e remove rlhf support for chatglm2&3 2024-07-02 23:03:17 +08:00
hiyouga c13ae2df19 upcast logits 2024-07-02 22:32:05 +08:00
hiyouga c47ab6c072 improve rlhf 2024-07-02 22:23:08 +08:00
hiyouga 9dcff3a5b5 Update bug-report.yml 2024-07-02 19:18:56 +08:00
hiyouga c81687963a Update bug-report.yml 2024-07-02 19:16:12 +08:00
hiyouga 4c296001c4 fix ppo callbacks 2024-07-02 17:34:56 +08:00
hiyouga 33f2ddb8b6 Update wechat_npu.jpg 2024-07-01 16:28:54 +08:00
hiyouga 73280b7dc7 tiny fix 2024-07-01 05:43:17 +08:00
hiyouga 8c41a0aa6d tiny fix 2024-07-01 03:55:20 +08:00
hiyouga 1856a08e87 add eval acc 2024-07-01 03:51:20 +08:00
hiyouga fc2c15d713 Update label_issue.yml 2024-07-01 01:29:09 +08:00
hiyouga 1771251ce3 fix #4402 #4617 
Deprecate reserved_label_len arg
 2024-07-01 01:19:27 +08:00
hiyouga d4e2af1fa4 update readme 2024-07-01 00:22:52 +08:00
hiyouga d74244d568 fix #4398 #4592 2024-06-30 21:28:51 +08:00
hiyouga 93e6fbb37d update npu docker 2024-06-30 21:05:31 +08:00
hiyouga 2f4b89ace1 loose gemma2 attention 2024-06-29 01:42:14 +08:00
hiyouga 0e0d69b77c update readme 2024-06-28 06:55:19 +08:00
hiyouga 4d35e218b1 bf16 by default, gemma2 attns 
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674
 2024-06-28 06:00:26 +08:00
hiyouga 64f4337dac increase pissa_iter for stability 2024-06-28 03:18:54 +08:00
hiyouga e3141f5f1b fix docker flashattn 2024-06-28 01:28:59 +08:00
hiyouga 6f63050e1b add Gemma2 models 2024-06-28 01:26:50 +08:00
hiyouga 2f78b5d62a update examples 2024-06-28 01:17:07 +08:00
hiyouga 8baf3b22b0 refactor pissa, improve llamaboard 2024-06-28 01:04:24 +08:00
hiyouga 8ed6b367e2 fix #4549 2024-06-28 00:41:58 +08:00
hiyouga 0f421055da fix docker file 2024-06-27 20:29:16 +08:00
hiyouga e44a4f07f0 tiny fix 2024-06-27 20:14:48 +08:00
hiyouga 719e2f1fef Update wechat.jpg 2024-06-27 18:46:47 +08:00
hiyouga 96a5044394 add quant checks 2024-06-27 01:12:25 +08:00
hiyouga d417e63f92 update examples 2024-06-27 00:53:33 +08:00
hiyouga f17c9dfd84 tiny fix 2024-06-27 00:46:41 +08:00
hiyouga 29c710da3a tiny fix 2024-06-27 00:36:04 +08:00
hiyouga ad144c2265 support HQQ/EETQ #4113 2024-06-27 00:29:42 +08:00
hiyouga addca926de improve autogptq integration 2024-06-26 22:11:44 +08:00
hiyouga 8d6cd69ac4 fix #4458 2024-06-26 19:52:35 +08:00
hiyouga 59e0b4f616 fix #4556 2024-06-26 19:43:16 +08:00
hiyouga 50b44d3c6d fix #4456 2024-06-25 14:34:13 +08:00
hiyouga 555ca8d780 lint 2024-06-25 02:55:50 +08:00
hiyouga c244af0dc3 fix test case 2024-06-25 02:51:49 +08:00
hiyouga 1e9d0aa1e4 fix #4432 2024-06-25 02:34:04 +08:00
hiyouga cc016461e6 fix #4379 2024-06-25 02:31:44 +08:00
hiyouga 095fab58d3 tiny fix about badam 2024-06-25 01:54:53 +08:00
hiyouga efb81b25ec fix #4419 2024-06-25 01:51:29 +08:00
hiyouga 41086059b1 tiny fix 2024-06-25 01:15:19 +08:00
hiyouga fca893d73c fix #4410 2024-06-24 22:34:31 +08:00
hiyouga 4ea84a8333 update readme 2024-06-24 18:29:04 +08:00
hiyouga e507e60638 update readme 2024-06-24 18:22:12 +08:00
hiyouga db9a1912e3 remove dup template 2024-06-22 01:31:32 +08:00
hiyouga 3ce44dda99 fix api 2024-06-22 00:00:38 +08:00
hiyouga 8d4f5093cf tiny fix 2024-06-20 22:56:05 +08:00
hiyouga f22d8f9ca4 improve llamaboard 2024-06-19 23:46:03 +08:00
hiyouga 3f84411b5d fix llamaboard abort 2024-06-19 23:22:28 +08:00
hiyouga 3b040e8e0f update patcher 2024-06-19 21:27:00 +08:00
hiyouga 42e69a3c63 set dev version 2024-06-19 21:08:16 +08:00
hiyouga 87e330fee5 Update publish.yml 2024-06-19 20:46:33 +08:00
hiyouga 71327ba85a release v0.8.2 2024-06-19 20:42:09 +08:00
hiyouga 2b596fb55f fix jinja template 2024-06-19 20:03:50 +08:00
hiyouga 4cff6a4ad5 fix templates 2024-06-19 17:44:05 +08:00
hiyouga 6d2bf216ac fix bug 2024-06-19 03:49:23 +08:00
hiyouga 4f22eae8f4 use prefix to replace force system 2024-06-19 03:39:52 +08:00
hiyouga cd75b1fe9d fix tool formatter, allow parallel function #4362 2024-06-19 03:23:51 +08:00
hiyouga 9ab0401948 update data 2024-06-19 02:48:43 +08:00
hiyouga 344b9a36b2 tiny fix 2024-06-18 23:32:18 +08:00
hiyouga a233fbc258 add deepseek coder v2 #4346 2024-06-18 22:53:54 +08:00
hiyouga 4bd77d8563 fix #4357 2024-06-18 22:42:45 +08:00
hiyouga c96264bc47 fix #4335 2024-06-18 22:08:56 +08:00
hiyouga 24c160df3d lint 2024-06-17 22:35:56 +08:00
hiyouga 7857c0990b update chat engine #4335 2024-06-17 19:07:17 +08:00
hiyouga fcb2e8e7b7 update readme 2024-06-17 18:47:24 +08:00
hiyouga e2665e71c7 fix #4326 2024-06-17 18:17:48 +08:00
hiyouga 72471ee046 Update wechat.jpg 2024-06-17 17:49:03 +08:00
hiyouga 2bf2863a58 tiny fix 2024-06-17 17:47:25 +08:00
hiyouga 0a2ec5fe20 update pr template 2024-06-16 01:43:43 +08:00
hiyouga 46093b5786 fix tol 2024-06-16 01:38:44 +08:00
hiyouga 7f3c19e3ab Update tests.yml 2024-06-16 01:22:23 +08:00
hiyouga de43bee0b0 increase tol 2024-06-16 01:21:06 +08:00
hiyouga 8c1046d78a support pissa 2024-06-16 01:08:12 +08:00