kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,049 Commits 1 Branch 0 Tags
a8f22d8895c07ce37e8cb34b7014f3e9bcdbf6a3
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hiyouga 0f5a0f64f7 update wechat 2024-08-27 12:55:23 +08:00
hiyouga d14edd350d add extra requires 2024-08-27 12:52:12 +08:00
hiyouga f6ae4e75dd tiny fix 2024-08-27 12:49:32 +08:00
hiyouga 72bc8f0111 support liger kernel 2024-08-27 11:20:14 +08:00
hiyouga 8907150c1b update wechat 2024-08-21 22:07:34 +08:00
hiyouga c8b4c7fee5 tiny fix 2024-08-20 00:10:52 +08:00
hiyouga 3804ddec9e update readme 2024-08-19 23:32:04 +08:00
hiyouga c93d55bfb0 update readme 2024-08-10 10:17:35 +08:00
hiyouga 576a894f77 update readme 2024-08-09 20:46:02 +08:00
hiyouga c75b5b83c4 add magpie ultra dataset 2024-08-09 20:28:55 +08:00
hiyouga dc770efb14 add qwen2 math models 2024-08-09 20:20:35 +08:00
hiyouga 0a690ada6f update examples 2024-08-09 20:13:46 +08:00
hiyouga e2a28f51c6 add adam_mini to readme 2024-08-09 20:02:03 +08:00
hiyouga 86f7099fa3 update scripts 2024-08-09 19:16:23 +08:00
hiyouga c87023d539 follow #5115 2024-08-09 18:03:00 +08:00
hiyouga b7ca6c8dc1 fix #5048 2024-08-05 23:48:19 +08:00
hiyouga 668654b5ad tiny fix 2024-07-26 11:51:00 +08:00
hiyouga 77cff78863 fix #4959 2024-07-24 23:44:00 +08:00
hiyouga 30f8149d11 update webui 2024-07-24 21:11:51 +08:00
hiyouga ace1d44857 tiny fix 2024-07-24 18:33:39 +08:00
hiyouga 091010492b fix #4928 2024-07-24 17:00:29 +08:00
hiyouga 935b22d93e fix #4925 2024-07-24 16:56:58 +08:00
hiyouga 1bbd49faae fix #4944 2024-07-24 16:42:51 +08:00
hiyouga 1550fe7331 add mistral nemo model 2024-07-24 16:25:53 +08:00
hiyouga 26533c0604 add llama3.1 2024-07-24 16:20:11 +08:00
hiyouga bb0a37dc06 Update wechat_npu.jpg 2024-07-22 21:17:22 +08:00
hiyouga 5665062ca0 tiny fix 2024-07-22 21:10:15 +08:00
hiyouga c333e2f49d tiny fix 2024-07-22 00:06:03 +08:00
hiyouga 4135e69406 fix flashattn + packing 2024-07-21 17:07:45 +08:00
hiyouga ad71296a7c update wechat 2024-07-20 22:00:44 +08:00
hiyouga 88c7fc1599 set dev version 2024-07-19 02:01:46 +08:00
hiyouga 8f6995081c update parser 2024-07-19 01:36:39 +08:00
hiyouga bbd5a64423 release v0.8.3 2024-07-19 01:21:18 +08:00
hiyouga cdb0f34f10 fix test 2024-07-19 01:17:37 +08:00
hiyouga e80006795f fix unittest 2024-07-19 01:10:30 +08:00
hiyouga 608de799a2 add unittest 2024-07-19 01:06:27 +08:00
hiyouga 779aae83d2 follow #4878 fix #4684 2024-07-18 22:06:12 +08:00
hiyouga beec77a089 fix metrics #4786 2024-07-17 00:47:00 +08:00
hiyouga d774b94f12 support batch_eval_metrics, fix #4826 2024-07-17 00:33:00 +08:00
hiyouga bda302fbfb tiny fix 2024-07-15 23:09:50 +08:00
hiyouga fd8cc49008 fix #4820 2024-07-15 22:32:07 +08:00
hiyouga b0aa321a4a update wechat 2024-07-15 22:02:52 +08:00
hiyouga 99ab7a8c1c allow computing rouge in training 2024-07-15 01:16:26 +08:00
hiyouga 29ebcd75d5 fix up 2024-07-15 01:04:56 +08:00
hiyouga a4ae3ab4ab update test template 2024-07-15 00:49:34 +08:00
hiyouga f1d8d29bc3 add gemma test 2024-07-14 18:01:45 +08:00
hiyouga 173921419d fix test 2024-07-14 15:44:30 +08:00
hiyouga 88a20ba797 fix #4699 
slow tokenizer for yi models
 2024-07-14 15:34:22 +08:00
hiyouga d3c01552e0 tiny fix 2024-07-14 10:56:45 +08:00
hiyouga 2f6af73da2 fix gemma2 attention 2024-07-13 23:33:45 +08:00
hiyouga 7b19e99ed7 update workflows 2024-07-13 22:31:15 +08:00
hiyouga 6b48308ef9 fix #4792 2024-07-13 22:07:58 +08:00
hiyouga 51942acee8 fix #4731 2024-07-10 11:32:36 +08:00
hiyouga fb0c400116 fix ppo trainer 2024-07-10 11:05:45 +08:00
hiyouga 2f09520c0d fix #4742 2024-07-09 23:24:24 +08:00
hiyouga 86b1594823 Update wechat.jpg 2024-07-09 09:25:11 +08:00
hiyouga a15782cb9f fix #4705 2024-07-07 13:10:06 +08:00
hiyouga 53b1002fb7 add codegeex4, internlm2.5 2024-07-06 16:16:47 +08:00
hiyouga c9bb0757ec update pissa example 2024-07-06 15:47:32 +08:00
hiyouga 9f33f1edf5 fix processors 2024-07-05 08:33:22 +08:00
hiyouga e43809bced fix #4683 2024-07-05 00:58:05 +08:00
hiyouga ed232311e8 fix #4674 2024-07-05 00:41:03 +08:00
hiyouga 226a9e563f Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory 2024-07-04 14:23:37 +08:00
hiyouga 1e27e8c776 fix #4677 2024-07-04 14:22:07 +08:00
hiyouga 636bb9c1e6 update tests 2024-07-04 04:00:12 +08:00
hiyouga 0c699de39d tiny fix 2024-07-04 03:47:05 +08:00
hiyouga 44747cebd2 tiny fix 2024-07-04 03:02:23 +08:00
hiyouga b5d101e1bf fix data map for packing 2024-07-04 03:01:31 +08:00
hiyouga b03e4a74ba update wechat 2024-07-04 01:55:05 +08:00
hiyouga 6fd6aa4530 fix packing for eager/sdpa attn 2024-07-04 01:52:43 +08:00
hiyouga cce7083024 update packing 2024-07-04 01:10:55 +08:00
hiyouga c346f79f99 update func name 2024-07-03 23:29:33 +08:00
hiyouga 8a6a7b9c8a update arg name 2024-07-03 23:23:24 +08:00
hiyouga 575a02a23d update hparams 2024-07-03 23:18:58 +08:00
hiyouga 7f770f6895 update ui 2024-07-03 23:13:49 +08:00
hiyouga a4a1ddbcb9 test 2024-07-03 23:05:39 +08:00
hiyouga 1e0c860c8c update scripts 2024-07-03 20:07:44 +08:00
hiyouga 8845e94f91 fix #4609 
unwrap_model_for_generation(reward_model) is necessary for zero3 training
 2024-07-03 19:45:51 +08:00
hiyouga 87346c0946 update readme 2024-07-03 19:39:05 +08:00
hiyouga 8b1172b910 tiny fix 2024-07-03 02:31:50 +08:00
hiyouga 71cdf8956e tiny fix 2024-07-02 23:06:13 +08:00
hiyouga 821bb6660e remove rlhf support for chatglm2&3 2024-07-02 23:03:17 +08:00
hiyouga c13ae2df19 upcast logits 2024-07-02 22:32:05 +08:00
hiyouga c47ab6c072 improve rlhf 2024-07-02 22:23:08 +08:00
hiyouga 9dcff3a5b5 Update bug-report.yml 2024-07-02 19:18:56 +08:00
hiyouga c81687963a Update bug-report.yml 2024-07-02 19:16:12 +08:00
hiyouga 4c296001c4 fix ppo callbacks 2024-07-02 17:34:56 +08:00
hiyouga 33f2ddb8b6 Update wechat_npu.jpg 2024-07-01 16:28:54 +08:00
hiyouga 73280b7dc7 tiny fix 2024-07-01 05:43:17 +08:00
hiyouga 8c41a0aa6d tiny fix 2024-07-01 03:55:20 +08:00
hiyouga 1856a08e87 add eval acc 2024-07-01 03:51:20 +08:00
hiyouga fc2c15d713 Update label_issue.yml 2024-07-01 01:29:09 +08:00
hiyouga 1771251ce3 fix #4402 #4617 
Deprecate reserved_label_len arg
 2024-07-01 01:19:27 +08:00
hiyouga d4e2af1fa4 update readme 2024-07-01 00:22:52 +08:00
hiyouga d74244d568 fix #4398 #4592 2024-06-30 21:28:51 +08:00
hiyouga 93e6fbb37d update npu docker 2024-06-30 21:05:31 +08:00
hiyouga 2f4b89ace1 loose gemma2 attention 2024-06-29 01:42:14 +08:00
hiyouga 0e0d69b77c update readme 2024-06-28 06:55:19 +08:00
hiyouga 4d35e218b1 bf16 by default, gemma2 attns 
Gemma2 finetuning cannot work until merging https://github.com/huggingface/transformers/pull/31674
 2024-06-28 06:00:26 +08:00
hiyouga 64f4337dac increase pissa_iter for stability 2024-06-28 03:18:54 +08:00