kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,115 Commits 1 Branch 0 Tags
52a06efaf8af26d16137ba9095f1fd81e8f61983
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hiyouga 52a06efaf8 add test case 2024-09-08 01:40:49 +08:00
hiyouga fb72a3adb0 support activation offloading via unsloth gc 2024-09-08 01:22:19 +08:00
hiyouga 54c6905937 add docstrings, refactor logger 2024-09-08 00:56:56 +08:00
hiyouga 76f2e59504 tiny fix 2024-09-05 23:41:16 +08:00
hiyouga eb5aa9adce fix ci 2024-09-05 22:39:47 +08:00
hiyouga 2f939b708f fix ci 2024-09-05 22:27:48 +08:00
hiyouga 94d5b1bd8f add e2e tests 2024-09-05 21:52:28 +08:00
hiyouga 70e36ff2f4 update data readme 2024-09-05 04:44:49 +08:00
hiyouga 6055fe02de update data readme 2024-09-05 04:25:27 +08:00
hiyouga 359ef8bb0e support Yi-Coder models 2024-09-05 03:12:24 +08:00
hiyouga 1173f7fc1d fix ci 2024-09-05 03:02:59 +08:00
hiyouga b6a3fdd056 fix ci 2024-09-05 02:49:22 +08:00
hiyouga 315284f627 update ci 2024-09-05 02:26:10 +08:00
hiyouga c122b9f865 tiny fix 2024-09-05 02:16:49 +08:00
hiyouga 8cafc7b055 video datasets 2024-09-05 02:04:17 +08:00
hiyouga c5e1736470 fix test 2024-09-04 22:38:26 +08:00
hiyouga dabad5570b update get template 2024-09-04 22:36:20 +08:00
hiyouga ebddce5d4a fix #5252 2024-09-04 03:17:54 +08:00
hiyouga 57497135bf add vl_feedback dataset 2024-09-04 03:13:03 +08:00
hiyouga d41d43a7c3 fix #5344 2024-09-04 03:06:06 +08:00
hiyouga 47ea97fb1b lazy image load 2024-09-04 02:27:08 +08:00
hiyouga 59d2b31e96 fix #5334 2024-09-03 19:09:42 +08:00
hiyouga 69d0acacc3 fix #5338 2024-09-03 17:45:17 +08:00
hiyouga 22959bcdd3 lint 2024-09-03 00:46:25 +08:00
hiyouga a61c8c4890 fix #5324 2024-09-02 23:56:21 +08:00
hiyouga 60fc6b926e fix mm inference 2024-09-02 01:47:40 +08:00
hiyouga 3a6f19f017 tiny fix 2024-09-02 01:33:22 +08:00
hiyouga ce8c5a2647 add image num check 2024-09-02 01:31:36 +08:00
hiyouga 194064fdae add pokemon dataset 2024-09-02 01:02:25 +08:00
hiyouga a8f8a2ad8a update readme 2024-09-01 23:32:39 +08:00
hiyouga 753c5fb36c update wechat 2024-09-01 23:30:57 +08:00
hiyouga 8e49940746 add rlhf-v dataset 2024-09-01 22:57:41 +08:00
hiyouga 55027282cd tiny fix 2024-09-01 21:15:44 +08:00
hiyouga 64cb947c60 fix bug 2024-09-01 21:07:49 +08:00
hiyouga 9967ccb3ae fix mixed mm inputs and rlhf-v 2024-09-01 20:52:47 +08:00
hiyouga b5063b4144 fix ci (temp) 2024-08-31 02:03:56 +08:00
hiyouga a2a8c0b92c add test mm plugin 2024-08-31 01:53:38 +08:00
hiyouga a025c3df61 remove visual_inputs, fix qlora 2024-08-31 00:24:51 +08:00
hiyouga a244f143f4 optimize predict vram 2024-08-30 23:08:45 +08:00
hiyouga e08045a946 add examples 2024-08-30 21:43:19 +08:00
hiyouga bee1bd43b9 tiny fix 2024-08-30 03:21:50 +08:00
hiyouga 8b588c7224 fix #5307 2024-08-30 02:45:40 +08:00
hiyouga 3382317e32 refactor mm training 2024-08-30 02:14:31 +08:00
hiyouga a7dd7d325e update liger kernel 2024-08-29 20:46:08 +08:00
hiyouga aa1afdc756 fix #5292 2024-08-29 20:37:47 +08:00
hiyouga ad72f3e065 fix #5295 2024-08-29 20:30:18 +08:00
hiyouga 364b757e30 fix #5305 2024-08-29 20:16:01 +08:00
hiyouga 0f5a0f64f7 update wechat 2024-08-27 12:55:23 +08:00
hiyouga d14edd350d add extra requires 2024-08-27 12:52:12 +08:00
hiyouga f6ae4e75dd tiny fix 2024-08-27 12:49:32 +08:00
hiyouga 72bc8f0111 support liger kernel 2024-08-27 11:20:14 +08:00
hiyouga 8907150c1b update wechat 2024-08-21 22:07:34 +08:00
hiyouga c8b4c7fee5 tiny fix 2024-08-20 00:10:52 +08:00
hiyouga 3804ddec9e update readme 2024-08-19 23:32:04 +08:00
hiyouga c93d55bfb0 update readme 2024-08-10 10:17:35 +08:00
hiyouga 576a894f77 update readme 2024-08-09 20:46:02 +08:00
hiyouga c75b5b83c4 add magpie ultra dataset 2024-08-09 20:28:55 +08:00
hiyouga dc770efb14 add qwen2 math models 2024-08-09 20:20:35 +08:00
hiyouga 0a690ada6f update examples 2024-08-09 20:13:46 +08:00
hiyouga e2a28f51c6 add adam_mini to readme 2024-08-09 20:02:03 +08:00
hiyouga 86f7099fa3 update scripts 2024-08-09 19:16:23 +08:00
hiyouga c87023d539 follow #5115 2024-08-09 18:03:00 +08:00
hiyouga b7ca6c8dc1 fix #5048 2024-08-05 23:48:19 +08:00
hiyouga 668654b5ad tiny fix 2024-07-26 11:51:00 +08:00
hiyouga 77cff78863 fix #4959 2024-07-24 23:44:00 +08:00
hiyouga 30f8149d11 update webui 2024-07-24 21:11:51 +08:00
hiyouga ace1d44857 tiny fix 2024-07-24 18:33:39 +08:00
hiyouga 091010492b fix #4928 2024-07-24 17:00:29 +08:00
hiyouga 935b22d93e fix #4925 2024-07-24 16:56:58 +08:00
hiyouga 1bbd49faae fix #4944 2024-07-24 16:42:51 +08:00
hiyouga 1550fe7331 add mistral nemo model 2024-07-24 16:25:53 +08:00
hiyouga 26533c0604 add llama3.1 2024-07-24 16:20:11 +08:00
hiyouga bb0a37dc06 Update wechat_npu.jpg 2024-07-22 21:17:22 +08:00
hiyouga 5665062ca0 tiny fix 2024-07-22 21:10:15 +08:00
hiyouga c333e2f49d tiny fix 2024-07-22 00:06:03 +08:00
hiyouga 4135e69406 fix flashattn + packing 2024-07-21 17:07:45 +08:00
hiyouga ad71296a7c update wechat 2024-07-20 22:00:44 +08:00
hiyouga 88c7fc1599 set dev version 2024-07-19 02:01:46 +08:00
hiyouga 8f6995081c update parser 2024-07-19 01:36:39 +08:00
hiyouga bbd5a64423 release v0.8.3 2024-07-19 01:21:18 +08:00
hiyouga cdb0f34f10 fix test 2024-07-19 01:17:37 +08:00
hiyouga e80006795f fix unittest 2024-07-19 01:10:30 +08:00
hiyouga 608de799a2 add unittest 2024-07-19 01:06:27 +08:00
hiyouga 779aae83d2 follow #4878 fix #4684 2024-07-18 22:06:12 +08:00
hiyouga beec77a089 fix metrics #4786 2024-07-17 00:47:00 +08:00
hiyouga d774b94f12 support batch_eval_metrics, fix #4826 2024-07-17 00:33:00 +08:00
hiyouga bda302fbfb tiny fix 2024-07-15 23:09:50 +08:00
hiyouga fd8cc49008 fix #4820 2024-07-15 22:32:07 +08:00
hiyouga b0aa321a4a update wechat 2024-07-15 22:02:52 +08:00
hiyouga 99ab7a8c1c allow computing rouge in training 2024-07-15 01:16:26 +08:00
hiyouga 29ebcd75d5 fix up 2024-07-15 01:04:56 +08:00
hiyouga a4ae3ab4ab update test template 2024-07-15 00:49:34 +08:00
hiyouga f1d8d29bc3 add gemma test 2024-07-14 18:01:45 +08:00
hiyouga 173921419d fix test 2024-07-14 15:44:30 +08:00
hiyouga 88a20ba797 fix #4699 
slow tokenizer for yi models
 2024-07-14 15:34:22 +08:00
hiyouga d3c01552e0 tiny fix 2024-07-14 10:56:45 +08:00
hiyouga 2f6af73da2 fix gemma2 attention 2024-07-13 23:33:45 +08:00
hiyouga 7b19e99ed7 update workflows 2024-07-13 22:31:15 +08:00
hiyouga 6b48308ef9 fix #4792 2024-07-13 22:07:58 +08:00
hiyouga 51942acee8 fix #4731 2024-07-10 11:32:36 +08:00