kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,196 Commits 1 Branch 0 Tags
3b43a3b7c5f894064afb1dd2b313962bd851156f
Commit Graph
139 Commits
Author SHA1 Message Date
hiyouga c00f0771a5 Update parser.py 2024-04-16 18:09:31 +08:00
hoshi-hiyougaandGitHub 4d660c5ade Merge pull request #3287 from Ledzy/badam 
[Feature] Add BAdam algorithm
 2024-04-16 17:32:16 +08:00
hoshi-hiyougaandGitHub 4660703674 Update parser.py 2024-04-16 17:27:25 +08:00
hoshi-hiyougaandGitHub 5b59ff4212 Update parser.py 2024-04-16 17:27:02 +08:00
hoshi-hiyougaandGitHub ec899cccf3 Update finetuning_args.py 2024-04-16 17:26:30 +08:00
hiyouga e0dbac2845 support cohere commandR #3184 2024-04-15 23:26:42 +08:00
Jonery 06c8908d3f Feature BAdam 2024-04-15 23:15:27 +08:00
hiyouga cce52351b5 update examples 2024-04-15 22:14:34 +08:00
hiyouga efc345c4b0 fix #3273 2024-04-15 15:32:58 +08:00
hiyouga 232642a621 fix #3238 2024-04-12 14:28:11 +08:00
hiyouga ce77d98872 fix #3116 2024-04-03 14:47:59 +08:00
hiyouga 92dab8a90b simplify readme 2024-04-02 20:07:43 +08:00
hiyouga b267aeb53f add moe aux loss control #3085 2024-04-02 14:26:31 +08:00
hiyouga eb259cc573 support infer 4bit model on GPUs #3023 2024-04-01 17:34:04 +08:00
hiyouga 17bf8a2c3a support ORPO 2024-03-31 18:29:50 +08:00
hiyouga 8d603f8820 fix #2982 2024-03-28 20:22:31 +08:00
hiyouga 3164b4f11b fix bug 2024-03-26 17:30:12 +08:00
hiyouga 511f675402 fix #2961 2024-03-26 17:26:14 +08:00
hiyouga 98a42cbdaa tiny fix 2024-03-25 23:28:52 +08:00
hiyouga 1484f76a95 add arg check 2024-03-25 22:42:58 +08:00
hiyouga 72367307df improve lora+ impl. 2024-03-13 23:32:51 +08:00
齐保元 a0965cd62c [FEATURE]: ADD LORA+ ALGORITHM 2024-03-13 19:43:27 +08:00
hiyouga 96ce76cd27 fix kv cache 2024-03-13 01:21:50 +08:00
hiyouga 19ef482649 support QDoRA 2024-03-12 22:12:42 +08:00
hiyouga 8d8956bad5 fix #2802 2024-03-12 17:08:34 +08:00
hiyouga 07f9b754a7 fix #2782 #2798 2024-03-12 15:53:29 +08:00
hiyouga be99799413 update parser 2024-03-10 13:35:20 +08:00
hiyouga 8664262cde support layerwise galore 2024-03-10 00:24:11 +08:00
hiyouga bdb496644c allow non-packing pretraining 2024-03-09 22:21:46 +08:00
hiyouga 393c2de27c update hardware requirements 2024-03-09 03:58:18 +08:00
hiyouga 5d956e2a51 fix chat engine, update webui 2024-03-08 03:01:53 +08:00
hiyouga 0ac6b40a47 update galore args 2024-03-08 01:17:32 +08:00
hiyouga 33a4c24a8a fix galore 2024-03-08 00:44:51 +08:00
hiyouga 28f7862188 support galore 2024-03-07 22:41:36 +08:00
hiyouga d07ad5cc1c support vllm 2024-03-07 20:26:31 +08:00
hiyouga f74f804a71 fix #2735 2024-03-07 16:15:53 +08:00
hiyouga 3016e65657 fix version checking 2024-03-06 14:51:51 +08:00
hiyouga 259af60d28 improve aqlm optim 2024-03-05 20:49:50 +08:00
hiyouga 4e5fae2fac fix #2649 2024-03-01 13:02:41 +08:00
hiyouga fa5ab21ebc release v0.5.3 2024-02-29 00:34:19 +08:00
hiyouga cfefacaa37 support DoRA, AWQ, AQLM #2512 2024-02-28 19:53:28 +08:00
hiyouga 3cc10a01a7 fix #2532 2024-02-21 21:55:14 +08:00
hiyouga 9aeb404a94 support lora for llama pro 2024-02-21 02:17:22 +08:00
hiyouga ba998c67ab update webui 2024-02-19 16:49:58 +08:00
hiyouga 7924ffc55d support llama pro #2338 , add rslora 2024-02-15 02:27:36 +08:00
hiyouga 91d09a01ac add option to disable version check 2024-02-10 22:31:23 +08:00
hiyouga 7d2dc83c5e improve aligner 2024-02-10 16:39:19 +08:00
hiyouga 88a1bc9773 lint 2024-02-07 01:10:04 +08:00
hiyouga db0ab4d601 fix reserved label len 2024-02-04 17:54:26 +08:00
hiyouga 6545c02790 add hint for freeze #2412 2024-02-03 23:38:56 +08:00