kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,017 Commits 1 Branch 0 Tags
3b4a59bfb1866a270b9934a4a2303197ffdab531
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hiyouga 3b4a59bfb1 fix export 2024-03-14 18:17:01 +08:00
hiyouga 8172530d54 fix bug 2024-03-13 23:55:31 +08:00
hiyouga 714d936dfb fix bug 2024-03-13 23:43:42 +08:00
hiyouga 72367307df improve lora+ impl. 2024-03-13 23:32:51 +08:00
hoshi-hiyougaandGitHub 4e5e99af43 Merge pull request #2830 from qibaoyuan/lora_plus 
[FEATURE]: ADD LORA+ ALGORITHM
 2024-03-13 20:15:46 +08:00
hiyouga dfd451b722 Update wechat.jpg 2024-03-13 19:03:00 +08:00
hiyouga 0b4a5bf509 fix #2817 2024-03-13 12:42:03 +08:00
hiyouga b9f87cdc11 fix #2802 2024-03-13 12:33:45 +08:00
hiyouga 96ce76cd27 fix kv cache 2024-03-13 01:21:50 +08:00
hiyouga 19ef482649 support QDoRA 2024-03-12 22:12:42 +08:00
hiyouga 70a3052dd8 patch for gemma cpt 2024-03-12 21:21:54 +08:00
hiyouga 60cc17f3a8 fix plot issues 2024-03-12 18:41:35 +08:00
hiyouga b3247d6a16 support olmo 2024-03-12 18:30:38 +08:00
hiyouga 8d8956bad5 fix #2802 2024-03-12 17:08:34 +08:00
hiyouga 06c97083e1 fix #2803 2024-03-12 16:57:39 +08:00
hiyouga 07f9b754a7 fix #2782 #2798 2024-03-12 15:53:29 +08:00
hoshi-hiyougaandGitHub c901aa63ff Merge pull request #2743 from S3Studio/DockerizeSupport 
Add dockerize support
 2024-03-12 00:05:49 +08:00
hiyouga e874c00906 fix #2775 2024-03-11 00:42:54 +08:00
hiyouga 352693e2dc tiny fix 2024-03-11 00:17:18 +08:00
hiyouga be99799413 update parser 2024-03-10 13:35:20 +08:00
hiyouga 8664262cde support layerwise galore 2024-03-10 00:24:11 +08:00
hiyouga 18ffce36b5 fix #2732 2024-03-09 22:37:16 +08:00
hiyouga bdb496644c allow non-packing pretraining 2024-03-09 22:21:46 +08:00
hiyouga 412c52e325 fix #2766 2024-03-09 21:35:24 +08:00
hiyouga af0e370fb1 use default arg for freeze tuning 2024-03-09 06:08:48 +08:00
hiyouga 818726e9bc add GaLore results 2024-03-09 04:11:55 +08:00
hiyouga 393c2de27c update hardware requirements 2024-03-09 03:58:18 +08:00
hiyouga 4c00bcdcae update examples 2024-03-09 02:30:37 +08:00
hiyouga e8dd38b7fd fix #2756 , patch #2746 2024-03-09 02:01:26 +08:00
hoshi-hiyougaandGitHub 516d0ddc66 Merge pull request #2746 from stephen-nju/main 
fix deepspeed ppo RuntimeError
 2024-03-09 01:37:00 +08:00
hiyouga 74ff8664d7 Update setup.py 2024-03-09 00:14:48 +08:00
hiyouga 10be2f0ecc fix aqlm version 2024-03-09 00:09:09 +08:00
hiyouga 8a45213440 fix example params 2024-03-08 20:41:43 +08:00
hiyouga 4a2cc60b94 update readme 2024-03-08 03:06:21 +08:00
hiyouga 5d956e2a51 fix chat engine, update webui 2024-03-08 03:01:53 +08:00
hiyouga 5cd4947650 Update setup.py 2024-03-08 01:23:00 +08:00
hiyouga 0ac6b40a47 update galore args 2024-03-08 01:17:32 +08:00
hiyouga 33a4c24a8a fix galore 2024-03-08 00:44:51 +08:00
hiyouga 57452a4aa1 add Yi-9B model 2024-03-07 23:11:57 +08:00
hiyouga 7230e1177d add galore examples 2024-03-07 22:53:45 +08:00
hiyouga 28f7862188 support galore 2024-03-07 22:41:36 +08:00
hiyouga 725f7cd70f update readme 2024-03-07 20:34:49 +08:00
hiyouga 77211d9843 tiny fix 2024-03-07 20:29:34 +08:00
hoshi-hiyougaandGitHub a0dc721816 Merge pull request #2739 from hiyouga/dev-vllm 
support vllm
 2024-03-07 20:28:18 +08:00
hiyouga d07ad5cc1c support vllm 2024-03-07 20:26:31 +08:00
hiyouga f74f804a71 fix #2735 2024-03-07 16:15:53 +08:00
hoshi-hiyougaandGitHub 2185855bdb Merge pull request #2730 from cx2333-gt/main 
fix flash_attn in train_web
 2024-03-07 14:37:18 +08:00
hiyouga 921ee82267 fix chatglm3 template 2024-03-07 14:26:16 +08:00
hiyouga 08d7dc06f2 Update wechat.jpg 2024-03-07 13:14:10 +08:00
hiyouga 0048a2021e tiny fix 2024-03-06 17:25:08 +08:00
hiyouga 3e84f430b1 export use balanced gpu 2024-03-06 16:33:14 +08:00
hiyouga 9658c63cd9 fix add tokens 2024-03-06 15:04:02 +08:00
hiyouga 3016e65657 fix version checking 2024-03-06 14:51:51 +08:00
hiyouga d1587c80de update examples 2024-03-06 13:14:57 +08:00
hiyouga e0c47358f9 fix arg dtype 2024-03-05 20:53:30 +08:00
hiyouga 259af60d28 improve aqlm optim 2024-03-05 20:49:50 +08:00
hiyouga d3d3dac707 optimize aqlm training 2024-03-05 18:35:41 +08:00
hiyouga ddf352f861 fix dora inference 2024-03-05 11:51:41 +08:00
hiyouga e5edcf440f fix export model 2024-03-05 11:05:41 +08:00
hiyouga df9e6bb063 update readme 2024-03-05 03:20:23 +08:00
hiyouga 76f31b18eb add examples 2024-03-05 03:16:35 +08:00
hiyouga 9e56eaf2d3 auto set chat template 2024-03-05 02:41:20 +08:00
hiyouga 24a79bd50f update readme 2024-03-04 19:29:26 +08:00
hiyouga cda2ff8727 fix export on cpu device 2024-03-04 17:35:09 +08:00
hiyouga 9c10854b46 fix sub-process error in thread 2024-03-03 15:04:35 +08:00
hiyouga 7c227e07dd update readme 2024-03-03 01:41:07 +08:00
hiyouga 894d183214 update readme, add starcoder2, cosmopedia 2024-03-03 01:01:46 +08:00
hoshi-hiyougaandGitHub 1006f372ae Update README_zh.md 2024-03-03 00:49:08 +08:00
hoshi-hiyougaandGitHub 4bf7eb72e0 Update README.md 2024-03-03 00:48:47 +08:00
hoshi-hiyougaandGitHub 585c884ea9 Update README.md 2024-03-03 00:48:06 +08:00
hiyouga 318315c76d add colab demo 2024-03-02 19:58:21 +08:00
hiyouga 32884523c5 update data 2024-03-02 19:37:18 +08:00
hiyouga a736b349f0 move git files 2024-03-02 18:30:11 +08:00
hiyouga 46a06e2362 Update wechat.jpg 2024-03-02 17:48:16 +08:00
hiyouga 4e5fae2fac fix #2649 2024-03-01 13:02:41 +08:00
hiyouga 396fd47947 tiny fix 2024-02-29 21:03:48 +08:00
hiyouga 1bfa70ce8e fix webui 2024-02-29 20:09:09 +08:00
hiyouga c0be617195 fix #2642 2024-02-29 18:32:54 +08:00
hiyouga bb16502c33 add twitter 2024-02-29 17:45:30 +08:00
hiyouga 4a871e80e2 tiny fix 2024-02-29 17:28:50 +08:00
hiyouga ece3b3737e tiny fix and release 2024-02-29 00:46:47 +08:00
hoshi-hiyougaandGitHub 7c87532476 Merge pull request #2575 from lungothrin/feature/chatter-with-role 
support on fly test of tools
 2024-02-29 00:39:47 +08:00
hiyouga 4cc2781efe fix #2629 2024-02-29 00:37:29 +08:00
hiyouga fa5ab21ebc release v0.5.3 2024-02-29 00:34:19 +08:00
hiyouga 804c1e7083 add examples 2024-02-28 23:19:25 +08:00
hiyouga 38d8b2cef8 update chatglm3 template 2024-02-28 21:11:23 +08:00
hiyouga a2dccce06a update readme 2024-02-28 20:50:01 +08:00
hiyouga cfefacaa37 support DoRA, AWQ, AQLM #2512 2024-02-28 19:53:28 +08:00
hoshi-hiyougaandGitHub 511b15b96a Merge pull request #2608 from Katehuuh/main 
bump accelerate
 2024-02-27 16:49:34 +08:00
hiyouga 4e63ea4698 add pr template 2024-02-26 18:31:07 +08:00
hoshi-hiyougaandGitHub 8c6b010bb0 Create CONTRIBUTING.md 2024-02-26 18:23:03 +08:00
hoshi-hiyougaandGitHub 647ff682eb Create SECURITY.md 2024-02-26 18:03:17 +08:00
hiyouga 3ba1054593 update readme 2024-02-26 17:25:47 +08:00
hoshi-hiyougaandGitHub 4f18a310e9 Merge pull request #2531 from Rayrtfr/main 
Support Atom Model
 2024-02-26 16:36:45 +08:00
hiyouga 2e592be536 update webui 2024-02-25 20:23:41 +08:00
hiyouga 261f631a1c update readme 2024-02-25 16:26:08 +08:00
hoshi-hiyougaandGitHub 4aab19c7ef Merge pull request #2525 from stephen-nju/main 
update project_kwargs for ppo config
 2024-02-25 15:54:00 +08:00
hiyouga aca948da8f add papers 2024-02-25 15:34:47 +08:00
hiyouga ad76482cf9 add papers 2024-02-25 15:18:58 +08:00
hiyouga 354f13c01a fix data entry 2024-02-23 18:29:24 +08:00