kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,794 Commits 1 Branch 0 Tags
cc016461e63a570142b56d50a5d11e55a96ab8db
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hiyouga cc016461e6 fix #4379 2024-06-25 02:31:44 +08:00
hiyouga 095fab58d3 tiny fix about badam 2024-06-25 01:54:53 +08:00
hiyouga efb81b25ec fix #4419 2024-06-25 01:51:29 +08:00
hiyouga 41086059b1 tiny fix 2024-06-25 01:15:19 +08:00
hiyouga fca893d73c fix #4410 2024-06-24 22:34:31 +08:00
hiyouga 4ea84a8333 update readme 2024-06-24 18:29:04 +08:00
hiyouga e507e60638 update readme 2024-06-24 18:22:12 +08:00
hiyouga db9a1912e3 remove dup template 2024-06-22 01:31:32 +08:00
hiyouga 3ce44dda99 fix api 2024-06-22 00:00:38 +08:00
hiyouga 8d4f5093cf tiny fix 2024-06-20 22:56:05 +08:00
hiyouga f22d8f9ca4 improve llamaboard 2024-06-19 23:46:03 +08:00
hiyouga 3f84411b5d fix llamaboard abort 2024-06-19 23:22:28 +08:00
hiyouga 3b040e8e0f update patcher 2024-06-19 21:27:00 +08:00
hiyouga 42e69a3c63 set dev version 2024-06-19 21:08:16 +08:00
hiyouga 87e330fee5 Update publish.yml 2024-06-19 20:46:33 +08:00
hiyouga 71327ba85a release v0.8.2 2024-06-19 20:42:09 +08:00
hiyouga 2b596fb55f fix jinja template 2024-06-19 20:03:50 +08:00
hiyouga 4cff6a4ad5 fix templates 2024-06-19 17:44:05 +08:00
hiyouga 6d2bf216ac fix bug 2024-06-19 03:49:23 +08:00
hiyouga 4f22eae8f4 use prefix to replace force system 2024-06-19 03:39:52 +08:00
hiyouga cd75b1fe9d fix tool formatter, allow parallel function #4362 2024-06-19 03:23:51 +08:00
hiyouga 9ab0401948 update data 2024-06-19 02:48:43 +08:00
hiyouga 344b9a36b2 tiny fix 2024-06-18 23:32:18 +08:00
hiyouga a233fbc258 add deepseek coder v2 #4346 2024-06-18 22:53:54 +08:00
hiyouga 4bd77d8563 fix #4357 2024-06-18 22:42:45 +08:00
hiyouga c96264bc47 fix #4335 2024-06-18 22:08:56 +08:00
hiyouga 24c160df3d lint 2024-06-17 22:35:56 +08:00
hiyouga 7857c0990b update chat engine #4335 2024-06-17 19:07:17 +08:00
hiyouga fcb2e8e7b7 update readme 2024-06-17 18:47:24 +08:00
hiyouga e2665e71c7 fix #4326 2024-06-17 18:17:48 +08:00
hiyouga 72471ee046 Update wechat.jpg 2024-06-17 17:49:03 +08:00
hiyouga 2bf2863a58 tiny fix 2024-06-17 17:47:25 +08:00
hiyouga 0a2ec5fe20 update pr template 2024-06-16 01:43:43 +08:00
hiyouga 46093b5786 fix tol 2024-06-16 01:38:44 +08:00
hiyouga 7f3c19e3ab Update tests.yml 2024-06-16 01:22:23 +08:00
hiyouga de43bee0b0 increase tol 2024-06-16 01:21:06 +08:00
hiyouga 8c1046d78a support pissa 2024-06-16 01:08:12 +08:00
hiyouga 38b6b0f52e tiny fix 2024-06-16 01:06:41 +08:00
hiyouga 80a9e6bf94 use fixture 2024-06-15 20:06:17 +08:00
hiyouga 1b834f50be add tests 2024-06-15 19:51:20 +08:00
hiyouga 572d8bbfdd add minicpm #4227 2024-06-15 17:58:52 +08:00
hiyouga d87108daa6 add license 2024-06-15 17:54:33 +08:00
hiyouga acd84ce535 update readme 2024-06-15 05:13:16 +08:00
hiyouga f1aa6a411a fix #4271 2024-06-15 05:11:33 +08:00
hiyouga d519b4d76d disable DP 2024-06-15 04:57:19 +08:00
hiyouga 9092f963db fix #4292 2024-06-15 04:47:13 +08:00
hiyouga 78589cf90c fix #4295 2024-06-15 04:34:55 +08:00
hiyouga b27269bd2b add test cases 2024-06-15 04:05:54 +08:00
hiyouga 2d43b8bb49 Update README.md 2024-06-13 16:02:21 +08:00
hiyouga 892e561c28 update examples 2024-06-13 03:26:10 +08:00
hiyouga c94e6c9411 add quant check in webui export tab 2024-06-13 03:19:18 +08:00
hiyouga a19cdd39fe Update llama3_full_sft_ds3.yaml 2024-06-13 03:16:20 +08:00
hiyouga b6e008c152 update examples 2024-06-13 03:15:06 +08:00
hiyouga 6baafd4eb3 fix #4221 2024-06-13 02:48:21 +08:00
hiyouga 9419f96609 update wechat 2024-06-13 02:31:45 +08:00
hiyouga cf9f2d6c42 fix #4209 
DeepSpeed ZeRO3 has inflight param error when calling model.eval()
 2024-06-13 02:25:50 +08:00
hiyouga 2ed8270112 clean code 2024-06-13 01:58:16 +08:00
hiyouga c7a5620ccc add neo-sft dataset 2024-06-13 01:00:56 +08:00
hiyouga 713fde4259 fix lint 2024-06-13 00:48:44 +08:00
hiyouga 947a34f53b fix docker compose usage 2024-06-13 00:07:48 +08:00
hiyouga 2ce2e5bc47 update readme 2024-06-12 17:39:12 +08:00
hiyouga 577de2fa07 fix #4242 2024-06-12 16:50:11 +08:00
hiyouga cca6f35108 fix deepspeed version 2024-06-11 16:52:36 +08:00
hiyouga 53b74361d3 Update bug-report.yml 2024-06-11 15:40:21 +08:00
hiyouga 89f2bd8c8c fix #4198 2024-06-11 15:38:38 +08:00
hiyouga 90e14a960d tiny fix 2024-06-11 12:48:53 +08:00
hiyouga 3f24337a8a tiny fix 2024-06-11 01:04:16 +08:00
hiyouga 91e62a098f set dev version 2024-06-11 00:50:53 +08:00
hiyouga 2b6ebd6b51 release v0.8.1 2024-06-11 00:44:26 +08:00
hiyouga a793e8456b fix #4160 
The split heads should be concatenated in dim=2
 2024-06-11 00:37:17 +08:00
hiyouga 949e9908ad fix #4145 
Fix the docker image
 2024-06-11 00:19:17 +08:00
hiyouga 0012762b04 update evaluator 2024-06-10 23:56:00 +08:00
hiyouga c907d81667 fix #2666 2024-06-10 21:24:15 +08:00
hiyouga b61d25cd70 add pr ci 2024-06-08 21:25:35 +08:00
hiyouga 25c635ef28 Update tests.yml 2024-06-08 21:15:36 +08:00
hiyouga 4c4f950f39 update git workflows 2024-06-08 21:11:32 +08:00
hiyouga 972ec9c668 fix llamafactory-cli env 2024-06-08 07:15:45 +08:00
hiyouga 3ac11e77cc set dev version 2024-06-08 06:46:09 +08:00
hiyouga 5aa4ce4756 release v0.8.0 2024-06-08 05:20:54 +08:00
hiyouga 12d79f89c5 add ultrafeedback and fineweb #4085 #4132 2024-06-08 02:42:34 +08:00
hiyouga 42d9b26fc8 fix ci 2024-06-08 02:00:44 +08:00
hiyouga 7f20e4722a fix ci 2024-06-08 01:57:36 +08:00
hiyouga aa2578bea0 add ci 2024-06-08 01:48:30 +08:00
hiyouga 1c7f0ab519 init unittest 2024-06-08 01:35:58 +08:00
hiyouga 4b55f35662 Delete .readthedocs.yaml 2024-06-08 00:58:10 +08:00
hiyouga 54cd743ebf reorganize adapter code 2024-06-08 00:47:23 +08:00
hiyouga 06e5d136a4 add resume args in webui 2024-06-08 00:22:16 +08:00
hiyouga 8bf9da659c fix #4137 2024-06-07 19:16:06 +08:00
hiyouga cce0fad91c Update wechat.jpg 2024-06-07 19:04:16 +08:00
hiyouga f8d8690bf4 tiny fix 2024-06-07 05:19:21 +08:00
hiyouga 4489d73ac7 fix ppo trainer save zero3 model 
accelerator.get_state_dict(ds_model) should be called at all ranks
 2024-06-07 05:14:19 +08:00
hiyouga 2702d7e952 fix ppo in trl 0.8.6 2024-06-07 04:48:29 +08:00
hiyouga f9e818d79c fix #4120 2024-06-07 04:18:05 +08:00
hiyouga ccc8b64cc2 update data processors 2024-06-07 04:15:40 +08:00
hiyouga 8e95648850 add qwen2 models 2024-06-07 00:22:57 +08:00
hiyouga 74f96efef9 rename files 2024-06-07 00:09:06 +08:00
hiyouga 45d8be8f93 add DISABLE_TORCHRUN option 2024-06-06 23:44:58 +08:00
hiyouga 76c61905b2 fix ppo+zero3 #3108 2024-06-06 23:30:07 +08:00
hiyouga 451b6693c0 fix torch gc 2024-06-06 20:30:25 +08:00
hiyouga 149610c636 fix ppo dataset bug #4012 2024-06-06 19:03:20 +08:00