kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
943 Commits 1 Branch 0 Tags
4bf7eb72e089b2afd27ed9268b12e661d638d9db
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hoshi-hiyougaandGitHub 4bf7eb72e0 Update README.md 2024-03-03 00:48:47 +08:00
hoshi-hiyougaandGitHub 585c884ea9 Update README.md 2024-03-03 00:48:06 +08:00
hiyouga 318315c76d add colab demo 2024-03-02 19:58:21 +08:00
hiyouga 32884523c5 update data 2024-03-02 19:37:18 +08:00
hiyouga a736b349f0 move git files 2024-03-02 18:30:11 +08:00
hiyouga 46a06e2362 Update wechat.jpg 2024-03-02 17:48:16 +08:00
hiyouga 4e5fae2fac fix #2649 2024-03-01 13:02:41 +08:00
hiyouga 396fd47947 tiny fix 2024-02-29 21:03:48 +08:00
hiyouga 1bfa70ce8e fix webui 2024-02-29 20:09:09 +08:00
hiyouga c0be617195 fix #2642 2024-02-29 18:32:54 +08:00
hiyouga bb16502c33 add twitter 2024-02-29 17:45:30 +08:00
hiyouga 4a871e80e2 tiny fix 2024-02-29 17:28:50 +08:00
hiyouga ece3b3737e tiny fix and release 2024-02-29 00:46:47 +08:00
hoshi-hiyougaandGitHub 7c87532476 Merge pull request #2575 from lungothrin/feature/chatter-with-role 
support on fly test of tools
 2024-02-29 00:39:47 +08:00
hiyouga 4cc2781efe fix #2629 2024-02-29 00:37:29 +08:00
hiyouga fa5ab21ebc release v0.5.3 2024-02-29 00:34:19 +08:00
hiyouga 804c1e7083 add examples 2024-02-28 23:19:25 +08:00
hiyouga 38d8b2cef8 update chatglm3 template 2024-02-28 21:11:23 +08:00
hiyouga a2dccce06a update readme 2024-02-28 20:50:01 +08:00
hiyouga cfefacaa37 support DoRA, AWQ, AQLM #2512 2024-02-28 19:53:28 +08:00
hoshi-hiyougaandGitHub 511b15b96a Merge pull request #2608 from Katehuuh/main 
bump accelerate
 2024-02-27 16:49:34 +08:00
hiyouga 4e63ea4698 add pr template 2024-02-26 18:31:07 +08:00
hoshi-hiyougaandGitHub 8c6b010bb0 Create CONTRIBUTING.md 2024-02-26 18:23:03 +08:00
hoshi-hiyougaandGitHub 647ff682eb Create SECURITY.md 2024-02-26 18:03:17 +08:00
hiyouga 3ba1054593 update readme 2024-02-26 17:25:47 +08:00
hoshi-hiyougaandGitHub 4f18a310e9 Merge pull request #2531 from Rayrtfr/main 
Support Atom Model
 2024-02-26 16:36:45 +08:00
hiyouga 2e592be536 update webui 2024-02-25 20:23:41 +08:00
hiyouga 261f631a1c update readme 2024-02-25 16:26:08 +08:00
hoshi-hiyougaandGitHub 4aab19c7ef Merge pull request #2525 from stephen-nju/main 
update project_kwargs for ppo config
 2024-02-25 15:54:00 +08:00
hiyouga aca948da8f add papers 2024-02-25 15:34:47 +08:00
hiyouga ad76482cf9 add papers 2024-02-25 15:18:58 +08:00
hiyouga 354f13c01a fix data entry 2024-02-23 18:29:24 +08:00
hiyouga 6bf4c1274f fix gemma template 2024-02-23 13:49:53 +08:00
hiyouga a87838ded1 fix template 2024-02-22 12:09:21 +08:00
hiyouga c375a20230 fix template 2024-02-22 12:06:48 +08:00
hiyouga c99e19641a support gemma 2024-02-21 23:27:36 +08:00
hiyouga 1630a4cb8f fix #2533 2024-02-21 22:47:48 +08:00
hiyouga 3cc10a01a7 fix #2532 2024-02-21 21:55:14 +08:00
hiyouga daa3185350 tiny fix 2024-02-21 18:30:29 +08:00
hiyouga 9aeb404a94 support lora for llama pro 2024-02-21 02:17:22 +08:00
hiyouga 02c8c55ce3 fix #2516 2024-02-20 20:44:24 +08:00
hoshi-hiyougaandGitHub b5bd36237f Merge pull request #2514 from codemayq/main 
add a pre-built version of flash-attn
 2024-02-20 16:09:25 +08:00
hoshi-hiyougaandGitHub 869fd208a8 Update README.md 2024-02-20 16:07:55 +08:00
hoshi-hiyougaandGitHub 175a48d79d Update README_zh.md 2024-02-20 16:06:59 +08:00
hiyouga 5bbec1c1f2 release v0.5.2 2024-02-20 11:12:43 +08:00
hiyouga ba998c67ab update webui 2024-02-19 16:49:58 +08:00
hiyouga 26912cd816 add test scripts 2024-02-19 02:09:13 +08:00
hiyouga d46977edf5 Update wechat.jpg 2024-02-18 18:15:22 +08:00
hiyouga e4e86a73f1 fix safetensors 2024-02-18 18:12:16 +08:00
hiyouga 22acab8aff fix #2481 2024-02-15 19:07:47 +08:00
hiyouga 7924ffc55d support llama pro #2338 , add rslora 2024-02-15 02:27:36 +08:00
hoshi-hiyougaandGitHub 8a1b389086 Merge pull request #2474 from younesbelkada/add-hf-tags 
FEAT: add HF tags for models that have been trained with llama-factory
 2024-02-14 10:26:03 +08:00
hiyouga 12b2066e34 fix #2471 2024-02-12 21:07:46 +08:00
hiyouga 91d09a01ac add option to disable version check 2024-02-10 22:31:23 +08:00
hiyouga a754f6e9ec update data/readme 2024-02-10 21:04:29 +08:00
hiyouga a5fb2806cd update default template 2024-02-10 16:44:47 +08:00
hiyouga 7d2dc83c5e improve aligner 2024-02-10 16:39:19 +08:00
hoshi-hiyougaandGitHub 388b705a8d Merge pull request #2462 from mnmueller/main 
Enable Parsing of SlimOrca
 2024-02-09 22:55:48 +08:00
hiyouga 54ea9684ed improve fix tokenizer 2024-02-09 14:53:14 +08:00
hoshi-hiyougaandGitHub d0daaa01f9 Merge pull request #2423 from mayflower/main 
Support for german sft and dpo
 2024-02-07 15:58:20 +08:00
hiyouga d6775c6522 Update tests.yml 2024-02-07 01:18:22 +08:00
hiyouga 88a1bc9773 lint 2024-02-07 01:10:04 +08:00
hiyouga aacc823b0f Update pyproject.toml 2024-02-07 00:45:58 +08:00
hiyouga 0ae9a16b9d update gc kwargs 2024-02-07 00:38:24 +08:00
hiyouga ebf31b62eb fix #2438 2024-02-06 15:23:08 +08:00
hiyouga 85622ae757 add models 2024-02-06 14:57:23 +08:00
hiyouga ccabb5b04a support qwen1.5 2024-02-06 00:10:51 +08:00
hoshi-hiyougaandGitHub 7f48c599eb fix #2436 
Update test_toolcall.py
 2024-02-05 22:55:28 +08:00
hoshi-hiyougaandGitHub b5007afb19 Update test_toolcall.py 2024-02-05 22:51:03 +08:00
hoshi-hiyougaandGitHub d4994235f0 Update test_toolcall.py 2024-02-05 22:50:43 +08:00
hiyouga 3dc86c4af9 fix #2421 2024-02-04 21:02:55 +08:00
hiyouga db0ab4d601 fix reserved label len 2024-02-04 17:54:26 +08:00
hiyouga 19d33ede13 fix #2420 2024-02-04 15:51:47 +08:00
hiyouga b988ce0a0c fix #2189 2024-02-04 00:47:37 +08:00
hiyouga 38e63bfd28 bump up transformers version 2024-02-04 00:01:16 +08:00
hiyouga 51df865734 fix #2397 2024-02-03 23:45:31 +08:00
hiyouga 6545c02790 add hint for freeze #2412 2024-02-03 23:38:56 +08:00
hiyouga 4ecadc3512 fix #2376 2024-02-03 23:14:31 +08:00
hiyouga 901faa16cc support minicpm #2404 2024-02-03 22:36:46 +08:00
hoshi-hiyougaandGitHub 2eaaa9522f Merge pull request #2411 from lxsyz/main 
fix eos_token_id=0 bug
 2024-02-02 17:38:16 +08:00
hiyouga ec70eb5d8d Update wechat.jpg 2024-02-01 11:01:12 +08:00
hiyouga 39bd5bd524 fix #2388 2024-01-31 17:23:56 +08:00
hiyouga 521ad76552 fix autoset attn impl, update data readme 2024-01-31 11:58:07 +08:00
hiyouga 60733275f8 Update wechat.jpg 2024-01-25 13:02:49 +08:00
hiyouga 2bc30763e9 fix #2320 2024-01-24 16:19:18 +08:00
hoshi-hiyougaandGitHub 51ad35b3c7 Merge pull request #2319 from ftgreat/main 
Add patch_mixtral_replace_moe_impl for full training Mitral using DeepSpeed Zero3
 2024-01-24 15:32:26 +08:00
hiyouga dbaaa4546e Update dataset_info.json 2024-01-23 00:10:32 +08:00
hiyouga e4ba1deedf add hint 2024-01-22 23:32:01 +08:00
hoshi-hiyougaandGitHub 8e4b3a959a Merge pull request #2283 from A-Cepheus/main 
fix: ZeRO3 does not work with MoE models
 2024-01-22 23:28:45 +08:00
hoshi-hiyougaandGitHub bdc9eff635 Update patcher.py 2024-01-22 23:27:39 +08:00
hoshi-hiyougaandGitHub bb5a3b85a6 Update tests.yml 2024-01-22 23:22:15 +08:00
hoshi-hiyougaandGitHub 087476da99 Create tests.yml 2024-01-22 23:13:04 +08:00
hiyouga b2fb0eca56 fix #2282 and update tool prompt 2024-01-22 22:27:30 +08:00
hiyouga 6fc2d5cc03 add orion models 2024-01-22 21:26:53 +08:00
hiyouga 486cc8d360 add array param format 2024-01-21 22:17:48 +08:00
hiyouga 37ec5deaec update tool test 2024-01-21 19:41:46 +08:00
hiyouga f51d48ea08 fix api 2024-01-21 19:15:27 +08:00
hiyouga e0a717aa3a fix #2268 2024-01-21 14:11:38 +08:00
hiyouga 3bc301be02 tiny fix 2024-01-21 13:26:12 +08:00
hoshi-hiyougaandGitHub ea6db72631 Merge pull request #2266 from yhyu13/fix_export_model_dtype 
Remove manully set use_cache; torch_dtype is not str, save model as b…
 2024-01-21 12:40:39 +08:00