kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,130 Commits 1 Branch 0 Tags
4c6c4a0d8829bc098c202e4c3df36f702d579537
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hoshi-hiyougaandGitHub 4c6c4a0d88 Merge pull request #3161 from hiyouga/feature/add-mediatek-model 
support Breeze-7B
 2024-04-08 20:56:51 +08:00
hiyouga 98ad2ccd8f Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory 2024-04-08 19:59:24 +08:00
hiyouga e79e1532fa Update wechat.jpg 2024-04-08 19:59:07 +08:00
hoshi-hiyougaandGitHub ff4d313a50 Merge pull request #3160 from sliderSun/main 
support Qwen1.5-32B
 2024-04-07 18:00:40 +08:00
hiyouga a88fe8c1af update readme 2024-04-07 00:48:24 +08:00
hiyouga b87f8f1519 update examples 2024-04-04 14:48:21 +08:00
hiyouga a6d943804b tiny fix 2024-04-04 02:19:03 +08:00
hiyouga 4b920f24d3 back to gradio 4.21 and fix chat 2024-04-04 02:07:20 +08:00
hiyouga 5ddcecda50 fix bug in latest gradio 2024-04-04 00:55:31 +08:00
hiyouga 7f6e412604 fix requires for windows 2024-04-03 21:56:43 +08:00
hiyouga 148bda353f fix resize vocab at inference #3022 2024-04-03 18:14:24 +08:00
hiyouga ce77d98872 fix #3116 2024-04-03 14:47:59 +08:00
hiyouga f0a9245c7e Update wechat.jpg 2024-04-03 14:42:21 +08:00
hiyouga 49a2dfaf90 update vllm example 2024-04-02 22:45:20 +08:00
hiyouga 66b0fe4e96 update readme 2024-04-02 22:17:48 +08:00
hiyouga fc7f1cc365 update examples 2024-04-02 21:09:25 +08:00
hiyouga 7765f337c7 add zh readme 2024-04-02 20:58:45 +08:00
hiyouga f22eaeb5bc update examples 2024-04-02 20:51:21 +08:00
hiyouga 31ffbde24d update examples 2024-04-02 20:41:49 +08:00
hiyouga 11a6c1bad6 update readme 2024-04-02 20:37:37 +08:00
hiyouga 949e5fe638 update readme 2024-04-02 20:22:11 +08:00
hiyouga 92dab8a90b simplify readme 2024-04-02 20:07:43 +08:00
hiyouga b267aeb53f add moe aux loss control #3085 2024-04-02 14:26:31 +08:00
hiyouga 9ddbe2866a fix #3022 2024-04-02 13:58:39 +08:00
hiyouga a86ae17241 Update SECURITY.md 2024-04-01 23:30:03 +08:00
hiyouga dd73a0c248 set dev version 2024-04-01 23:24:08 +08:00
hiyouga 4a6ca621c0 fix #3083 2024-04-01 22:53:52 +08:00
hiyouga 54b7d34908 add qwen1.5 moe 2024-04-01 21:49:40 +08:00
hiyouga aee634cd20 fix #3077 2024-04-01 21:35:18 +08:00
hiyouga eb259cc573 support infer 4bit model on GPUs #3023 2024-04-01 17:34:04 +08:00
hiyouga d0842f6828 update webui 2024-04-01 16:23:28 +08:00
hiyouga 816d714146 fix ORPO loss 2024-04-01 14:42:41 +08:00
hiyouga 5b9b40403d fix IPO and ORPO loss 2024-04-01 14:37:53 +08:00
hiyouga 5907216a1c fix plots 2024-03-31 19:43:48 +08:00
hiyouga 68aaa4904b use log1p in orpo loss 
https://github.com/huggingface/trl/pull/1491
 2024-03-31 19:27:08 +08:00
hiyouga 099db6acc0 update readme 2024-03-31 18:46:34 +08:00
hoshi-hiyougaandGitHub a81d88b780 Merge pull request #3066 from hiyouga/orpo 
support ORPO
 2024-03-31 18:42:48 +08:00
hiyouga 5195add324 support orpo in webui 2024-03-31 18:34:59 +08:00
hiyouga 17bf8a2c3a support ORPO 2024-03-31 18:29:50 +08:00
hiyouga 27776c3474 tiny fix 2024-03-31 00:10:29 +08:00
hoshi-hiyougaandGitHub de3564ff70 Merge pull request #3057 from marko1616/bugfix/lora-model-merge 
Fix Llama model save for full param train
 2024-03-31 00:07:20 +08:00
hiyouga 7a086ed333 support save args in webui #2807 #3046 
some ideas are borrowed from @marko1616
 2024-03-30 23:09:12 +08:00
hoshi-hiyougaandGitHub 257f643a74 Merge pull request #3053 from lealaxy/main 
Fix pile dataset download config
 2024-03-30 20:41:43 +08:00
hiyouga 831c5321ac upgrade gradio to 4.21.0 2024-03-30 20:37:08 +08:00
hiyouga a0333bb0ce Update wechat.jpg 2024-03-29 16:55:53 +08:00
hiyouga ca793028c6 release v0.6.1 2024-03-29 11:36:08 +08:00
hiyouga c1fe6ce782 update readme 2024-03-28 22:02:32 +08:00
hiyouga 1e43319f9c add project 2024-03-28 20:24:27 +08:00
hiyouga 8d603f8820 fix #2982 2024-03-28 20:22:31 +08:00
hiyouga 6c94305e47 update readme 2024-03-28 18:35:11 +08:00
hiyouga b19c14870d fix #3010 2024-03-28 18:31:17 +08:00
hiyouga 8c77b10912 update trainers 2024-03-28 18:16:27 +08:00
hoshi-hiyouga 3bcd41b639 fix ds optimizer 2024-03-26 23:39:56 +08:00
hiyouga b29d5560f1 fix #2981 2024-03-26 17:53:04 +08:00
hiyouga 3164b4f11b fix bug 2024-03-26 17:30:12 +08:00
hiyouga 511f675402 fix #2961 2024-03-26 17:26:14 +08:00
hiyouga 7ea1a1f5b3 Update wechat.jpg 2024-03-26 16:24:42 +08:00
hiyouga ba70aca8fb release v0.6.0 (real) 2024-03-25 23:37:48 +08:00
hiyouga 98a42cbdaa tiny fix 2024-03-25 23:28:52 +08:00
hiyouga 7b3d8188f5 update readme 2024-03-25 23:06:13 +08:00
hoshi-hiyougaandGitHub f633ac6646 Merge pull request #2967 from Tsumugii24/main 
Update README_zh.md
 2024-03-25 23:02:22 +08:00
hiyouga 1484f76a95 add arg check 2024-03-25 22:42:58 +08:00
hiyouga 6f2b563f12 release v0.6.0 2024-03-25 22:38:56 +08:00
hoshi-hiyougaandGitHub f33a3dfadc Merge pull request #2963 from rkinas/patch-1 
Update requirements.txt
 2024-03-25 21:49:34 +08:00
hiyouga 558a538724 tiny fix 2024-03-25 21:18:08 +08:00
hoshi-hiyougaandGitHub 49f9dbb4b1 Merge pull request #2945 from marko1616/bugfix/lora-model-merge 
修复了在 transformers > 4.36.2 版本中部分模型合并 Lora 模型时因生成配置校验而导致的崩溃问题
 2024-03-25 13:36:08 +08:00
hiyouga 140ad4ad56 fix #2936 2024-03-24 00:43:21 +08:00
hiyouga 7afbc85dae fix #2928 2024-03-24 00:34:54 +08:00
hiyouga a1c8c98c5f fix #2941 2024-03-24 00:28:44 +08:00
hiyouga 564d57aa23 Update wechat.jpg 2024-03-22 14:00:37 +08:00
hoshi-hiyougaandGitHub ce261fdd64 Merge pull request #2919 from 0xez/main 
Update README.md, fix the release date of the paper
 2024-03-22 12:12:24 +08:00
hiyouga 96702620c4 move file 2024-03-21 17:05:17 +08:00
hiyouga 5eaa50fa01 add citation 2024-03-21 17:04:10 +08:00
hiyouga 0581bfdbc7 paper release 2024-03-21 13:49:17 +08:00
hiyouga bfe7a91289 update readme 2024-03-21 00:48:42 +08:00
hiyouga 8408225162 support fsdp + qlora 2024-03-21 00:36:06 +08:00
hiyouga 3271af2afc add orca_dpo_pairs dataset 2024-03-20 20:09:06 +08:00
hoshi-hiyougaandGitHub b2dfbd728f Merge pull request #2905 from SirlyDreamer/main 
Follow HF_ENDPOINT environment variable
 2024-03-20 18:09:54 +08:00
hiyouga 9bec3c98a2 fix #2777 #2895 2024-03-20 17:59:45 +08:00
hiyouga 7b8f502901 fix #2346 2024-03-20 17:56:33 +08:00
hoshi-hiyougaandGitHub a773035709 Merge pull request #2903 from khazic/main 
Updated README with new information
 2024-03-20 16:13:44 +08:00
hiyouga bea31b9b12 Update wechat.jpg 2024-03-18 16:48:32 +08:00
hiyouga 8e04794b2d fix packages 2024-03-17 22:32:03 +08:00
hiyouga 85c376fc1e fix patcher 2024-03-15 19:18:42 +08:00
hoshi-hiyougaandGitHub 113cc04719 Merge pull request #2849 from S3Studio/DockerizeSupport 
Improve Dockerize support
 2024-03-15 19:16:02 +08:00
hiyouga 6bc2c23b6d fix export 2024-03-15 15:06:30 +08:00
hiyouga 6ebde4f23e tiny fix 2024-03-14 21:19:06 +08:00
hiyouga 3b4a59bfb1 fix export 2024-03-14 18:17:01 +08:00
hiyouga 8172530d54 fix bug 2024-03-13 23:55:31 +08:00
hiyouga 714d936dfb fix bug 2024-03-13 23:43:42 +08:00
hiyouga 72367307df improve lora+ impl. 2024-03-13 23:32:51 +08:00
hoshi-hiyougaandGitHub 4e5e99af43 Merge pull request #2830 from qibaoyuan/lora_plus 
[FEATURE]: ADD LORA+ ALGORITHM
 2024-03-13 20:15:46 +08:00
hiyouga dfd451b722 Update wechat.jpg 2024-03-13 19:03:00 +08:00
hiyouga 0b4a5bf509 fix #2817 2024-03-13 12:42:03 +08:00
hiyouga b9f87cdc11 fix #2802 2024-03-13 12:33:45 +08:00
hiyouga 96ce76cd27 fix kv cache 2024-03-13 01:21:50 +08:00
hiyouga 19ef482649 support QDoRA 2024-03-12 22:12:42 +08:00
hiyouga 70a3052dd8 patch for gemma cpt 2024-03-12 21:21:54 +08:00
hiyouga 60cc17f3a8 fix plot issues 2024-03-12 18:41:35 +08:00
hiyouga b3247d6a16 support olmo 2024-03-12 18:30:38 +08:00