kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,273 Commits 1 Branch 0 Tags
860549b99b520ae9509559b18646f83fd95933b8
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hoshi-hiyougaandGitHub 860549b99b update hparam name 2024-04-26 02:49:39 +08:00
hoshi-hiyougaandGitHub 646a7885e7 delete llava template (use vicuna) 2024-04-26 02:20:47 +08:00
hoshi-hiyougaandGitHub fcfbd8c300 Merge pull request #3449 from hiyouga/mllm 
add webui backend option
 2024-04-25 20:58:16 +08:00
hiyouga b45939e139 add webui backend option 2024-04-25 20:49:23 +08:00
hiyouga 28571da80a vllm + lora support 2024-04-25 20:24:31 +08:00
hiyouga 8d66435664 fix #3374 2024-04-25 19:56:49 +08:00
hiyouga 3a7c1286ce add export_device in webui #3333 2024-04-25 19:02:32 +08:00
hiyouga aa16ff6205 update tool template 2024-04-25 00:21:34 +08:00
hiyouga 7fbe8add8f fix log level 2024-04-24 23:42:59 +08:00
hiyouga 297fb8ead3 support new special token #3420 2024-04-24 23:39:31 +08:00
hoshi-hiyougaandGitHub e5d23c053a fix phi template 2024-04-24 13:55:14 +08:00
hoshi-hiyougaandGitHub 4c71c314fb fix webchatmodel 2024-04-24 13:54:21 +08:00
hoshi-hiyougaandGitHub f36057ea03 fix inference in llamaboard 2024-04-24 13:53:39 +08:00
hiyouga 44a43ee152 add olmo 1.7 2024-04-24 05:50:50 +08:00
hiyouga 69eb03a8fe add dbrx and jamba models 2024-04-24 05:39:52 +08:00
hiyouga 73ff9c834b fix bug 2024-04-24 05:21:18 +08:00
hiyouga 8f44dce08a fix bug 2024-04-24 05:10:07 +08:00
hiyouga 667ce08b27 remove redundant code 2024-04-24 05:02:18 +08:00
hiyouga b1deb0a0b9 support unsloth generate 2024-04-24 04:46:53 +08:00
hiyouga aa2b79eb23 refactor patcher 2024-04-24 03:02:23 +08:00
hiyouga 07737a3d2d reenable sdpa and fast tok by default 2024-04-24 02:18:44 +08:00
hiyouga 707f0b1d5d fix #3347 #3387 2024-04-24 01:30:16 +08:00
hiyouga 1a13f05555 support phi-3 2024-04-24 00:28:53 +08:00
hiyouga 2efd9b6ba0 update examples 2024-04-23 18:29:46 +08:00
hiyouga 5722ada12b Update wechat.jpg 2024-04-23 17:12:33 +08:00
hiyouga db7f3b9784 update readme 2024-04-22 17:09:17 +08:00
hiyouga 836ca05586 update readme 2024-04-22 00:51:35 +08:00
hiyouga 34d66a3a85 update readme 2024-04-22 00:42:25 +08:00
hiyouga a1f1fac33b update readme and examples 2024-04-22 00:37:32 +08:00
hiyouga ddbd29d777 remove extras 2024-04-22 00:35:41 +08:00
hiyouga 1197513a16 Update wechat.jpg 2024-04-22 00:22:58 +08:00
hiyouga a83e7587a0 update readme 2024-04-22 00:21:01 +08:00
hiyouga 3e1bf8325c set dev version 2024-04-21 23:14:30 +08:00
hiyouga e0d6b72d56 release v0.6.3 2024-04-21 23:13:23 +08:00
hiyouga 4469a3237d fix #3366 2024-04-21 21:34:25 +08:00
hiyouga fbbe0dba2f fix optimizers 2024-04-21 20:40:54 +08:00
hiyouga a1d31ffc8c fix #3365 2024-04-21 19:20:18 +08:00
hiyouga 5c62881c5a fix bug in galore optimizer 2024-04-21 18:53:22 +08:00
hiyouga f58425ab45 fix mod stuff 2024-04-21 18:11:10 +08:00
hoshi-hiyougaandGitHub d0273787be Merge pull request #3338 from astramind-ai/main 
Adding Mixture of Depth
 2024-04-21 18:05:52 +08:00
hoshi-hiyouga 1fa287fd63 fix #3348 2024-04-20 10:34:09 +08:00
hiyouga 6339edefff add dpo mix dataset 2024-04-20 01:31:38 +08:00
hiyouga ba559a659a fix #3352 2024-04-19 22:40:01 +08:00
hiyouga 14a605a2da fix llama3 template 2024-04-19 15:46:51 +08:00
hoshi-hiyouga 2aaaede247 support llama3 2024-04-19 01:13:50 +08:00
hiyouga 942362d008 fix #3324 2024-04-18 15:34:45 +08:00
hiyouga 3b43a3b7c5 tiny fix 2024-04-18 00:22:17 +08:00
hiyouga e2f1c6fc6a update readme 2024-04-17 23:40:49 +08:00
hiyouga cab0598fd0 add mixtral 8x22B models 2024-04-17 23:35:59 +08:00
hiyouga 5f86053d75 add CodeQwen models 2024-04-17 23:27:22 +08:00
hiyouga c9a477322d fix #3316 2024-04-17 22:54:34 +08:00
hiyouga 6d641af703 fix #3317 2024-04-17 22:17:19 +08:00
hiyouga e3ca57602c Update wechat.jpg 2024-04-17 21:14:37 +08:00
hiyouga 278c5e10c4 lint 2024-04-16 18:21:09 +08:00
hoshi-hiyougaandGitHub aa3206ec26 Merge pull request #3291 from codemayq/main 
support for previewing custom dataset in directory format
 2024-04-16 18:12:09 +08:00
hiyouga c00f0771a5 Update parser.py 2024-04-16 18:09:31 +08:00
hiyouga 5d62a51c12 update readme and gradio version 2024-04-16 18:09:16 +08:00
hiyouga e3d8fc75eb support badam for all stages 2024-04-16 17:44:48 +08:00
hoshi-hiyougaandGitHub 4d660c5ade Merge pull request #3287 from Ledzy/badam 
[Feature] Add BAdam algorithm
 2024-04-16 17:32:16 +08:00
hoshi-hiyougaandGitHub c9828f4c6e Update utils.py 2024-04-16 17:30:12 +08:00
hoshi-hiyougaandGitHub 6700a1b9fa Update trainer.py 2024-04-16 17:29:52 +08:00
hoshi-hiyougaandGitHub 38a56706e0 Update utils.py 2024-04-16 17:29:30 +08:00
hoshi-hiyougaandGitHub a950f3b81d Update patcher.py 2024-04-16 17:29:19 +08:00
hoshi-hiyougaandGitHub 750cdf2e74 Update adapter.py 2024-04-16 17:28:12 +08:00
hoshi-hiyougaandGitHub 4660703674 Update parser.py 2024-04-16 17:27:25 +08:00
hoshi-hiyougaandGitHub 5b59ff4212 Update parser.py 2024-04-16 17:27:02 +08:00
hoshi-hiyougaandGitHub ec899cccf3 Update finetuning_args.py 2024-04-16 17:26:30 +08:00
hoshi-hiyougaandGitHub 57dcd91e17 Update sft.sh 2024-04-16 17:25:40 +08:00
hoshi-hiyougaandGitHub 50ced257e0 Update requirements.txt 2024-04-16 17:10:17 +08:00
hoshi-hiyougaandGitHub f4b4a26c64 Update setup.py 2024-04-16 17:10:02 +08:00
hiyouga b3ac14ffc4 add empty template 2024-04-16 03:10:02 +08:00
hiyouga cf52911fed update readme 2024-04-16 02:36:54 +08:00
hiyouga 6084eb7cf1 update readme 2024-04-16 02:35:36 +08:00
hiyouga 7dc72fb58c support unsloth 2024.4 2024-04-16 00:25:03 +08:00
hiyouga 6543f3d449 add codegemma 2024-04-16 00:11:15 +08:00
hiyouga e0dbac2845 support cohere commandR #3184 2024-04-15 23:26:42 +08:00
hoshi-hiyougaandGitHub 7a8ae3f4ac Merge pull request #3254 from marko1616/feature/Add-support-for-CohereForAI/c4ai-command-r-plus 
Add template&support for c4ai-command-r/plus (tested)
 2024-04-15 22:59:35 +08:00
hoshi-hiyougaandGitHub 3ccf0d0977 Update template.py 2024-04-15 22:58:01 +08:00
hoshi-hiyougaandGitHub 268f53dddb Update constants.py 2024-04-15 22:56:55 +08:00
hiyouga cce52351b5 update examples 2024-04-15 22:14:34 +08:00
hoshi-hiyougaandGitHub 09735ed30c Merge pull request #3261 from khazic/main 
Added specimens for single-card full parameter prediction
 2024-04-15 16:30:57 +08:00
hoshi-hiyougaandGitHub 0e0942d388 Merge pull request #3276 from liu-zichen/fix_mixtral 
fix: turn on output_router_logits of mixtral
 2024-04-15 15:38:16 +08:00
hiyouga efc345c4b0 fix #3273 2024-04-15 15:32:58 +08:00
hiyouga d1fb6c72b5 fix #3247 2024-04-12 17:41:33 +08:00
hiyouga c53a11b6fd fix model card 2024-04-12 17:11:59 +08:00
hiyouga 232642a621 fix #3238 2024-04-12 14:28:11 +08:00
hiyouga f2ba59352e Update wechat.jpg 2024-04-12 14:15:45 +08:00
hiyouga 3dfe4cf611 set dev version 2024-04-11 20:27:34 +08:00
hiyouga 9d4c949461 release v0.6.2 2024-04-11 20:08:51 +08:00
hiyouga 51d0a1a19e Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory 2024-04-10 23:58:18 +08:00
hiyouga a99f5ed0b6 fix #3225 2024-04-10 23:57:59 +08:00
hoshi-hiyougaandGitHub caf8373c2d Merge pull request #3201 from kno10/patch-1 and fix #3200 
Pass additional_target to unsloth
 2024-04-10 00:58:48 +08:00
hoshi-hiyougaandGitHub 98bc97d8d2 Update adapter.py 2024-04-10 00:57:51 +08:00
hoshi-hiyougaandGitHub 2111b586b6 Update adapter.py 2024-04-10 00:57:30 +08:00
hiyouga 7f6c2486b8 fix quant infer and qwen2moe 2024-04-09 17:12:59 +08:00
hiyouga 9a99fbc86d tiny fix 2024-04-08 21:28:39 +08:00
hoshi-hiyougaandGitHub 4c6c4a0d88 Merge pull request #3161 from hiyouga/feature/add-mediatek-model 
support Breeze-7B
 2024-04-08 20:56:51 +08:00
hiyouga 98ad2ccd8f Merge branch 'main' of https://github.com/hiyouga/LLaMA-Factory 2024-04-08 19:59:24 +08:00
hiyouga e79e1532fa Update wechat.jpg 2024-04-08 19:59:07 +08:00
hoshi-hiyougaandGitHub ff4d313a50 Merge pull request #3160 from sliderSun/main 
support Qwen1.5-32B
 2024-04-07 18:00:40 +08:00