kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,139 Commits 1 Branch 0 Tags
f0b930d94a31ed46a605b3e8e3d989fdc344e61b
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hoshi-hiyougaandGitHub f0b930d94a fix webui 2024-09-19 02:13:39 +08:00
hoshi-hiyougaandGitHub 92ef62f502 add qwen2.5 models 2024-09-19 02:07:54 +08:00
hoshi-hiyougaandGitHub 1a3e6545b2 Merge pull request #5438 from aliencaocao/patch-1 
Add qwen_vl to liger kernel supported list
 2024-09-16 13:40:02 +08:00
hoshi-hiyougaandGitHub a76617728a Merge pull request #5427 from HardAndHeavy/update-rocm 
Update the ROCm version to 6.2
 2024-09-13 10:25:47 +08:00
hoshi-hiyougaandGitHub 8eac1b929f Merge pull request #5388 from yzoaim/cal_mfu_update 
update cal_mfu.py
 2024-09-08 00:49:28 +08:00
hoshi-hiyougaandGitHub 842c5455b0 fix 2024-09-08 00:41:45 +08:00
hoshi-hiyougaandGitHub e71133cab1 Update cal_mfu.py 2024-09-08 00:39:48 +08:00
hoshi-hiyougaandGitHub 36665f3001 fix #5384 2024-09-07 01:21:14 +08:00
hoshi-hiyougaandGitHub 1274356263 Merge pull request #5372 from LDLINGLINGLING/main 
增加了对minicpm3.0的适配'
 2024-09-05 21:35:42 +08:00
hoshi-hiyougaandGitHub e9bda48c6d fix #5366 2024-09-05 18:08:09 +08:00
hoshi-hiyougaandGitHub 46b1765d03 Merge pull request #5365 from hiyouga/video_finetuning 
Support Qwen2-VL Fine-Tuning on Video Datasets
 2024-09-05 02:24:58 +08:00
hoshi-hiyougaandGitHub 8f441c2b3a Merge pull request #5323 from naem1023/feat/add-dataset-map-batch-size-argument 
Add batch size of map function in the preprocessed dataset
 2024-09-04 22:09:36 +08:00
hoshi-hiyougaandGitHub 44d6947e55 fix #5228 2024-09-04 19:10:30 +08:00
hoshi-hiyougaandGitHub ce7ed6eb99 Merge pull request #5346 from hiyouga/lazy_image 
[exp] Lazyload for multimodal inputs
 2024-09-04 03:00:53 +08:00
hoshi-hiyougaandGitHub 99fd9637bd fix trainer predict 2024-09-02 10:15:29 +08:00
hoshi-hiyougaandGitHub a6c6750e8a remove .cpu() 2024-09-02 10:10:53 +08:00
hoshi-hiyougaandGitHub 6f9e455af4 Merge pull request #5317 from ByronHsu/patch-1 
Add liger kernel link
 2024-09-01 23:30:12 +08:00
hoshi-hiyougaandGitHub 727e184840 Merge pull request #5290 from simonJJJ/qwen2_vl 
support qwen2-vl
 2024-08-30 02:10:36 +08:00
hoshi-hiyougaandGitHub a8f22d8895 fix bug 2024-08-30 02:05:26 +08:00
hoshi-hiyougaandGitHub dbe886ae5c Merge pull request #5237 from marko1616/patch-1 
Fix mllm api
 2024-08-27 12:24:43 +08:00
hoshi-hiyougaandGitHub 36039b0fe0 Merge pull request #5230 from MengqingCao/image 
[NPU] Update npu base image
 2024-08-21 22:13:07 +08:00
hoshi-hiyougaandGitHub 15be296347 Merge pull request #5156 from YeQiuO/main 
fix Llama-template's system prompt bug
 2024-08-20 00:09:03 +08:00
hoshi-hiyougaandGitHub ec72eeca52 Update template.py 2024-08-20 00:03:33 +08:00
hoshi-hiyougaandGitHub da335d42c3 Merge pull request #5163 from liu-zichen/fix_ppo_optim 
fix lr not change
 2024-08-19 23:56:24 +08:00
hoshi-hiyougaandGitHub f59c9bef31 Merge pull request #5185 from chenhuiyu/feature/add-sailorllm-template 
Add SailorLLM template
 2024-08-19 23:51:49 +08:00
hoshi-hiyougaandGitHub d39f4a62d3 Merge pull request #5188 from Zxilly/main 
fix: report correct device count for intel xpu
 2024-08-19 23:51:39 +08:00
hoshi-hiyougaandGitHub 5d5bfc83e6 Merge pull request #5193 from Ricardo-L-C/main 
_is_bf16_available judgment supports npu
 2024-08-19 23:40:59 +08:00
hoshi-hiyougaandGitHub 5f3300ec5d Update template.py 2024-08-19 23:40:16 +08:00
hoshi-hiyougaandGitHub ef482394f0 Merge pull request #5095 from relic-yuexi/feat-optimizer 
Feat optimizer
 2024-08-09 19:51:33 +08:00
hoshi-hiyougaandGitHub 51542cb15f Merge pull request #5115 from YeQiuO/main 
fix: `Train on the last turn only` truncate bug
 2024-08-09 17:58:27 +08:00
hoshi-hiyougaandGitHub 984961c550 Merge pull request #5072 from relic-yuexi/main 
fix the deepseekcoder template to avoid repeat problem
 2024-08-09 16:35:21 +08:00
hoshi-hiyougaandGitHub 4f62e1cb24 Update template.py 2024-08-09 16:27:42 +08:00
hoshi-hiyougaandGitHub c2921b9960 Merge pull request #5037 from codemayq/feature-gemma-2-2b 
support gemma-2-2b
 2024-08-05 23:27:37 +08:00
hoshi-hiyougaandGitHub cd420c1938 Merge pull request #5010 from Eruly/main 
Add Korean web UI (llamafactory-cli webui)
 2024-07-30 01:55:54 +08:00
hoshi-hiyougaandGitHub 06e17eb462 Merge pull request #4996 from LDLINGLINGLING/main 
增加了MiniCPM在页面首页的支持列表，MiniCPM官方github也放了LLama_factory的友情链接
 2024-07-30 01:55:30 +08:00
hoshi-hiyougaandGitHub 3a49c76b65 Update README_zh.md 2024-07-30 01:55:13 +08:00
hoshi-hiyougaandGitHub 9e409eadb0 Update README.md 2024-07-30 01:53:19 +08:00
hoshi-hiyougaandGitHub 8d5a41f2cd Update README.md 2024-07-30 01:52:35 +08:00
hoshi-hiyougaandGitHub daa62db06f Merge pull request #4995 from codemayq/fix-pissa 
fix pissa callback
 2024-07-30 01:47:25 +08:00
hoshi-hiyougaandGitHub 8a2846cfe1 Merge pull request #4892 from piamo/main 
update deepseek template
 2024-07-26 11:49:34 +08:00
hoshi-hiyougaandGitHub 9839c6d1f6 Merge pull request #4950 from liuwwang/main and fi 
fix: Repair the issue where quantization failed after merging the adapter.
 2024-07-26 11:48:56 +08:00
hoshi-hiyougaandGitHub b8896b9b8b Merge pull request #4970 from HardAndHeavy/add-rocm 
Add ROCm support
 2024-07-26 11:41:23 +08:00
hoshi-hiyougaandGitHub 3c424cf69a Merge pull request #4961 from khazic/main 
Added the reference address for TRL PPO details.
 2024-07-26 11:32:29 +08:00
hoshi-hiyougaandGitHub 77e7bfee79 Update README_zh.md 2024-07-26 11:30:57 +08:00
hoshi-hiyougaandGitHub 1186ad53d4 Update README.md 2024-07-26 11:29:28 +08:00
hoshi-hiyougaandGitHub f97beca23a Update README.md 2024-07-26 11:29:09 +08:00
hoshi-hiyougaandGitHub 71d3e60713 Update README_zh.md 2024-07-24 21:08:42 +08:00
hoshi-hiyougaandGitHub 5626bdc56d Update README.md 2024-07-24 21:07:14 +08:00
hoshi-hiyougaandGitHub 26082fc6c9 fix #4917 2024-07-22 11:28:31 +08:00
hoshi-hiyougaandGitHub 2516763d69 Merge pull request #4878 from ly863/main 
Train the last turing conversation.
 2024-07-18 22:03:41 +08:00
hoshi-hiyougaandGitHub f2aaebdbde Merge pull request #4822 from codemayq/test-ci 
add github action check to ignore some test cases
 2024-07-15 23:07:55 +08:00
hoshi-hiyougaandGitHub 10289eab15 Update test_template.py 2024-07-15 23:04:39 +08:00
hoshi-hiyougaandGitHub da990f76b8 Update test_template.py 2024-07-15 23:00:27 +08:00
hoshi-hiyougaandGitHub 38bc411d42 Merge pull request #4821 from codemayq/feature-eval-split 
add "split" as suffix in eval task name
 2024-07-15 22:59:44 +08:00
hoshi-hiyougaandGitHub 91ba083f37 Update llama3_lora_eval.yaml 2024-07-15 22:55:12 +08:00
hoshi-hiyougaandGitHub 33420bab81 Update test_template.py 2024-07-15 22:55:05 +08:00
hoshi-hiyougaandGitHub 52a4256ad9 Update test_template.py 2024-07-15 22:52:25 +08:00
hoshi-hiyougaandGitHub 15b399a82f Merge pull request #4691 from codemayq/feature-suppot-eval-dataset 
add eval dataset support
 2024-07-15 01:00:34 +08:00
hoshi-hiyougaandGitHub cba673f491 Update data_args.py 2024-07-15 00:56:03 +08:00
hoshi-hiyougaandGitHub df52fb05b1 Update preprocess.py 2024-07-15 00:55:36 +08:00
hoshi-hiyougaandGitHub 84e4047f8a Update parser.py 2024-07-15 00:55:21 +08:00
hoshi-hiyougaandGitHub 97a0e291c7 Update data_utils.py 2024-07-15 00:54:34 +08:00
hoshi-hiyougaandGitHub a5b809516e Update loader.py 2024-07-15 00:50:06 +08:00
hoshi-hiyougaandGitHub 3d39d74003 Update parser.py 2024-07-14 23:04:34 +08:00
hoshi-hiyougaandGitHub 9d64507bd5 Update README.md 2024-07-14 21:27:04 +08:00
hoshi-hiyougaandGitHub 5da54deb50 Merge pull request #4781 from hzhaoy/fix-dockerfile-cuda 
Fix cuda Dockerfile
 2024-07-13 22:25:32 +08:00
hoshi-hiyougaandGitHub 32699a82a6 Merge pull request #4804 from codemayq/fix-examples 
tiny fix of examples
 2024-07-13 20:49:13 +08:00
hoshi-hiyougaandGitHub f618b80fa2 Update llava1_5.yaml 2024-07-13 20:30:06 +08:00
hoshi-hiyougaandGitHub 555194e150 Merge pull request #4700 from marko1616/patch-1 
Fix Windows command preview
 2024-07-10 13:51:50 +08:00
hoshi-hiyougaandGitHub 40c3b88b68 Merge pull request #4746 from yzoaim/fix 
fix src/llamafactory/train/callbacks.py
 2024-07-10 13:32:49 +08:00
hoshi-hiyougaandGitHub 39cd89ce17 Update callbacks.py 2024-07-10 13:32:20 +08:00
hoshi-hiyougaandGitHub 563a27dab7 Merge pull request #4706 from T-Atlas/main 
chore: Update vllm_engine.py to support vllm version >= 0.5.1
 2024-07-07 15:50:38 +08:00
hoshi-hiyougaandGitHub f84b007ebb Update packages.py 2024-07-07 15:48:29 +08:00
hoshi-hiyougaandGitHub 07d96d497c Merge pull request #4673 from hzhaoy/main 
tiny fix
 2024-07-04 10:40:41 +08:00
hoshi-hiyougaandGitHub 87d9b2d005 Merge pull request #4224 from chuan298/main 
Implement efficient packing without cross-contamination attention
 2024-07-04 01:18:54 +08:00
hoshi-hiyougaandGitHub a36e8f2dd5 Update packing.py 2024-07-03 23:36:01 +08:00
hoshi-hiyougaandGitHub 3449c3531f Merge pull request #4662 from wzh1994/wzh/readme 
Add `LazyLLM` to `Projects using LLaMA Factory` in `README.md`
 2024-07-03 15:51:02 +08:00
hoshi-hiyougaandGitHub 4e4b3cc905 Merge pull request #4651 from hzhaoy/add-telechat-1b 
Add TeleChat-1B
 2024-07-02 17:56:43 +08:00
hoshi-hiyougaandGitHub e8e6af2651 Merge branch 'main' into main 2024-07-01 21:01:09 +08:00
hoshi-hiyougaandGitHub ef38daa0a4 Merge pull request #4580 from hzhaoy/bugfix-deepspeed-pissa 
Fix bug when using pissa method with deepspeed
 2024-06-28 00:46:51 +08:00
hoshi-hiyougaandGitHub 33ef6f4ec2 Merge pull request #4590 from injet-zhou/main 
Exit the process with the subprocess's return code when utilizing the CLI
 2024-06-27 20:09:36 +08:00
hoshi-hiyougaandGitHub 64b131dcfa Merge pull request #4461 from hzhaoy/feature/support-flash-attn 
support flash-attn in Dockerfile
 2024-06-27 20:05:26 +08:00
hoshi-hiyougaandGitHub a6bf74c0c9 Merge pull request #4561 from hashstone/fix-docker-npu 
fix torch-npu dependency
 2024-06-27 19:58:16 +08:00
hoshi-hiyougaandGitHub 5fcd33fd4f Update Dockerfile 2024-06-27 19:57:40 +08:00
hoshi-hiyougaandGitHub 9624af1df3 Update Dockerfile 2024-06-27 19:51:25 +08:00
hoshi-hiyougaandGitHub 569f03ca1a Update setup.py 2024-06-27 19:38:15 +08:00
hoshi-hiyougaandGitHub fc7a08e16a Update README_zh.md 2024-06-27 19:17:52 +08:00
hoshi-hiyougaandGitHub 06536c44d4 Update README.md 2024-06-27 19:17:35 +08:00
hoshi-hiyougaandGitHub 03389207f4 Update setup.py 2024-06-27 19:16:46 +08:00
hoshi-hiyougaandGitHub 82d0b46bc9 Merge pull request #4544 from MengqingCao/npu 
fix docker-compose path
 2024-06-26 10:19:24 +08:00
hoshi-hiyougaandGitHub d0f953bf5b Merge pull request #4352 from Ledzy/main 
[Enhancement] Support ZeRO-3 when using BAdam
 2024-06-25 01:49:13 +08:00
hoshi-hiyougaandGitHub d0e6059902 Merge pull request #4355 from MengqingCao/npu 
Add docker-npu
 2024-06-25 01:07:43 +08:00
hoshi-hiyougaandGitHub ec95f942d1 Update README_zh.md 2024-06-25 01:06:59 +08:00
hoshi-hiyougaandGitHub 5dc8fa647e Update README.md 2024-06-25 01:03:38 +08:00
hoshi-hiyougaandGitHub 721acd8768 Update docker-compose.yml 2024-06-25 00:54:28 +08:00
hoshi-hiyougaandGitHub 3af936a76d Update Dockerfile 2024-06-25 00:50:34 +08:00
hoshi-hiyougaandGitHub 15608d0558 Update docker-compose.yml 2024-06-25 00:46:47 +08:00
hoshi-hiyougaandGitHub fce146ab68 Update Dockerfile 2024-06-25 00:46:08 +08:00
hoshi-hiyougaandGitHub dcc2e24f5c Update Dockerfile 2024-06-24 23:41:35 +08:00
hoshi-hiyougaandGitHub 3bed18c644 Merge pull request #4409 from kno10/patch-2 
Print help if no arguments given
 2024-06-24 23:21:31 +08:00