kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,783 Commits 1 Branch 0 Tags
41086059b12ecb7827eb390294e315068ff9c2e6
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
hoshi-hiyougaandGitHub d0e6059902 Merge pull request #4355 from MengqingCao/npu 
Add docker-npu
 2024-06-25 01:07:43 +08:00
hoshi-hiyougaandGitHub ec95f942d1 Update README_zh.md 2024-06-25 01:06:59 +08:00
hoshi-hiyougaandGitHub 5dc8fa647e Update README.md 2024-06-25 01:03:38 +08:00
hoshi-hiyougaandGitHub 721acd8768 Update docker-compose.yml 2024-06-25 00:54:28 +08:00
hoshi-hiyougaandGitHub 3af936a76d Update Dockerfile 2024-06-25 00:50:34 +08:00
hoshi-hiyougaandGitHub 15608d0558 Update docker-compose.yml 2024-06-25 00:46:47 +08:00
hoshi-hiyougaandGitHub fce146ab68 Update Dockerfile 2024-06-25 00:46:08 +08:00
hoshi-hiyougaandGitHub dcc2e24f5c Update Dockerfile 2024-06-24 23:41:35 +08:00
hoshi-hiyougaandGitHub 3bed18c644 Merge pull request #4409 from kno10/patch-2 
Print help if no arguments given
 2024-06-24 23:21:31 +08:00
hoshi-hiyougaandGitHub acb61f7ab7 Update cli.py 2024-06-24 23:21:10 +08:00
hoshi-hiyougaandGitHub def6d280db Merge pull request #4417 from mMrBun/main 
Add tool_format parameter to rewrite templates for different function call formats.
 2024-06-24 23:17:55 +08:00
hoshi-hiyougaandGitHub 672152d2ce Update test_formatter.py 2024-06-24 23:14:36 +08:00
hoshi-hiyougaandGitHub 1240bd57d8 Update template.py 2024-06-24 23:12:59 +08:00
hoshi-hiyougaandGitHub dddfd516ee Update loader.py 2024-06-24 23:06:18 +08:00
hoshi-hiyougaandGitHub e0014db7d2 Merge pull request #4445 from MengqingCao/label 
auto-label npu issue
 2024-06-24 22:02:05 +08:00
hoshi-hiyougaandGitHub 80d1910a93 Update label_issue.yml 2024-06-24 22:01:23 +08:00
hoshi-hiyougaandGitHub aa60cd8910 Update label_issue.yml 2024-06-24 21:59:39 +08:00
hoshi-hiyougaandGitHub cc452c32c7 Merge pull request #4446 from stceum/bug-fix 
Bug Fix: `off` is parsed as `False` in yaml file
 2024-06-24 21:41:28 +08:00
hoshi-hiyougaandGitHub e90c424f55 Update parser.py 2024-06-24 21:37:42 +08:00
hoshi-hiyougaandGitHub a9b3d91952 Update test_attention.py 2024-06-24 21:35:34 +08:00
hoshi-hiyougaandGitHub a459624474 Merge pull request #4382 from MengqingCao/bugfix 
upper bound numpy version to <2.0
 2024-06-20 10:19:37 +08:00
hoshi-hiyougaandGitHub c0ca42566c Merge pull request #4173 from mMrBun/main 
Implemented the tool_formatter and tool_extractor for glm4 and Qwen2 tool_format
 2024-06-19 03:18:55 +08:00
hoshi-hiyougaandGitHub 89a50dbfde Merge pull request #4314 from EliMCosta/patch-2 
Fix Dockerfile
 2024-06-18 23:30:59 +08:00
hoshi-hiyougaandGitHub 10316dd8ca Merge pull request #4309 from EliMCosta/patch-1 
Add Magpie and Webinstruct dataset samples
 2024-06-18 23:30:19 +08:00
hoshi-hiyougaandGitHub 078040babd Merge pull request #4334 from zzxzz12345/bugfix/add-pandas-versions 
Update requirements.txt
 2024-06-18 22:30:35 +08:00
hoshi-hiyougaandGitHub e8c518c08a Update requirements.txt 2024-06-18 22:27:24 +08:00
hoshi-hiyougaandGitHub 29c1f31baa Update parser.py 2024-06-16 02:57:00 +08:00
hoshi-hiyougaandGitHub b7b5892a34 Merge pull request #4307 from hiyouga/pissa 
Support pissa
 2024-06-16 01:41:50 +08:00
hoshi-hiyougaandGitHub 1f23f25226 Merge pull request #4246 from hzhaoy/adapt-vllm-v0.5.0 
adapt vllm==0.5.0
 2024-06-13 01:54:02 +08:00
hoshi-hiyougaandGitHub 656b2bbdaf Merge pull request #4234 from kimdwkimdw/patch-1 
Support vllm==0.5.0
 2024-06-12 16:39:09 +08:00
hoshi-hiyougaandGitHub 9049aab911 Merge pull request #4204 from dignfei/main 
fixbug：llama3在增量预训练时应该使用<|end_of_text|>标识文本的结束
 2024-06-11 17:06:10 +08:00
hoshi-hiyougaandGitHub 0c29233237 Update pretrain.py 2024-06-11 17:02:14 +08:00
hoshi-hiyougaandGitHub 796699f867 Merge pull request #4191 from iamthebot/al--add_manifest_for_reqs 
Add MANIFEST.in so requirements.txt is present in sdist
 2024-06-11 10:41:15 +08:00
hoshi-hiyougaandGitHub ef4afdaf0e Merge pull request #4167 from yzoaim/branch 
fix README
 2024-06-10 16:24:33 +08:00
hoshi-hiyougaandGitHub cfd62283a9 fix #4139 2024-06-08 00:45:02 +08:00
hoshi-hiyougaandGitHub 181dbb0d05 Merge pull request #4009 from AlongWY/main 
supervised packing with greedy knapsack algorithm
 2024-06-07 03:48:46 +08:00
hoshi-hiyougaandGitHub c09ad8bab3 Update supervised.py 2024-06-07 03:42:08 +08:00
hoshi-hiyougaandGitHub 788e8232fc Update supervised.py 2024-06-07 03:38:23 +08:00
hoshi-hiyougaandGitHub 8cecade708 Update supervised.py 2024-06-07 03:38:04 +08:00
hoshi-hiyougaandGitHub 55c18c49b0 Merge pull request #4082 from MengqingCao/bugfix 
Fix #4077
 2024-06-06 23:38:40 +08:00
hoshi-hiyougaandGitHub 751dd77bc0 Update cli.py 2024-06-06 23:38:09 +08:00
hoshi-hiyougaandGitHub f2580ad403 Merge pull request #4066 from injet-zhou/main 
add throughput entry to training log
 2024-06-06 03:32:04 +08:00
hoshi-hiyougaandGitHub ca459f67eb Merge pull request #4080 from MengqingCao/npu 
Add npu option for model exporting
 2024-06-06 03:15:44 +08:00
hoshi-hiyougaandGitHub feaee36c46 Update export.py 2024-06-06 03:14:46 +08:00
hoshi-hiyougaandGitHub af2c3cbee4 Update model_args.py 2024-06-06 03:14:23 +08:00
hoshi-hiyougaandGitHub 0e740aa463 Merge pull request #4053 from hzhaoy/feature/add_select_config_file 
Support selecting saved configuration files
 2024-06-06 03:06:03 +08:00
hoshi-hiyougaandGitHub ae18e1e251 Merge pull request #3987 from injet-zhou/main 
Fix cann't interrupt training when using multi GPUs in webui
 2024-06-04 00:04:07 +08:00
hoshi-hiyougaandGitHub 30a538e2db Merge pull request #4045 from enji-zhou/feature/add_kto 
fix KTO Trainer Sampler
 2024-06-03 22:09:25 +08:00
hoshi-hiyougaandGitHub 24499f40dc Update trainer.py 2024-06-03 22:08:38 +08:00
hoshi-hiyougaandGitHub 0f01500b68 Merge pull request #4006 from Uminosachi/scheduler-kwargs 
Set scheduler_specific_kwargs to get_scheduler
 2024-06-03 19:27:53 +08:00
hoshi-hiyougaandGitHub d359dd2de4 Merge pull request #4011 from statelesshz/issue-template 
Update bug-report.yml
 2024-06-03 19:20:43 +08:00
hoshi-hiyougaandGitHub 1539c72b94 Merge pull request #4007 from xu-song/patch-3 
Update model_args.py
 2024-06-03 18:54:37 +08:00
hoshi-hiyouga 2f38c1f5fd Update wechat.jpg 2024-05-30 12:48:47 +08:00
hoshi-hiyougaandGitHub 483eb47e5d Merge pull request #3829 from seanzhang-zhichen/add_dataset_sample_num 
Add dataset sample num
 2024-05-30 00:25:45 +08:00
hoshi-hiyougaandGitHub ca5dd7c6c1 Update loader.py 2024-05-30 00:20:20 +08:00
hoshi-hiyougaandGitHub f9a88b89ca Update loader.py 2024-05-30 00:17:21 +08:00
hoshi-hiyougaandGitHub b55fb611c5 Update loader.py 2024-05-30 00:12:12 +08:00
hoshi-hiyougaandGitHub 51dd454337 Update parser.py 2024-05-30 00:05:20 +08:00
hoshi-hiyougaandGitHub c8ae7e0e65 Update README_zh.md 2024-05-30 00:04:47 +08:00
hoshi-hiyougaandGitHub 3761d7d5dd Update README.md 2024-05-30 00:04:26 +08:00
hoshi-hiyougaandGitHub 880b4a9acf Merge pull request #3930 from MengqingCao/npu 
Add Ascend npu doc and dependency
 2024-05-29 18:33:38 +08:00
hoshi-hiyougaandGitHub bcddd5b066 Merge pull request #3958 from hzhaoy/add_telechat_12b_support 
add TeleChat-12B/TeleChat-12B-v2 models
 2024-05-29 17:20:53 +08:00
hoshi-hiyougaandGitHub 50912484d3 Merge pull request #3925 from Yimi81/feat-fix-yi-template 
fix yi template
 2024-05-27 22:59:32 +08:00
hoshi-hiyougaandGitHub 87ea0a8bcd Merge pull request #3921 from gusye1234/main 
Add openchat-3.6-8B support
 2024-05-27 20:52:37 +08:00
hoshi-hiyougaandGitHub f1002b9f93 Update template.py 2024-05-27 20:51:56 +08:00
hoshi-hiyougaandGitHub 122213a7a7 Update template.py 2024-05-27 20:51:26 +08:00
hoshi-hiyougaandGitHub 838f2fb3e4 Merge pull request #3835 from BUAADreamer/main 
fix some features in llava-style training
 2024-05-27 20:23:45 +08:00
hoshi-hiyougaandGitHub a506f3628b Merge pull request #3876 from dongdongqiang2018/main 
added adapted to 910B image
 2024-05-24 01:54:30 +08:00
hoshi-hiyougaandGitHub aa0bca49e9 Merge pull request #3812 from ycjcl868/feat/chat-support-system-prompt 
feat: cli chat support system_message
 2024-05-20 00:31:32 +08:00
hoshi-hiyougaandGitHub a0e8d3d159 Update vllm_engine.py 2024-05-20 00:31:04 +08:00
hoshi-hiyougaandGitHub a943a1034b Update hf_engine.py 2024-05-20 00:30:45 +08:00
hoshi-hiyougaandGitHub a1fa7aa63b Update generating_args.py 2024-05-20 00:29:31 +08:00
hoshi-hiyougaandGitHub 896c656185 Update chat_model.py 2024-05-20 00:29:12 +08:00
hoshi-hiyougaandGitHub 73d4a8e655 Merge pull request #3799 from hiyouga/dev 
improve KTO impl, replace datasets
 2024-05-18 03:49:13 +08:00
hoshi-hiyougaandGitHub 33a354548e Merge pull request #3785 from enji-zhou/feature/add_kto 
add kto
 2024-05-18 03:07:18 +08:00
hoshi-hiyougaandGitHub d7ff49f245 Merge pull request #3794 from jue-jue-zi/main 
feat: pass the `max_lora_rank` parameter to vLLM backend
 2024-05-17 16:17:30 +08:00
hoshi-hiyougaandGitHub 9646727453 Update model_args.py 2024-05-17 16:16:41 +08:00
hiyouga 3df986c679 fix examples #3769 2024-05-16 19:12:09 +08:00
hiyouga 308edbc426 rename package 2024-05-16 18:39:08 +08:00
hiyouga b2fc7aeb03 set dev version 2024-05-16 02:17:31 +08:00
hiyouga 1c910079d8 release v0.7.1 2024-05-16 00:57:16 +08:00
hiyouga 2a67ab3925 fix #3694 2024-05-16 00:35:28 +08:00
hiyouga 44cfa9a1cd fix #3606 
https://github.com/huggingface/peft/pull/1706
 2024-05-15 23:05:02 +08:00
hiyouga a388cadfc0 add Yi-VL-34B model 2024-05-15 22:58:19 +08:00
hiyouga 73845fcc46 add yi-vl 6b model 2024-05-15 20:02:41 +08:00
hiyouga 51d61fcc89 fix yi vl vllm infer 2024-05-15 19:25:48 +08:00
hiyouga e1f4e53915 add NPU docker images 2024-05-15 19:20:11 +08:00
hoshi-hiyougaandGitHub 75f405ec30 Merge pull request #3748 from BUAADreamer/main 
Add MLLM YI-VL and save processor config during training
 2024-05-15 16:40:54 +08:00
hoshi-hiyougaandGitHub cbeef2aaea Update visual.py 2024-05-15 16:39:57 +08:00
hiyouga 008e3b3b10 fix fsdp model loading 2024-05-15 16:32:28 +08:00
hoshi-hiyougaandGitHub 5a0c8a8d34 Update patcher.py 2024-05-15 15:37:07 +08:00
hoshi-hiyougaandGitHub 780ca8306b Update template.py 2024-05-15 14:20:39 +08:00
hoshi-hiyougaandGitHub aa4a8933dd Update trainer.py 2024-05-15 14:13:26 +08:00
hoshi-hiyougaandGitHub c309605ff5 Update workflow.py 2024-05-15 14:13:01 +08:00
hiyouga 11bf282dcc fix bug in vllm engine 2024-05-15 02:17:54 +08:00
hiyouga 144801db09 fix gen args 2024-05-15 01:49:05 +08:00
hiyouga 7e69e71a52 fix examples 2024-05-15 00:26:10 +08:00
hiyouga 5bdad46387 update examples 2024-05-15 00:05:17 +08:00
hiyouga b96d84835f update readme 2024-05-14 23:57:08 +08:00
hiyouga fc547ee591 update readme 2024-05-14 23:55:49 +08:00