Commit Graph
100 Commits
Author SHA1 Message Date
hiyouga b7d4cf2caf pin tokenizers version 2024-11-27 05:24:58 +00:00
hoshi-hiyougaandGitHub b26c490ac3 Merge pull request #6152 from hiyouga/hiyouga/add_num_proc_in_data_load
[data] add num_proc in load_dataset
2024-11-27 00:16:15 +08:00
hoshi-hiyougaandGitHub 88f087c8b9 Merge pull request #6151 from hiyouga/hiyouga/fix_mllama
[model] fix mllama cross mask
2024-11-27 00:07:54 +08:00
hiyouga 362d579ce8 fix #6149 2024-11-26 16:03:02 +00:00
hiyouga 598c22e43f fix mllama cross_mask 2024-11-26 15:56:58 +00:00
hoshi-hiyougaandGitHub 00031b1a66 Merge pull request #6141 from hiyouga/hiyouga-patch-1
[misc] chore: lint
2024-11-25 23:02:11 +08:00
hoshi-hiyougaandGitHub da9e4ddd26 lint 2024-11-25 22:55:56 +08:00
hoshi-hiyougaandGitHub 3924a3d6e9 Merge pull request #6140 from hiyouga/hiyouga/fix_mllama
[data] fix mllama plugin
2024-11-25 22:32:07 +08:00
hoshi-hiyougaandGitHub d87e16cf5c fix #6139 2024-11-25 22:22:06 +08:00
hoshi-hiyougaandGitHub 3a1402a4ed Merge pull request #6138 from hiyouga/hiyouga/update_data
[data] update dataset info
2024-11-25 21:47:23 +08:00
hoshi-hiyougaandGitHub 5214d3ea06 update dataset 2024-11-25 21:47:04 +08:00
hoshi-hiyougaandGitHub 2b7157dc1d Merge pull request #6137 from hiyouga/hiyouga/fix_mllama
[model] fix mllama hidden_size
2024-11-25 20:17:33 +08:00
hoshi-hiyougaandGitHub 75b586c31a fix visual patch 2024-11-25 20:06:06 +08:00
hoshi-hiyougaandGitHub 0516e556a7 fix #6136 2024-11-25 19:43:42 +08:00
hoshi-hiyougaandGitHub 44125da5a5 Merge pull request #6127 from hiyouga/hiyouga/dev_version
[misc] set dev version
2024-11-25 01:42:29 +08:00
hoshi-hiyougaandGitHub 18daf10eda Merge pull request #6124 from hiyouga/hiyouga/release
[release] release v0.9.1
2024-11-25 00:20:02 +08:00
hoshi-hiyougaandGitHub 07059a7ca4 Merge pull request #6126 from hiyouga/hiyouga/fix_vllm
[inference] fix vllm
2024-11-25 00:19:54 +08:00
hoshi-hiyougaandGitHub 8e9f4617f2 Merge pull request #6010 from XYZliang/fix-#4316
Increase shm_size to 16GB in docker-compose.yml
2024-11-25 00:16:42 +08:00
hoshi-hiyougaandGitHub 57953c8ff6 Merge pull request #6125 from hiyouga/hiyouga/fix_cli
[cli] remove shell=True in cli
2024-11-25 00:07:35 +08:00
hoshi-hiyougaandGitHub 0ce173e2a4 Merge pull request #6123 from hiyouga/hiyouga/fix_qwen2vl_vllm
[inference] fix qwen2vl vllm infer
2024-11-24 23:42:11 +08:00
hoshi-hiyougaandGitHub f2bfa80d55 Merge pull request #6121 from hiyouga/hiyouga/readme
[readme] update readme
2024-11-24 03:28:09 +08:00
hiyouga a89ad72d03 update readme 2024-11-23 19:27:18 +00:00
hoshi-hiyougaandGitHub 5f310d9279 Merge pull request #6120 from hiyouga/hiyouga/fix_ci
[test] fix ci
2024-11-24 03:21:11 +08:00
hiyouga b52c38350d fix ci 2024-11-23 19:13:32 +00:00
hoshi-hiyougaandGitHub e68ef89600 Merge pull request #5555 from marko1616/feat/llama3.2vl
Support llama3.2 vision
2024-11-24 02:49:07 +08:00
hiyouga df477370dc add forbidden modules 2024-11-23 18:34:15 +00:00
hiyouga 446441fdb0 fix inputs 2024-11-23 18:26:02 +00:00
hoshi-hiyougaandGitHub b3aa80d54a Merge commit from fork
[patch] Patch remote OS command injection vulnerability
2024-11-21 22:39:44 +08:00
hoshi-hiyougaandGitHub d20b97e7e9 do not split save_cmd ret value 2024-11-21 22:30:23 +08:00
hoshi-hiyougaandGitHub c8f199881a Merge pull request #6098 from hiyouga/hiyouga-patch-2
update wechat
2024-11-21 14:26:03 +08:00
hoshi-hiyougaandGitHub acf491fc3a update wechat 2024-11-21 14:25:33 +08:00
hoshi-hiyougaandGitHub bd639a137e Merge pull request #6078 from wtmlon/support-efficient-tokens-calculation
support effective tokens calculation on sft/dpo
2024-11-20 13:43:15 +08:00
hoshi-hiyougaandGitHub fdcc78b639 Merge pull request #6083 from hiyouga/hiyouga-patch
[asset] update wechat
2024-11-20 11:46:54 +08:00
hoshi-hiyougaandGitHub 9c0f6556ee Merge pull request #6065 from hiyouga/hiyouga-patch-1
[misc] fix dep package version
2024-11-18 21:13:59 +08:00
hoshi-hiyougaandGitHub 4ac5b97011 fix #6061 2024-11-18 20:56:44 +08:00
hoshi-hiyougaandGitHub 45f32916ce Merge pull request #6052 from hiyouga/hiyouga-patch-1
[trainer] fix DPO metrics
2024-11-16 16:20:12 +08:00
hoshi-hiyougaandGitHub dc82821872 fix #6050 2024-11-16 16:11:16 +08:00
hoshi-hiyougaandGitHub 6c0847899d Merge pull request #6046 from hiyouga/hiyouga/add_code_model
[model] add qwen-coder and opencoder
2024-11-15 21:58:03 +08:00
hoshi-hiyougaandGitHub 3eebae892b Merge pull request #5990 from hiyouga/hiyouga/dev_vllm
[generate] fix vllm config args
2024-11-11 14:10:35 +08:00
hoshi-hiyougaandGitHub 8d70edf39b fix #5988 2024-11-11 13:57:14 +08:00
hoshi-hiyougaandGitHub 2176224f4b Merge pull request #5984 from hiyouga/hiyouga/wechat
[readme] update wechat
2024-11-10 22:08:55 +08:00
hoshi-hiyougaandGitHub 1ca6b1582f Merge pull request #5982 from hiyouga/hiyouga/vllm_args
[args] add vllm config
2024-11-10 21:37:18 +08:00
hoshi-hiyougaandGitHub 40a2fcc02d Merge pull request #5973 from JJJJerry/fix_vllm_generate
fix VllmEngine: 将inputs参数替换为prompt
2024-11-10 21:04:38 +08:00
hoshi-hiyougaandGitHub a543bc478d Update vllm_engine.py 2024-11-10 20:57:00 +08:00
hoshi-hiyougaandGitHub adc5849ce7 Merge pull request #5971 from hiyouga/hiyouga/fix_webui
[webui] fix extra args
2024-11-09 00:25:24 +08:00
hoshi-hiyougaandGitHub 39e330196d Merge pull request #5970 from hiyouga/hiyouga/fix_beam
[generation] fix vllm v0.6.3
2024-11-08 23:58:15 +08:00
hoshi-hiyougaandGitHub 707ff5a370 Merge pull request #5929 from hiyouga/hiyouga/dev_wechat
[readme] update wechat
2024-11-04 16:44:31 +08:00
hiyouga 882635cac3 update wechat 2024-11-04 08:43:21 +00:00
hoshi-hiyougaandGitHub bcbd1bebb0 Merge pull request #5927 from hiyouga/hiyouga/dev_fixmmchat
[fix] chat engines
2024-11-04 16:36:23 +08:00
hiyouga ffa39ba3db add image input type 2024-11-04 08:27:20 +00:00
hiyouga 8c88065c38 fix chat engines 2024-11-04 08:18:12 +00:00
hoshi-hiyougaandGitHub 22ee197a40 Merge pull request #5926 from hiyouga/hiyouga/dev_deps
[version] update datasets version
2024-11-04 16:04:00 +08:00
hiyouga c5fae465ec update datasets version 2024-11-04 07:52:26 +00:00
hoshi-hiyougaandGitHub 04c10d2e80 Merge pull request #5914 from hiyouga/hiyouga/dev_read
[misc] update readme
2024-11-02 21:44:10 +08:00
hoshi-hiyougaandGitHub 9a42c5f76f Merge pull request #5475 from menibrief/main
Fix phi-3-small issues
2024-11-02 21:31:34 +08:00
hoshi-hiyougaandGitHub 478cbb1aa7 update template 2024-11-02 21:21:22 +08:00
hoshi-hiyougaandGitHub 5f14910910 Merge branch 'main' into main 2024-11-02 21:20:27 +08:00
hoshi-hiyougaandGitHub 344ff76d26 Merge pull request #5913 from hiyouga/hiyouga/dev_metrics
[train] support gather DPO metrics, fix return output
2024-11-02 21:13:43 +08:00
hoshi-hiyougaandGitHub 07e5088851 Merge pull request #5880 from sd3ntato/make-image-parametric
make base image parametric.
2024-11-02 20:26:14 +08:00
hoshi-hiyougaandGitHub 5e8a619d1d Update Dockerfile 2024-11-02 20:20:26 +08:00
hoshi-hiyougaandGitHub c58cc22d06 Merge pull request #5910 from Cuiyn/index
Support Index series models.
2024-11-02 20:16:54 +08:00
hoshi-hiyougaandGitHub 83535bbe8b Merge pull request #5912 from hiyouga/hiyouga/dev_logging
[misc] support rank0 logger
2024-11-02 18:48:41 +08:00
hoshi-hiyougaandGitHub bd08b8c441 Merge pull request #5909 from hiyouga/hiyouga/dev2
[data] support auto convert for single image, add image_dir argument
2024-11-02 13:43:04 +08:00
hoshi-hiyougaandGitHub 8408339d83 Merge pull request #5907 from hiyouga/hiyouga/dev
[data] fix template replace behavior
2024-11-02 13:42:53 +08:00
hoshi-hiyougaandGitHub 3ef7d590b1 Merge pull request #5906 from hiyouga/dev
[test] update tests
2024-11-02 12:50:43 +08:00
hoshi-hiyougaandGitHub 0a55e60693 Merge pull request #5895 from hiyouga/dev
[inference] support multiple images
2024-11-01 16:52:55 +08:00
hiyouga e824b715ad add examples 2024-11-01 08:41:54 +00:00
hiyouga e80a481927 support multiimage inference 2024-11-01 07:25:20 +00:00
hoshi-hiyougaandGitHub 641d0dab08 Merge pull request #5873 from hiyouga/dev
[misc] update readme
2024-10-30 17:14:44 +08:00
hiyouga 2417b70a62 update readme 2024-10-30 09:14:01 +00:00
hoshi-hiyougaandGitHub b2d4b9a7a8 Merge pull request #5871 from hiyouga/dev
[loss&ui] fix incorrect loss of vlms, add extra args to ui
2024-10-30 17:13:17 +08:00
hiyouga 30567a1487 fix incorrect loss value for vlms 2024-10-30 08:56:46 +00:00
hiyouga 0c22da4f1c tiny fix 2024-10-30 08:56:29 +00:00
hiyouga 86e5affc0d support extra args in llamaboard 2024-10-30 08:55:54 +00:00
hoshi-hiyougaandGitHub 9009a467e6 Merge pull request #5581 from Kuangdd01/pixtral-patch
[WIP] Support Pixtral-12B
2024-10-29 22:29:10 +08:00
hoshi-hiyougaandGitHub bb0afda8fb fix bug 2024-10-29 22:19:04 +08:00
hoshi-hiyougaandGitHub 049c554aee Update mm_plugin.py 2024-10-29 22:16:22 +08:00
hoshi-hiyougaandGitHub c3239ba6b2 Update template.py 2024-10-29 22:11:21 +08:00
hoshi-hiyougaandGitHub 0baa7735f6 Update visual.py 2024-10-29 22:10:29 +08:00
hoshi-hiyougaandGitHub f745c4b28f Update collator.py 2024-10-29 22:03:42 +08:00
hoshi-hiyougaandGitHub 6e212fdab5 Update hf_engine.py 2024-10-29 22:00:59 +08:00
hoshi-hiyougaandGitHub 8fa20bf427 Update README_zh.md 2024-10-29 21:58:03 +08:00
hoshi-hiyougaandGitHub 1b57df074a Update README.md 2024-10-29 21:57:28 +08:00
hoshi-hiyougaandGitHub 4ff6e564f8 Merge pull request #5801 from NLPJCL/main
使用了 LLaMA Factory 的项目:RAG-Retrieval 使用LLaMA-Factory作为生成方法做Reranker任务的微调框架。
2024-10-29 21:20:16 +08:00
hoshi-hiyougaandGitHub 08d9a03c30 Update README_zh.md 2024-10-29 21:19:17 +08:00
hoshi-hiyougaandGitHub a76478c127 Update README.md 2024-10-29 21:18:15 +08:00
hoshi-hiyougaandGitHub a7c79d8f6a Merge pull request #5857 from hiyouga/dev
[train] fix saving processor
2024-10-29 21:12:04 +08:00
hiyouga 23dbe9a099 fix #5749 2024-10-29 13:02:13 +00:00
hoshi-hiyougaandGitHub 935adaeed9 Merge pull request #5852 from hiyouga/dev
[misc] several important updates
2024-10-29 20:30:02 +08:00
hiyouga 51e5f96247 fix pissa 2024-10-29 12:18:45 +00:00
hiyouga ae045c884f fix #5747 2024-10-29 10:47:04 +00:00
hiyouga 21db8ed2f4 use pre-commit 2024-10-29 09:07:46 +00:00
hiyouga 77666bd227 update requires 2024-10-29 16:10:07 +08:00
hiyouga 8723922923 update wechat 2024-10-29 15:46:10 +08:00
hoshi-hiyougaandGitHub b4c7dd3ac5 fix #5797 2024-10-23 20:49:44 +08:00
hoshi-hiyougaandGitHub 74a79cc059 fix test 2024-10-22 12:35:36 +08:00
hoshi-hiyougaandGitHub d155b7008c fix #5768 2024-10-22 11:06:22 +08:00
hoshi-hiyougaandGitHub 769fbb6349 Update misc.py 2024-10-17 19:48:51 +08:00
hoshi-hiyougaandGitHub 93b9067dfc Update loader.py 2024-10-17 19:48:12 +08:00
hoshi-hiyougaandGitHub 110e4c548d Update README_zh.md 2024-10-17 19:47:33 +08:00