kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,212 Commits 1 Branch 0 Tags
45841bb646afa9d0bc2ea4b6b7b107daa67d90f0
Commit Graph
94 Commits
Author SHA1 Message Date
hiyouga 45841bb646 add patch processor func 2024-09-30 17:07:43 +08:00
BUAADreamer 485fc04716 fix constants 2024-09-29 22:00:01 +08:00
BUAADreamer 23916d57c1 fix style 2024-09-29 21:39:37 +08:00
Zhangchi Feng 83abf86657 Merge branch 'main' into main 2024-09-29 21:32:54 +08:00
BUAADreamer 65a8923f5a add more llava-next series template 2024-09-29 21:29:29 +08:00
BUAADreamer bf0bcbc5ec fix readme 2024-09-29 20:45:02 +08:00
BUAADreamer d5c69400cd fix some 2024-09-29 17:55:40 +08:00
hoshi-hiyouga fe7057a8a3 Update attention.py 2024-09-29 10:47:41 +08:00
Amirreza A 94ee105526 made a small change to a warning about fa2 for gemma2 models. 2024-09-28 19:03:36 +03:30
BUAADreamer 7f3f81009e fix some 2024-09-28 01:15:33 +08:00
BUAADreamer 6642cd501d add llava-next/llava-next-video/video-llava 2024-09-28 00:57:03 +08:00
Zhangchi Feng 900631755b Merge branch 'hiyouga:main' into main 2024-09-27 18:14:39 +08:00
Billy Cao 7a2958a44f Add qwen_vl to liger kernel supported list 2024-09-14 19:28:20 +08:00
BUAADreamer 7b4ba0efb6 try to past test 2024-09-10 13:12:51 +08:00
BUAADreamer 96decf82b8 resolve confilct 2024-09-10 12:39:17 +08:00
BUAADreamer 31259e7e0c support llava-next(video) 2024-09-10 12:31:53 +08:00
hiyouga c93795ae14 fix qwen2vl preprocess 2024-09-09 22:33:33 +08:00
hiyouga c9b3870adb tiny fix 2024-09-08 23:18:08 +08:00
hiyouga b332908ab4 fix test case 2024-09-08 01:50:51 +08:00
hiyouga 52a06efaf8 add test case 2024-09-08 01:40:49 +08:00
hiyouga fb72a3adb0 support activation offloading via unsloth gc 2024-09-08 01:22:19 +08:00
hiyouga 76f2e59504 tiny fix 2024-09-05 23:41:16 +08:00
hiyouga 94d5b1bd8f add e2e tests 2024-09-05 21:52:28 +08:00
hiyouga 8cafc7b055 video datasets 2024-09-05 02:04:17 +08:00
hiyouga a61c8c4890 fix #5324 2024-09-02 23:56:21 +08:00
hiyouga 8e49940746 add rlhf-v dataset 2024-09-01 22:57:41 +08:00
hiyouga 9967ccb3ae fix mixed mm inputs and rlhf-v 2024-09-01 20:52:47 +08:00
hiyouga a2a8c0b92c add test mm plugin 2024-08-31 01:53:38 +08:00
hiyouga a025c3df61 remove visual_inputs, fix qlora 2024-08-31 00:24:51 +08:00
hiyouga 3382317e32 refactor mm training 2024-08-30 02:14:31 +08:00
hoshi-hiyouga 727e184840 Merge pull request #5290 from simonJJJ/qwen2_vl 
support qwen2-vl
 2024-08-30 02:10:36 +08:00
hiyouga a7dd7d325e update liger kernel 2024-08-29 20:46:08 +08:00
simonJJJ aeb85f200b initial-commit 2024-08-28 16:51:35 +08:00
hiyouga 72bc8f0111 support liger kernel 2024-08-27 11:20:14 +08:00
hiyouga b7ca6c8dc1 fix #5048 2024-08-05 23:48:19 +08:00
hiyouga 5665062ca0 tiny fix 2024-07-22 21:10:15 +08:00
hoshi-hiyouga 26082fc6c9 fix #4917 2024-07-22 11:28:31 +08:00
hiyouga 29ebcd75d5 fix up 2024-07-15 01:04:56 +08:00
hiyouga d3c01552e0 tiny fix 2024-07-14 10:56:45 +08:00
hiyouga 2f6af73da2 fix gemma2 attention 2024-07-13 23:33:45 +08:00
hiyouga 0c699de39d tiny fix 2024-07-04 03:47:05 +08:00
hiyouga 6fd6aa4530 fix packing for eager/sdpa attn 2024-07-04 01:52:43 +08:00
hoshi-hiyouga 87d9b2d005 Merge pull request #4224 from chuan298/main 
Implement efficient packing without cross-contamination attention
 2024-07-04 01:18:54 +08:00
hiyouga cce7083024 update packing 2024-07-04 01:10:55 +08:00
hoshi-hiyouga a36e8f2dd5 Update packing.py 2024-07-03 23:36:01 +08:00
hiyouga c346f79f99 update func name 2024-07-03 23:29:33 +08:00
hiyouga 8a6a7b9c8a update arg name 2024-07-03 23:23:24 +08:00
hiyouga 8b1172b910 tiny fix 2024-07-03 02:31:50 +08:00
ancv e8e13b0942 move efficient_packing from data_args to model_args 2024-07-02 18:37:55 +07:00
hoshi-hiyouga e8e6af2651 Merge branch 'main' into main 2024-07-01 21:01:09 +08:00