Commit Graph

196 Commits

Author SHA1 Message Date
BUAADreamer
1dcabafe72 modify style 2024-04-25 21:15:16 +08:00
BUAADreamer
94ad744941 add some 2024-04-25 21:08:32 +08:00
BUAADreamer
68cdd9a020 Merge branch 'hiyouga:main' into main 2024-04-25 20:02:50 +08:00
BUAADreamer
c6dd89918f merge data part to the text stream 2024-04-25 19:19:59 +08:00
hiyouga
3a7c1286ce add export_device in webui #3333 2024-04-25 19:02:32 +08:00
BUAADreamer
838eb87a96 merge model part to the text stream 2024-04-25 08:20:41 +08:00
BUAADreamer
8239907f57 remove error 2024-04-25 01:01:59 +08:00
BUAADreamer
7ffee90799 remove conflicts 2024-04-25 00:34:22 +08:00
BUAADreamer
cfb485eddf add llava and instructblip 2024-04-25 00:22:43 +08:00
hiyouga
7fbe8add8f fix log level 2024-04-24 23:42:59 +08:00
hiyouga
297fb8ead3 support new special token #3420 2024-04-24 23:39:31 +08:00
hiyouga
73ff9c834b fix bug 2024-04-24 05:21:18 +08:00
hiyouga
8f44dce08a fix bug 2024-04-24 05:10:07 +08:00
hiyouga
667ce08b27 remove redundant code 2024-04-24 05:02:18 +08:00
hiyouga
b1deb0a0b9 support unsloth generate 2024-04-24 04:46:53 +08:00
hiyouga
aa2b79eb23 refactor patcher 2024-04-24 03:02:23 +08:00
hiyouga
07737a3d2d reenable sdpa and fast tok by default 2024-04-24 02:18:44 +08:00
hiyouga
707f0b1d5d fix #3347 #3387 2024-04-24 01:30:16 +08:00
BUAADreamer
4dcb11eab7 add multimodal LLM BLIP-2 and InstructBLIP 2024-04-23 18:45:43 +08:00
hiyouga
a1d31ffc8c fix #3365 2024-04-21 19:20:18 +08:00
hiyouga
f58425ab45 fix mod stuff 2024-04-21 18:11:10 +08:00
hoshi-hiyouga
d0273787be Merge pull request #3338 from astramind-ai/main
Adding Mixture of Depth
2024-04-21 18:05:52 +08:00
hoshi-hiyouga
1fa287fd63 fix #3348 2024-04-20 10:34:09 +08:00
Marco
620add7b9f Added Mixture of Depths 2024-04-18 20:31:24 +02:00
hiyouga
942362d008 fix #3324 2024-04-18 15:34:45 +08:00
hiyouga
c9a477322d fix #3316 2024-04-17 22:54:34 +08:00
hoshi-hiyouga
4d660c5ade Merge pull request #3287 from Ledzy/badam
[Feature] Add BAdam algorithm
2024-04-16 17:32:16 +08:00
hoshi-hiyouga
38a56706e0 Update utils.py 2024-04-16 17:29:30 +08:00
hoshi-hiyouga
a950f3b81d Update patcher.py 2024-04-16 17:29:19 +08:00
hoshi-hiyouga
750cdf2e74 Update adapter.py 2024-04-16 17:28:12 +08:00
Jonery
7ecb61822b resolve gradient checkpointing issue. 2024-04-16 12:05:27 +08:00
hiyouga
7dc72fb58c support unsloth 2024.4 2024-04-16 00:25:03 +08:00
hiyouga
6543f3d449 add codegemma 2024-04-16 00:11:15 +08:00
hiyouga
e0dbac2845 support cohere commandR #3184 2024-04-15 23:26:42 +08:00
Jonery
06c8908d3f Feature BAdam 2024-04-15 23:15:27 +08:00
hiyouga
cce52351b5 update examples 2024-04-15 22:14:34 +08:00
hoshi-hiyouga
0e0942d388 Merge pull request #3276 from liu-zichen/fix_mixtral
fix: turn on output_router_logits of mixtral
2024-04-15 15:38:16 +08:00
hiyouga
efc345c4b0 fix #3273 2024-04-15 15:32:58 +08:00
liuzc
9f4fe62386 fix: mixtral output_router_logits 2024-04-15 12:11:49 +08:00
hiyouga
9d4c949461 release v0.6.2 2024-04-11 20:08:51 +08:00
hoshi-hiyouga
98bc97d8d2 Update adapter.py 2024-04-10 00:57:51 +08:00
hoshi-hiyouga
2111b586b6 Update adapter.py 2024-04-10 00:57:30 +08:00
Erich Schubert
b5eefe5c4c Pass additional_target to unsloth
Fixes #3200
2024-04-09 17:53:40 +02:00
hiyouga
7f6c2486b8 fix quant infer and qwen2moe 2024-04-09 17:12:59 +08:00
hiyouga
148bda353f fix resize vocab at inference #3022 2024-04-03 18:14:24 +08:00
hiyouga
92dab8a90b simplify readme 2024-04-02 20:07:43 +08:00
hiyouga
b267aeb53f add moe aux loss control #3085 2024-04-02 14:26:31 +08:00
hiyouga
9ddbe2866a fix #3022 2024-04-02 13:58:39 +08:00
hiyouga
4a6ca621c0 fix #3083 2024-04-01 22:53:52 +08:00
hiyouga
aee634cd20 fix #3077 2024-04-01 21:35:18 +08:00