kyy/llm_trainer
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
998 Commits 1 Branch 0 Tags
e874c00906c765b81c0e5ff9c7b3679557da8e0e
Commit Graph
2 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
ldwang c284665425 Add patch_mixtral_replace_moe_impl for full training Mitral using DeepSpeed Zero3. 
Signed-off-by: ldwang <ftgreat@gmail.com>
 2024-01-24 15:25:31 +08:00
ldwang 18923b1402 Add patch_mixtral_replace_moe_impl for full training Mitral using DeepSpeed Zero3. 
Signed-off-by: ldwang <ftgreat@gmail.com>
 2024-01-24 14:43:16 +08:00