kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,508 Commits 1 Branch 0 Tags
026e88ab748e9133483a4ebe1af440126a3db2df
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
A-Cepheus b06a31e76a 🐞 fix: typo 2024-01-22 16:04:39 +08:00
A-Cepheus 319a72b48d 🐞 fix: typo, move MoE fix to patcher 2024-01-22 16:01:58 +08:00
A-CepheusandGitHub e1d5c98519 fix: ZeRO3 does not work with MoE models 2024-01-22 15:21:14 +08:00