kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,288 Commits 1 Branch 0 Tags
cd3a960f81579b4173ae79aa14d075e94651e8ce
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
A-Cepheus b06a31e76a 🐞 fix: typo 2024-01-22 16:04:39 +08:00
A-Cepheus 319a72b48d 🐞 fix: typo, move MoE fix to patcher 2024-01-22 16:01:58 +08:00
A-CepheusandGitHub e1d5c98519 fix: ZeRO3 does not work with MoE models 2024-01-22 15:21:14 +08:00