kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
856 Commits 1 Branch 0 Tags
85622ae757e2ffe7f3da15f0a9123e8410d82b28
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
A-Cepheus b06a31e76a 🐞 fix: typo 2024-01-22 16:04:39 +08:00
A-Cepheus 319a72b48d 🐞 fix: typo, move MoE fix to patcher 2024-01-22 16:01:58 +08:00
A-CepheusandGitHub e1d5c98519 fix: ZeRO3 does not work with MoE models 2024-01-22 15:21:14 +08:00