kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,412 Commits 1 Branch 0 Tags
c27afa296bc8ae2b0611b3248200e88e4c185aef
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
A-Cepheus b06a31e76a 🐞 fix: typo 2024-01-22 16:04:39 +08:00
A-Cepheus 319a72b48d 🐞 fix: typo, move MoE fix to patcher 2024-01-22 16:01:58 +08:00
A-CepheusandGitHub e1d5c98519 fix: ZeRO3 does not work with MoE models 2024-01-22 15:21:14 +08:00