kyy/llm_trainer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
842 Commits 1 Branch 0 Tags
a5d559a89ebb6c094252dc8bf6f6dcf10b98bfd6
Commit Graph
3 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
A-Cepheus b06a31e76a 🐞 fix: typo 2024-01-22 16:04:39 +08:00
A-Cepheus 319a72b48d 🐞 fix: typo, move MoE fix to patcher 2024-01-22 16:01:58 +08:00
A-CepheusandGitHub e1d5c98519 fix: ZeRO3 does not work with MoE models 2024-01-22 15:21:14 +08:00