kyy/llm_trainer
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge pull request #3785 from enji-zhou/feature/add_kto

Browse Source 
add kto
This commit is contained in:
hoshi-hiyouga authored and GitHub committed 2024-05-18 03:07:18 +08:00
2 parents d7ff49f245 db1d5a4f51
commit 33a354548e
14 files changed
+5923 -8
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

src/llamafactory/extras/constants.py
+1
View File
@@ -45,6 +45,7 @@ TRAINING_STAGES = {
"Reward Modeling": "rm",
"PPO": "ppo",
"DPO": "dpo",
"KTO": "kto",
"ORPO": "orpo",
"Pre-Training": "pt",
}