kyy/llm_trainer
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

resolve gradient checkpointing issue.

Browse Source
This commit is contained in:
Jonery committed 2024-04-16 12:05:27 +08:00
1 parent 06c8908d3f
commit 7ecb61822b
4 files changed
+8 -14
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

examples/extras/badam/sft.sh
+1 -2
View File
@@ -31,6 +31,5 @@ python ../../../src/train_bash.py \
--use_badam \
--switch_mode descending \
--badam_verbose 2 \
--switch_block_every 50 \
--pure_bf16 \
--switch_block_every 50