kyy/llm_trainer
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

update readme

Browse Source
This commit is contained in:
hiyouga committed 2024-03-07 20:34:49 +08:00
1 parent 77211d9843
commit 725f7cd70f
2 files changed
+2 -2
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

README.md
+1 -1
View File
@@ -577,7 +577,7 @@ CUDA_VISIBLE_DEVICES=0 python src/export_model.py \
### Inference with OpenAI-style API ### Inference with OpenAI-style API
```bash ```bash
CUDA_VISIBLE_DEVICES=0 python src/api_demo.py \ CUDA_VISIBLE_DEVICES=0 API_PORT=8000 python src/api_demo.py \
--model_name_or_path path_to_llama_model \ --model_name_or_path path_to_llama_model \
--adapter_name_or_path path_to_checkpoint \ --adapter_name_or_path path_to_checkpoint \
--template default \ --template default \
README_zh.md
+1 -1
View File
@@ -576,7 +576,7 @@ CUDA_VISIBLE_DEVICES=0 python src/export_model.py \
### 使用 OpenAI 风格 API 推理 ### 使用 OpenAI 风格 API 推理
```bash ```bash
CUDA_VISIBLE_DEVICES=0 python src/api_demo.py \ CUDA_VISIBLE_DEVICES=0 API_PORT=8000 python src/api_demo.py \
--model_name_or_path path_to_llama_model \ --model_name_or_path path_to_llama_model \
--adapter_name_or_path path_to_checkpoint \ --adapter_name_or_path path_to_checkpoint \
--template default \ --template default \