kyy/llm_trainer
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix api

Browse Source
This commit is contained in:
hiyouga committed 2023-07-20 22:14:54 +08:00
1 parent 6022adb72e
commit 8333795fcb
2 files changed
+5 -2
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

src/llmtuner/api/app.py
+1 -1
View File
@@ -30,7 +30,7 @@ async def lifespan(app: FastAPI): # collects GPU memory
torch_gc()
def create_app(chat_model: ChatModel):
def create_app(chat_model: ChatModel) -> FastAPI:
app = FastAPI(lifespan=lifespan)
app.add_middleware(