Skip to content

Commit 23f8186

Browse files
committed
Clear conversation on premature exit
1 parent 79caf54 commit 23f8186

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

src/guidellm/scheduler/worker.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -399,6 +399,8 @@ async def _process_next_request(self) -> ProcessRequestT[RequestT, ResponseT]:
399399
request_info.error = "Request was cancelled"
400400
request_info.scheduler_timings.resolve_end = time.time()
401401
self._send_update("cancelled", response, request, request_info)
402+
# Clear conversation on premature exit
403+
conversation = []
402404

403405
return history, conversation, aug
404406

0 commit comments

Comments
 (0)