Skip to content

Commit

Permalink
--amend
Browse files Browse the repository at this point in the history
  • Loading branch information
jroesch committed Dec 23, 2023
1 parent 58ccc23 commit 687b350
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion serve/mlc_serve/engine/staging_engine.py
Original file line number Diff line number Diff line change
Expand Up @@ -130,7 +130,6 @@ def add(self, requests: list[Request]):

def cancel(self, request_id: RequestId):
LOG.info("StagingInferenceEngine.cancel", request_id=request_id)
print("StagingInferenceEngine.cancel")
if not self._is_ready_to_serve():
raise RuntimeError("GenerationLoopWorker process is not running")
self.command_queue.put(CancelRequestCommand(request_id))
Expand Down

0 comments on commit 687b350

Please sign in to comment.