Skip to content

Commit

Permalink
fix mypy
Browse files Browse the repository at this point in the history
  • Loading branch information
masahi committed Dec 11, 2023
1 parent 8bbe0b3 commit 051f57f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion serve/mlc_serve/model/paged_cache_model.py
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ def __init__(self, prompt_blocks: list[int]):
# Prompt blocks between [prompt_cursor, self.num_prompt_blocks) are shared
# with other sequences in a parallel-sampling request.
self.prompt_blocks = prompt_blocks # immutable
self.decode_blocks = []
self.decode_blocks: list[int] = []

def append(self, new_block_id):
self.decode_blocks.append(new_block_id)
Expand Down

0 comments on commit 051f57f

Please sign in to comment.