Skip to content

Commit

Permalink
remove hardcoded local model
Browse files Browse the repository at this point in the history
  • Loading branch information
dnth committed Oct 23, 2024
1 parent 78c364b commit 289a353
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions xinfer/vllm/molmo.py
Original file line number Diff line number Diff line change
Expand Up @@ -20,8 +20,7 @@ def __init__(

def load_model(self, **kwargs):
self.model = LLM(
# model=self.model_id,
model="/home/dnth/Desktop/cv-docker-images/image_captioning/molmo/molmo_7b_d_0924",
model=self.model_id,
trust_remote_code=True,
dtype=self.dtype,
**kwargs,
Expand Down

0 comments on commit 289a353

Please sign in to comment.