Skip to content

Actions: octoml/mlc-llm

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
149 workflow run results
149 workflow run results

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Enable StagingEngine in test_engine_paged_cache_model.py (#50) Lint #24: Commit 84297df pushed by masahi
November 6, 2023 22:29 2m 3s batch-serving
batch-serving
November 6, 2023 22:29 2m 3s
Fix wrong request id (#51) Lint #23: Commit 1d3d12a pushed by yelite
November 6, 2023 22:28 1m 50s batch-serving
batch-serving
November 6, 2023 22:28 1m 50s
Fix wrong request id Lint #22: Pull request #51 opened by yelite
November 6, 2023 22:28 2m 5s yelite:fix-wrong-request-id
yelite:fix-wrong-request-id
November 6, 2023 22:28 2m 5s
Enable StagingEngine in test_engine_paged_cache_model.py Lint #21: Pull request #50 opened by masahi
November 6, 2023 22:22 1m 55s masahi:test-staging-engine
masahi:test-staging-engine
November 6, 2023 22:22 1m 55s
Cleanup unused code (#49) Lint #20: Commit 594208c pushed by yelite
November 6, 2023 18:40 1m 56s batch-serving
batch-serving
November 6, 2023 18:40 1m 56s
Cleanup unused code Lint #19: Pull request #49 opened by yelite
November 6, 2023 18:40 2m 1s yelite:cleanup-unused
yelite:cleanup-unused
November 6, 2023 18:40 2m 1s
New engine implementation and performance optimizations (#48) Lint #18: Commit 0919383 pushed by yelite
November 6, 2023 17:57 2m 1s batch-serving
batch-serving
November 6, 2023 17:57 2m 1s
New engine implementation and performance optimizations Lint #17: Pull request #48 opened by yelite
November 6, 2023 17:26 2m 4s yelite:staging-engine
yelite:staging-engine
November 6, 2023 17:26 2m 4s
Use min-decode-steps = 256 by default for server and benchmark (#47) Lint #16: Commit 3554164 pushed by masahi
November 2, 2023 08:16 1m 57s batch-serving
batch-serving
November 2, 2023 08:16 1m 57s
Use min-decode-steps = 256 by default for server and benchmark Lint #15: Pull request #47 opened by masahi
November 2, 2023 08:12 2m 5s masahi:engine-tweak
masahi:engine-tweak
November 2, 2023 08:12 2m 5s
Do not apply conversation template during benchmarking (#46) Lint #14: Commit 0fc66fa pushed by masahi
November 2, 2023 01:23 2m 1s batch-serving
batch-serving
November 2, 2023 01:23 2m 1s
Do not apply conversation template during benchmarking Lint #13: Pull request #46 opened by masahi
November 2, 2023 01:21 1m 48s masahi:remove-conv-template
masahi:remove-conv-template
November 2, 2023 01:21 1m 48s
Use PyTorch CUDA memory allocator to manage small memory allocation f… Lint #12: Commit be20632 pushed by masahi
November 2, 2023 00:42 2m 5s batch-serving
batch-serving
November 2, 2023 00:42 2m 5s
Use PyTorch CUDA memory allocator to manage small memory allocation for batch inputs Lint #11: Pull request #45 opened by masahi
November 2, 2023 00:39 2m 37s masahi:input-alloc-torch
masahi:input-alloc-torch
November 2, 2023 00:39 2m 37s
Add host parameter for uvicorn (#44) Lint #10: Commit 911ba9e pushed by sunggg
November 1, 2023 20:55 1m 55s batch-serving
batch-serving
November 1, 2023 20:55 1m 55s
Add host parameter for uvicorn Lint #9: Pull request #44 opened by sunggg
November 1, 2023 20:55 2m 28s sunggg:add-host
sunggg:add-host
November 1, 2023 20:55 2m 28s
Hot fix for the VM allocator issue with Disco (#43) Lint #8: Commit 5ab11f5 pushed by masahi
October 31, 2023 07:19 2m 7s batch-serving
batch-serving
October 31, 2023 07:19 2m 7s
Hot fix for the VM allocator issue with Disco Lint #7: Pull request #43 opened by masahi
October 31, 2023 07:16 2m 1s masahi:disco-fix
masahi:disco-fix
October 31, 2023 07:16 2m 1s
Enable split rotary fusion for batched model (#42) Lint #6: Commit 2d30b96 pushed by masahi
October 31, 2023 00:29 2m 17s batch-serving
batch-serving
October 31, 2023 00:29 2m 17s
Enable split rotary fusion for batched model Lint #5: Pull request #42 opened by masahi
October 31, 2023 00:26 2m 0s masahi:split-rotary-fuse
masahi:split-rotary-fuse
October 31, 2023 00:26 2m 0s
Upstream merge oct31 (#41) Lint #4: Commit ba6d4ea pushed by masahi
October 31, 2023 00:15 2m 20s batch-serving
batch-serving
October 31, 2023 00:15 2m 20s
Enable split rotary fusion for batched model Lint #3: Commit de70a1f pushed by masahi
October 31, 2023 00:13 2m 16s batch-serving
batch-serving
October 31, 2023 00:13 2m 16s
Upstream merge oct31 (#41) Lint #2: Commit ba6d4ea pushed by masahi
October 30, 2023 23:58 1m 57s batch-serving
batch-serving
October 30, 2023 23:58 1m 57s
Upstream merge oct31 Lint #1: Pull request #41 opened by masahi
October 30, 2023 23:58 2m 2s masahi:upstream-merge-oct31
masahi:upstream-merge-oct31
October 30, 2023 23:58 2m 2s