llm decode shapes fp8 rowwise gemm tuning #7328
Job | Run time |
---|---|
7m 30s | |
8m 4s | |
7m 39s | |
7m 30s | |
7m 37s | |
8m 24s | |
7m 41s | |
7m 34s | |
8m 1s | |
7m 40s | |
12m 39s | |
12m 51s | |
12m 31s | |
12m 49s | |
12m 19s | |
13m 15s | |
12m 14s | |
12m 49s | |
12m 20s | |
13m 20s | |
16m 14s | |
16m 5s | |
16m 15s | |
16m 46s | |
16m 31s | |
16m 5s | |
14m 55s | |
16m 6s | |
15m 21s | |
15m 21s | |
23m 55s | |
24m 22s | |
24m 37s | |
24m 6s | |
23m 27s | |
23m 41s | |
23m 29s | |
23m 45s | |
21m 17s | |
21m 44s | |
9h 58m 49s |