Code

[WIP] Resize scheduler update#3657

Code

Draft

naoyam wants to merge 110 commits intomainNVIDIA/Fuser:mainfrom resize_scheduler_optNVIDIA/Fuser:resize_scheduler_optCopy head branch name to clipboard

+733-43

Commits

Commits on Dec 18, 2024

• Exclusiveness analysis

  naoyam

  committed
  1a370e7

  Copy full SHA for 1a370e7

• cleanup

  naoyam

  committed
  ac5a1bc

  Copy full SHA for ac5a1bc

Commits on Dec 19, 2024

• cleanup

  naoyam

  committed
  8b8c708

  Copy full SHA for 8b8c708

• PR feedback

  naoyam

  committed
  d364442

  Copy full SHA for d364442

Commits on Dec 20, 2024

• Resolve conflicts by recomputation

  naoyam

  committed
  7380a40

  Copy full SHA for 7380a40

• Merge remote-tracking branch 'origin/main' into resize_scheduler_recomputation

  naoyam

  committed
  eb9fffa

  Copy full SHA for eb9fffa

• test fix

  naoyam

  committed
  9631958

  Copy full SHA for 9631958

• fix

  naoyam

  committed
  76dbab9

  Copy full SHA for 76dbab9

• cleanup

  naoyam

  committed
  75338a4

  Copy full SHA for 75338a4

• Add a c++ test version of a rope module

  naoyam

  committed
  fd0cd06

  Copy full SHA for fd0cd06

• WIP

  naoyam

  committed
  bb193f7

  Copy full SHA for bb193f7

• cleanup

  naoyam

  committed
  6d83336

  Copy full SHA for 6d83336

• Add pre-mma seciton

  naoyam

  committed
  8d0f05f

  Copy full SHA for 8d0f05f

Commits on Dec 21, 2024

• bug fix

  naoyam

  committed
  a2c0652

  Copy full SHA for a2c0652

• vectorize hack

  naoyam

  committed
  dd3a2d9

  Copy full SHA for dd3a2d9

• vec

  naoyam

  committed
  1069c6f

  Copy full SHA for 1069c6f

• vec tuning

  naoyam

  committed
  e5ec7d8

  Copy full SHA for e5ec7d8

• WIP: segmenter opt

  naoyam

  committed
  907ae7a

  Copy full SHA for 907ae7a

Commits on Dec 22, 2024

• WIP

  naoyam

  committed
  523fe84

  Copy full SHA for 523fe84

Commits on Dec 23, 2024

• mistral bwd

  naoyam

  committed
  80bfc84

  Copy full SHA for 80bfc84

Commits on Dec 24, 2024

• fix

  naoyam

  committed
  d6711a7

  Copy full SHA for d6711a7

• Merge remote-tracking branch 'origin/main' into resize_scheduler_recomputation

  naoyam

  committed
  221a323

  Copy full SHA for 221a323

• Recomputation needs to be done in a topological order

  naoyam

  committed
  e48a2f6

  Copy full SHA for e48a2f6

• Translate repeat

  naoyam

  committed
  9a96e99

  Copy full SHA for 9a96e99

• Avoid transpose

  naoyam

  committed
  cab9cd8

  Copy full SHA for cab9cd8

• cleanup

  naoyam

  committed
  a73dab6

  Copy full SHA for a73dab6

Commits on Dec 25, 2024

• Translate the repetition pattern with expand and reshape

  naoyam

  committed
  e25a464

  Copy full SHA for e25a464

• cleanup

  naoyam

  committed
  330a62f

  Copy full SHA for 330a62f

• Drop support of addition-based concat as it isn't immediately necessary

  naoyam

  committed
  4c1abda

  Copy full SHA for 4c1abda

• Merge remote-tracking branch 'origin/main' into translate_repeat_pattern

  naoyam

  committed
  e5fcf14

  Copy full SHA for e5fcf14

• remove

  naoyam

  committed
  baebd7b

  Copy full SHA for baebd7b

• Merge remote-tracking branch 'origin/translate_repeat_pattern' into rope_benchmark_test

  naoyam

  committed
  a2f7df1

  Copy full SHA for a2f7df1

• manual seg

  naoyam

  committed
  795dd49

  Copy full SHA for 795dd49

• forward other single-input ops

  naoyam

  committed
  1a5bcae

  Copy full SHA for 1a5bcae

• Skip transpose by default

  naoyam

  committed
  2348d55

  Copy full SHA for 2348d55

Commits on Dec 26, 2024

• Mistral bwd adjustment

  naoyam

  committed
  197b0e7

  Copy full SHA for 197b0e7

• resize heuristic param with split gdimx

  naoyam

  committed
  8051a56

  Copy full SHA for 8051a56

Commits on Dec 27, 2024

• reshape cancelation and vec

  naoyam

  committed
  53cc163

  Copy full SHA for 53cc163

• bug fix

  naoyam

  committed
  1527c84

  Copy full SHA for 1527c84

• scheduling update

  naoyam

  committed
  e4619e2

  Copy full SHA for e4619e2

Commits on Dec 30, 2024

• scheduler update

  naoyam

  committed
  86fba69

  Copy full SHA for 86fba69

• fix

  naoyam

  committed
  cd39203

  Copy full SHA for cd39203

• war

  naoyam

  committed
  5205d1d

  Copy full SHA for 5205d1d

• vec fix

  naoyam

  committed
  410ee87

  Copy full SHA for 410ee87

Commits on Dec 31, 2024

• Mistral and Litgpt benchmarks

  naoyam

  committed
  4a45a99

  Copy full SHA for 4a45a99

• cleanup

  naoyam

  committed
  75ec122

  Copy full SHA for 75ec122

• Merge branch 'main' into resize_scheduler_opt

  naoyam

  committed
  b497d8e

  Copy full SHA for b497d8e

• Merge branch 'rope_benchmark_cpp_test' into resize_scheduler_opt

  naoyam

  committed
  52f3353

  Copy full SHA for 52f3353

• Merge branch 'main' into resize_scheduler_recomputation

  naoyam

  authored
  f9a2d37

  Copy full SHA for f9a2d37

• remove a file added by accident

  naoyam

  committed
  2653e13

  Copy full SHA for 2653e13

• Merge branch 'main' into resize_scheduler_recomputation

  naoyam

  authored
  d66a67d

  Copy full SHA for d66a67d

• cleanup

  naoyam

  committed
  87b4713

  Copy full SHA for 87b4713

• Merge branch 'main' into resize_scheduler_opt

  naoyam

  committed
  0b48837

  Copy full SHA for 0b48837

• Merge branch 'resize_scheduler_recomputation' into resize_scheduler_opt

  naoyam

  committed
  30a5dc1

  Copy full SHA for 30a5dc1

• Merge branch 'main' into resize_scheduler_opt

  naoyam

  committed
  350af8d

  Copy full SHA for 350af8d

• remove file added accidentally

  naoyam

  committed
  70b8920

  Copy full SHA for 70b8920

• Merge branch 'main' into resize_scheduler_opt

  naoyam

  committed
  1d42538

  Copy full SHA for 1d42538

• Merge branch 'main' into resize_scheduler_opt

  naoyam

  committed
  f577705

  Copy full SHA for f577705

Commits on Jan 1, 2025

• cleanup

  naoyam

  committed
  e06cc3b

  Copy full SHA for e06cc3b

Commits on Jan 6, 2025

• Merge branch 'main' into resize_scheduler_opt

  naoyam

  committed
  efcd1b2

  Copy full SHA for efcd1b2

• cleanup

  naoyam

  committed
  bd71357

  Copy full SHA for bd71357

Commits on Jan 7, 2025

• Merge remote-tracking branch 'origin/main' into resize_scheduler_opt

  naoyam

  committed
  1e82c7e

  Copy full SHA for 1e82c7e

• cleanup

  naoyam

  committed
  1d9d50b

  Copy full SHA for 1d9d50b

Commits on Jan 8, 2025

• fix reshape cancellation

  naoyam

  committed
  a8d1fec

  Copy full SHA for a8d1fec

• cleanup

  naoyam

  committed
  c1e3ae1

  Copy full SHA for c1e3ae1

• Schedule loop domains such that reshape transforms are cancelled

  naoyam

  committed
  dd0f134

  Copy full SHA for dd0f134

• cleanup

  naoyam

  committed
  4542dd5

  Copy full SHA for 4542dd5

Commits on Jan 9, 2025

• fix

  naoyam

  committed
  ed100ac

  Copy full SHA for ed100ac

• comment

  naoyam

  committed
  0c2c335

  Copy full SHA for 0c2c335

• Merge remote-tracking branch 'origin/main' into resize_scheduler_opt

  naoyam

  committed
  7b10c6a

  Copy full SHA for 7b10c6a

• Don't try to index broadcast IDs as they should always be zero and there

  Show description for 80bcffb
  naoyam

  committed
  80bcffb

  Copy full SHA for 80bcffb

• Merge branch 'skip_trying_indexing_broadcast_ids' into resize_scheduler_opt

  naoyam

  committed
  93ced2e

  Copy full SHA for 93ced2e

Commits on Jan 10, 2025

• cleanup

  naoyam

  committed
  d53e387

  Copy full SHA for d53e387

• Merge remote-tracking branch 'origin/main' into resize_scheduler_opt

  naoyam

  committed
  30cd401

  Copy full SHA for 30cd401

• Merge remote-tracking branch 'origin/cancel_reshape' into resize_scheduler_opt

  naoyam

  committed
  2102318

  Copy full SHA for 2102318

• cleanup

  naoyam

  committed
  ee31fde

  Copy full SHA for ee31fde

• Merge remote-tracking branch 'origin/main' into resize_scheduler_opt

  naoyam

  committed
  d01a1e8

  Copy full SHA for d01a1e8

Commits on Jan 11, 2025

• Handle ending repeat

  naoyam

  committed
  f05a1a7

  Copy full SHA for f05a1a7

• cast seg

  naoyam

  committed
  8c8bd45

  Copy full SHA for 8c8bd45

• fix

  naoyam

  committed
  c5f4e3b

  Copy full SHA for c5f4e3b

• fix

  naoyam

  committed
  21b18c2

  Copy full SHA for 21b18c2

• debug

  naoyam

  committed
  46b6e3f

  Copy full SHA for 46b6e3f

• Merge remote-tracking branch 'origin/resize_scheduler_opt' into resize_scheduler_opt

  naoyam

  committed
  8fe98b2

  Copy full SHA for 8fe98b2

• fix

  naoyam

  committed
  cdb50f3

  Copy full SHA for cdb50f3

Commits on Jan 12, 2025

• fix

  naoyam

  committed
  7655764

  Copy full SHA for 7655764

• fix

  naoyam

  committed
  54ffcd5

  Copy full SHA for 54ffcd5

Commits on Jan 15, 2025

• Don't use permissive traversal

  naoyam

  committed
  12ddb7a

  Copy full SHA for 12ddb7a

• Merge remote-tracking branch 'origin/main' into resize_scheduler_opt

  naoyam

  committed
  43f9de8

  Copy full SHA for 43f9de8

• Fixes #3710

  naoyam

  committed
  73d36ad

  Copy full SHA for 73d36ad

• WAR

  naoyam

  committed
  ca29e2c

  Copy full SHA for ca29e2c

• Merge remote-tracking branch 'origin/resize_predicate' into resize_scheduler_opt

  naoyam

  committed
  60b3d9e

  Copy full SHA for 60b3d9e

• Merge branch 'main' into resize_scheduler_opt

  naoyam

  committed
  8cbc4c2

  Copy full SHA for 8cbc4c2

Commits on Jan 16, 2025

• merge fix

  naoyam

  committed
  44c8bc9

  Copy full SHA for 44c8bc9

• cleanup

  naoyam

  committed
  4120f67

  Copy full SHA for 4120f67

• Merge remote-tracking branch 'origin/main' into resize_scheduler_opt

  naoyam

  committed
  965b17b

  Copy full SHA for 965b17b

Commits on Jan 17, 2025

• cleanup

  naoyam

  committed
  6da5cc3

  Copy full SHA for 6da5cc3

• Merge branch 'main' into resize_scheduler_opt

  naoyam

  committed
  f52f8af

  Copy full SHA for f52f8af

• cleanup

  naoyam

  committed
  0f60fc5

  Copy full SHA for 0f60fc5

• Merge branch 'main' into resize_scheduler_opt

  naoyam

  committed
  75cc644

  Copy full SHA for 75cc644

• cleanup

  naoyam

  committed
  8bd2775

  Copy full SHA for 8bd2775

• Merge remote-tracking branch 'origin/main' into resize_scheduler_opt

  naoyam

  committed
  3493b91

  Copy full SHA for 3493b91

• Don't skip the full loop promotion analysis just because there's no root

  Show description for 4b56743
  naoyam

  committed
  4b56743

  Copy full SHA for 4b56743

Commits on Jan 18, 2025

• Clear expanded extent in TensorDomain::flatten (#3724)

  Show description for 977486f
  naoyam

  committed
  977486f

  Copy full SHA for 977486f

• WIP

  naoyam

  committed
  0c14cd2

  Copy full SHA for 0c14cd2

• cleanup

  naoyam

  committed
  a4deccc

  Copy full SHA for a4deccc

• repro

  naoyam

  committed
  8fa8f5f

  Copy full SHA for 8fa8f5f

• more diagnosis message

  naoyam

  committed
  dd5f8e3

  Copy full SHA for dd5f8e3

• cleanup

  naoyam

  committed
  377c6da

  Copy full SHA for 377c6da

• Merge remote-tracking branch 'origin/loop_promotion_fix' into resize_scheduler_opt

  naoyam

  committed
  15953b2

  Copy full SHA for 15953b2

• Merge remote-tracking branch 'origin/fix_vec_validation' into resize_scheduler_opt

  naoyam

  committed
  668d8cb

  Copy full SHA for 668d8cb