Code

[ARM CPU] hgemm optimized for gqa#23107

Code

Merged

fajin-corp merged 22 commits intomainmicrosoft/onnxruntime:mainfrom fajin/gqa-hgemmmicrosoft/onnxruntime:fajin/gqa-hgemmCopy head branch name to clipboardJan 24, 2025

+2,594-34

Commits

Commits on Jan 13, 2025

• init

  fajin-corp

  committed
  8f48fe5

  Copy full SHA for 8f48fe5

• connect kernels

  fajin-corp

  committed
  ee3ff7e

  Copy full SHA for ee3ff7e

• added threading and blocking code

  fajin-corp

  committed
  94c4030

  Copy full SHA for 94c4030

• added fp16 kernel file

  fajin-corp

  committed
  d894f9a

  Copy full SHA for d894f9a

• adding kernels

  fajin-corp

  committed
  1214402

  Copy full SHA for 1214402

Commits on Jan 16, 2025

• added some notes to enrich the context

  fajin-corp

  committed
  0bf54a0

  Copy full SHA for 0bf54a0

• finishd packB kernel

  fajin-corp

  committed
  0e3baeb

  Copy full SHA for 0e3baeb

Commits on Jan 17, 2025

• finished hgemm m1 kernel

  fajin-corp

  committed
  f37276f

  Copy full SHA for f37276f

• finished m2 kernel

  fajin-corp

  committed
  5f73132

  Copy full SHA for 5f73132

Commits on Jan 18, 2025

• added template kernels for packedB hgemm

  fajin-corp

  committed
  2601bcd

  Copy full SHA for 2601bcd

Commits on Jan 21, 2025

• finished transposed packed hgemm m2 kernel

  fajin-corp

  committed
  389e328

  Copy full SHA for 389e328

Commits on Jan 22, 2025

• passed build

  fajin-corp

  committed
  d72f45e

  Copy full SHA for d72f45e

• fixed build warnings

  fajin-corp

  committed
  946c5b2

  Copy full SHA for 946c5b2

• fix mac build

  fajin-corp

  committed
  7559335

  Copy full SHA for 7559335

• fix ci

  fajin-corp

  committed
  b2b47c8

  Copy full SHA for b2b47c8

• fix windows build

  fajin-corp

  committed
  a71f736

  Copy full SHA for a71f736

Commits on Jan 23, 2025

• added kernel UT

  fajin-corp

  committed
  7ff22bf

  Copy full SHA for 7ff22bf

• passed all kernel uts

  fajin-corp

  committed
  59348cf

  Copy full SHA for 59348cf

• added mlas hgemm ut

  fajin-corp

  committed
  5d16333

  Copy full SHA for 5d16333

• fix linting

  fajin-corp

  committed
  8eae201

  Copy full SHA for 8eae201

Commits on Jan 24, 2025

• fixed qnn build

  fajin-corp

  committed
  8c8943b

  Copy full SHA for 8c8943b

• fix linting

  fajin-corp

  committed
  bf8bfb0

  Copy full SHA for bf8bfb0