Code

Refactoring of MVAU and VVAU#963

Code

Closed

mmrahorovic wants to merge 131 commits intoXilinx:refactor/rtl_integrationXilinx/finn:refactor/rtl_integrationfrom mmrahorovic:refactor/mvu_vvummrahorovic/finn:refactor/mvu_vvuCopy head branch name to clipboard

+2,152-1,349

Commits

Commits on Jan 3, 2023

• First changes to custom_op for RTL-based MVAU

  mmrahorovic

  committed
  be1503a

  Copy full SHA for be1503a

Commits on Apr 5, 2023

• Merge remote-tracking branch 'upstream/dev' into feature/dsp_packing

  mmrahorovic

  committed
  8265985

  Copy full SHA for 8265985

Commits on Apr 6, 2023

• [rtl custom op]: initial implementation of mvu_8sx9

  mmrahorovic

  committed
  afab9cd

  Copy full SHA for afab9cd

• [rtl custom op]: testbench for mvu_8sx9

  mmrahorovic

  committed
  a94fc3b

  Copy full SHA for a94fc3b

• [rtl custom op]: initial implementation of flow control component for mvu_8sx9

  mmrahorovic

  committed
  98f9acc

  Copy full SHA for 98f9acc

• [rtl custom op]: implementation of replay buffer for mvu

  mmrahorovic

  committed
  96925a9

  Copy full SHA for 96925a9

• [rtl custom op]: testbench for mvu_8sx9_axi (including axi_wrapper & compute kernel)

  mmrahorovic

  committed
  a3d1156

  Copy full SHA for a3d1156

• [rtl custom op]: initial implementation of verilog wrapper for mvu_8sx9_axi

  mmrahorovic

  committed
  2aea664

  Copy full SHA for 2aea664

• Merge remote-tracking branch 'upstream/dev' into feature/dsp_packing

  mmrahorovic

  committed
  c92e4e3

  Copy full SHA for c92e4e3

Commits on Apr 11, 2023

• [rtl mvu]: fix tab indentation

  mmrahorovic

  committed
  8b57849

  Copy full SHA for 8b57849

Commits on Apr 12, 2023

• [rtl custom op]: fix to indentation

  mmrahorovic

  committed
  5e61f42

  Copy full SHA for 5e61f42

• [rtl custom-op]: minor changes for compiler integration

  mmrahorovic

  committed
  cbee193

  Copy full SHA for cbee193

• [rtl custom op]: moved testbenches to separate directory

  mmrahorovic

  committed
  ba5e77b

  Copy full SHA for ba5e77b

• [rtl custom op]: fixed output width to ACCU_WIDTH

  mmrahorovic

  committed
  69310b4

  Copy full SHA for 69310b4

• [rtl custom op]: renamed file and added generic to switch between compute kernels

  mmrahorovic

  committed
  cfcff00

  Copy full SHA for cfcff00

• [rtl custom op]: renamed file and added generic to switch between compute kernels

  mmrahorovic

  committed
  72b5196

  Copy full SHA for 72b5196

Commits on May 8, 2023

• [rtl mvu]: added behavioral model DSP58

  mmrahorovic

  committed
  c068bb6

  Copy full SHA for c068bb6

• [rtl mvu]: extended flow control wrapper with additional compute core and other minor changes

  mmrahorovic

  committed
  18f94e7

  Copy full SHA for 18f94e7

• [rtl mvu]: fix to done_len flag when SIMD dimension fully unrolled and PyVerilator-related syntax change

  mmrahorovic

  committed
  6d4a0a7

  Copy full SHA for 6d4a0a7

• [rtl mvu tb]: updated testbench

  mmrahorovic

  committed
  90c547d

  Copy full SHA for 90c547d

• [builder]: added specialize_to_rtl step and changed standalone threshold layers to be by default true

  mmrahorovic

  committed
  0c37f1f

  Copy full SHA for 0c37f1f

• [builder]: added specialize_to_rtl step

  mmrahorovic

  committed
  5ccb016

  Copy full SHA for 5ccb016

• [custom op]: added custom op MatrixVectorActivation_rtl

  mmrahorovic

  committed
  f099f4b

  Copy full SHA for f099f4b

• [custom op]: added additional attribute to enable conversion to RTL (custom-op)

  mmrahorovic

  committed
  9a3b0fd

  Copy full SHA for 9a3b0fd

• [custom op]: modified ip-stitching and code generation

  mmrahorovic

  committed
  38aa930

  Copy full SHA for 38aa930

• [tests]: initial version of unit test for RTL custom op and specialize_to_rtl transformation for MVU

  mmrahorovic

  committed
  4e44934

  Copy full SHA for 4e44934

• [rtl mvu]: specialized compute core for 4-bit weights and activations for DSP48/DSP58

  mmrahorovic

  committed
  cc361d9

  Copy full SHA for cc361d9

• [rtl mvu]: specialized compute core for > 4-bit weights and activations for DSP48

  mmrahorovic

  committed
  8eefb53

  Copy full SHA for 8eefb53

• [fpgadataflow transform]: initial specialize_to_rtl_layers-transform for MVU

  mmrahorovic

  committed
  e7109e7

  Copy full SHA for e7109e7

Commits on May 9, 2023

• Merge remote-tracking branch 'upstream/dev' into feature/dsp_packing

  mmrahorovic

  committed
  d107b4d

  Copy full SHA for d107b4d

• [rtl mvu] fixes for latest memstream + linting

  

  maltanar

  authored and

  mmrahorovic

  committed
  5a868d1

  Copy full SHA for 5a868d1

Commits on May 11, 2023

• [rtl custom_op]: add support for external weights

  mmrahorovic

  committed
  4a9cfa1

  Copy full SHA for 4a9cfa1

• Specify clock and reset associations of bus interfaces.

  preusser

  committed
  8a9ac1a

  Copy full SHA for 8a9ac1a

Commits on May 21, 2023

• Merge remote-tracking branch 'upstream/dev' into feature/dsp_packing

  mmrahorovic

  committed
  51bbe02

  Copy full SHA for 51bbe02

Commits on May 23, 2023

• Merge branch 'dev' into feature/dsp_packing

  preusser

  committed
  3d856b7

  Copy full SHA for 3d856b7

• [rtlmvu] More fixes for memstream and param gen

  

  maltanar

  authored and

  mmrahorovic

  committed
  d9b9079

  Copy full SHA for d9b9079

• [Build] apply config to only FIFO nodes in step_set_fifo_depths

  

  maltanar

  authored and

  mmrahorovic

  committed
  a5f2a83

  Copy full SHA for a5f2a83

Commits on May 24, 2023

• Revised control interface attributes.

  preusser

  committed
  08cbdc5

  Copy full SHA for 08cbdc5

• Merge branch 'dev' into feature/dsp_packing

  preusser

  committed
  48f0c5c

  Copy full SHA for 48f0c5c

• Mask device primitives from Verilator in favor of using behavioral code.

  preusser

  committed
  d058cc2

  Copy full SHA for d058cc2

• [Deps] update qonnx

  

  maltanar

  authored and

  mmrahorovic

  committed
  a66f38f

  Copy full SHA for a66f38f

• Adding folding hints. Impl selection by case statement.

  preusser

  committed
  8f9bd04

  Copy full SHA for 8f9bd04

• Merge branch 'feature/verilator_workarounds' into feature/dsp_packing

  preusser

  committed
  8799707

  Copy full SHA for 8799707

• Fixed behavioral sideband prediction.

  preusser

  committed
  9de5ed6

  Copy full SHA for 9de5ed6

• Merge remote-tracking branch 'origin/feature/dsp_packing' into feature/dsp_packing

  mmrahorovic

  committed
  b6e92bb

  Copy full SHA for b6e92bb

• [rtl mvu]: extension to allow selecting PE values that are not multiples of 4

  mmrahorovic

  committed
  239759a

  Copy full SHA for 239759a

• [rtlmvu] Avoid unintentional verilator metacomments

  

  maltanar

  authored and

  preusser

  committed
  8d3247c

  Copy full SHA for 8d3247c

• Merge remote-tracking branch 'origin/feature/dsp_packing' into feature/dsp_packing

  mmrahorovic

  committed
  ffc11d6

  Copy full SHA for ffc11d6

• [rtl mvu]: extension to allow selecting PE values that are not multiples of 2

  mmrahorovic

  committed
  c866350

  Copy full SHA for c866350

• [rtl mvu axi]: updated comments on folding hints

  mmrahorovic

  committed
  fd1e038

  Copy full SHA for fd1e038

Commits on Jun 2, 2023

• [rtl custom op]: minor fixes to codegen

  mmrahorovic

  committed
  f60d4c6

  Copy full SHA for f60d4c6

• [specialize-to-rtl]: add ram_style and rt_writeable_weights support

  mmrahorovic

  committed
  a1ad304

  Copy full SHA for a1ad304

• [rtllib]: change string type to parameter type due to Vivado error

  mmrahorovic

  committed
  2cbb68f

  Copy full SHA for 2cbb68f

• [rtllib]: renamed variable for consistency

  mmrahorovic

  committed
  92eb0ed

  Copy full SHA for 92eb0ed

• Fix improper blocking assignment & linting.

  preusser

  committed
  471a221

  Copy full SHA for 471a221

• [test rtl mvu]: modified/extended test cases

  mmrahorovic

  committed
  5c5dc09

  Copy full SHA for 5c5dc09

Commits on Jun 30, 2023

• [rtl mvu]: updated DSP58 >4-bit variant to lift SIMD%3==0 restriction

  mmrahorovic

  committed
  b4eb9b6

  Copy full SHA for b4eb9b6

• [rtl mvu]: bug fix for SIMD=1 init_leave_loads

  mmrahorovic

  committed
  ad63673

  Copy full SHA for ad63673

Commits on Jul 13, 2023

• [mvu rtl]: restrict index i to be less than 3 (within bounds of hi4)

  mmrahorovic

  committed
  79e8a5e

  Copy full SHA for 79e8a5e

Commits on Jul 17, 2023

• Merge remote-tracking branch 'upstream/dev' into feature/dsp_packing

  mmrahorovic

  committed
  7be62b4

  Copy full SHA for 7be62b4

Commits on Jul 27, 2023

• Rewrite replay_buffer for input elasticity.

  

  preusser

  authored and

  mmrahorovic

  committed
  e3493c3

  Copy full SHA for e3493c3

Commits on Jul 31, 2023

• Merge remote-tracking branch 'upstream/dev' into feature/dsp_packing

  mmrahorovic

  committed
  44fae0c

  Copy full SHA for 44fae0c

Commits on Aug 16, 2023

• Merge remote-tracking branch 'upstream/dev' into feature/dsp_packing

  mmrahorovic

  committed
  df51f11

  Copy full SHA for df51f11

Commits on Sep 5, 2023

• [to-rtl]: Infer unique node names after transformation is applied

  mmrahorovic

  committed
  2efba68

  Copy full SHA for 2efba68

Commits on Sep 18, 2023

• [mvu rtl]: add synthesis directive to handle 'X in simulation

  mmrahorovic

  committed
  114ea1b

  Copy full SHA for 114ea1b

• [replay buffer rtl]: minor fix to when LEN=1 (= AWIDTH=0)

  mmrahorovic

  committed
  79fafdb

  Copy full SHA for 79fafdb

• [mvu lut]: LUT-based MVU compute core

  mmrahorovic

  committed
  619d9db

  Copy full SHA for 619d9db

Commits on Sep 19, 2023

• [custom op]: add preferred_backend attribute

  mmrahorovic

  committed
  090f2ac

  Copy full SHA for 090f2ac

Commits on Sep 21, 2023

• Ensure a minimum of two buffer slots even for length-1 sequences.

  preusser

  committed
  ac5e82d

  Copy full SHA for ac5e82d

• Merge pull request #1 from Xilinx/bugfix/replay_len1

  Show description for d5ff2a2
  mmrahorovic

  authored
  d5ff2a2

  Copy full SHA for d5ff2a2

• Merge remote-tracking branch 'origin/feature/dsp_packing' into feature/dsp_packing

  mmrahorovic

  committed
  bb94092

  Copy full SHA for bb94092

• [rtl mvu wrapper]: support for vvu layer and rename

  mmrahorovic

  committed
  8515693

  Copy full SHA for 8515693

• [mvu vvu tb]: modified testbench to also support testing VVU on DSP58

  mmrahorovic

  committed
  cf28d78

  Copy full SHA for cf28d78

• [axi wrapper]: minor modification to comment description

  mmrahorovic

  committed
  2617c39

  Copy full SHA for 2617c39

• [mvu axi]: add support for VVU on DSP58

  mmrahorovic

  committed
  8ca5fe7

  Copy full SHA for 8ca5fe7

• [mvu vvu axi]: renamed file for consistency purposes

  mmrahorovic

  committed
  32d6338

  Copy full SHA for 32d6338

• [mvu 8sx9]: added support for VVU on DSP58, resolved PyVerilator-caused error and added synthesis directive to handle 'X in input data

  mmrahorovic

  committed
  031406d

  Copy full SHA for 031406d

• [mvu vvu 8sx9]: renamed compute core for consistency

  mmrahorovic

  committed
  e2c1f15

  Copy full SHA for e2c1f15

• [axi wrapper]: changed parameter to localparam

  mmrahorovic

  committed
  adb5869

  Copy full SHA for adb5869

• [axi]: added support for LUT-based VVU

  mmrahorovic

  committed
  f54d438

  Copy full SHA for f54d438

• [mvu vvu 8sx9]: minor change to list of generics

  mmrahorovic

  committed
  a4e2ac7

  Copy full SHA for a4e2ac7

• [mvu lut]: added support for VVU

  mmrahorovic

  committed
  40ad0b4

  Copy full SHA for 40ad0b4

• [mvu vvu lut]: renamed file for consistency

  mmrahorovic

  committed
  30fcb5b

  Copy full SHA for 30fcb5b

• Revert to proper address truncation without generation bit.

  

  preusser

  authored and

  mmrahorovic

  committed
  cb43438

  Copy full SHA for cb43438

• remove deletd/renamed files

  mmrahorovic

  committed
  b4b69f3

  Copy full SHA for b4b69f3

• [mvu vvu 8sx9]: renamed for consistency

  mmrahorovic

  committed
  14c5fa9

  Copy full SHA for 14c5fa9

• [mvu vvu axi]: changes for renamed module

  mmrahorovic

  committed
  3a37588

  Copy full SHA for 3a37588

Commits on Sep 25, 2023

• [mvu vvu wrapper]: convert localparam to param

  mmrahorovic

  committed
  afe36ba

  Copy full SHA for afe36ba

• [mvau-rtl custom-op]: bugfix to instantiate memstreamer, modified renamed files and axi wrapper template fill-out

  mmrahorovic

  committed
  e4f2f9e

  Copy full SHA for e4f2f9e

• [specialize to rtl]: fix to changed attribute name and added support for converting HLS-based VVU custom-ops to RTL-based custom-ops

  mmrahorovic

  committed
  b49b79a

  Copy full SHA for b49b79a

• Adding core for DSP48 backport.

  

  preusser

  authored and

  mmrahorovic

  committed
  9bdba03

  Copy full SHA for 9bdba03

• [mvu rtl core]: added support for signed activations for DSP48-based MVUs

  mmrahorovic

  committed
  2cf1ef7

  Copy full SHA for 2cf1ef7

• [rtl mvu custom-op]: add upper bound to SEGMENTLEN equal to number of DSP58s chained together

  mmrahorovic

  committed
  ab8d4a8

  Copy full SHA for ab8d4a8

Commits on Oct 13, 2023

• [mvu_vvu dsp58]: change weight input to 2D instead of 3D array

  mmrahorovic

  committed
  5a429fc

  Copy full SHA for 5a429fc

• [mvu_vvu axi]: re-wire weights appropriately for VVU DSP58

  mmrahorovic

  committed
  a4a18bb

  Copy full SHA for a4a18bb

• [mvu_vvu axi wrapper]: fix to IS_MVU parameter

  mmrahorovic

  committed
  cc0737b

  Copy full SHA for cc0737b

• [mvu_vvu tb]: WIP -- changes to self-checker and shape of input data

  mmrahorovic

  committed
  c0eff0b

  Copy full SHA for c0eff0b

Commits on Nov 27, 2023

• [mvu vvu axi]: minor bugfixes to enable VVU

  mmrahorovic

  committed
  cf7f494

  Copy full SHA for cf7f494

• [mvu vvu axi]: minor fix -- define mvauin_weight_t

  mmrahorovic

  committed
  5ffc221

  Copy full SHA for 5ffc221

• Merge remote-tracking branch 'upstream/dev' into feature/dsp_packing

  mmrahorovic

  committed
  d573043

  Copy full SHA for d573043

Commits on Nov 29, 2023

• [rtl mvu op]: minor fix to chain length estimation and enabled behavioral mode for rtl sim

  mmrahorovic

  committed
  40d652c

  Copy full SHA for 40d652c

Commits on Jan 4, 2024

• [rtlsim]: use pyverilator util functions

  mmrahorovic

  committed
  6e98bac

  Copy full SHA for 6e98bac

• [mvu vvu axi]: sign extend output tdata (byte-aligned)

  mmrahorovic

  committed
  5dd74ad

  Copy full SHA for 5dd74ad

Commits on Jan 8, 2024

• [mvu core]: dsp48 convert unpacked array to packed array to work around limitation on max array indices in Verilator

  mmrahorovic

  committed
  b20410b

  Copy full SHA for b20410b

• [mvu axi]: update list of deduced parameters

  mmrahorovic

  committed
  1c2cc0c

  Copy full SHA for 1c2cc0c

• [mvu custom-op]: remove lut-based implementation and update compute core selection

  mmrahorovic

  committed
  eeb3cea

  Copy full SHA for eeb3cea

• [mvu axi]: remove LUT-based compute core

  mmrahorovic

  committed
  0813d14

  Copy full SHA for 0813d14

Commits on Jan 11, 2024

• [hls custom-op]: enable reset in sim

  mmrahorovic

  committed
  4892d66

  Copy full SHA for 4892d66

• [test mvu rtl]: updated test flow (DSP58 only)

  mmrahorovic

  committed
  44f6e0f

  Copy full SHA for 44f6e0f

• [mvu vvu axi]: reworked flow control and backpressure handling by tpreusser

  mmrahorovic

  committed
  9b2cceb

  Copy full SHA for 9b2cceb

• Merge remote-tracking branch 'origin/feature/dsp_packing' into refactor/mvu_vvu

  mmrahorovic

  committed
  8b46c90

  Copy full SHA for 8b46c90

• [hlsbackend]: update limit HLS axi streams (8k-1)

  mmrahorovic

  committed
  4ab6596

  Copy full SHA for 4ab6596

Commits on Jan 18, 2024

• Merge remote-tracking branch 'upstream/refactor/rtl_integration' into refactor/mvu_vvu

  mmrahorovic

  committed
  3011144

  Copy full SHA for 3011144

Commits on Jan 26, 2024

• Merge remote-tracking branch 'upstream/refactor/rtl_integration' into refactor/mvu_vvu

  mmrahorovic

  committed
  c3ce0c6

  Copy full SHA for c3ce0c6

• [mvau hls]: refactored MVAU_hls custom_op

  mmrahorovic

  committed
  72ccc83

  Copy full SHA for 72ccc83

• [refactor]: call to base_op_type method instead of custom_op type

  mmrahorovic

  committed
  7a9b82b

  Copy full SHA for 7a9b82b

• [hls custom-op]: add mvau_hls

  mmrahorovic

  committed
  4556d2d

  Copy full SHA for 4556d2d

• [hw custom-op]: refactor MVAU

  mmrahorovic

  committed
  0b2fc98

  Copy full SHA for 0b2fc98

• [VVAU hw custom-op]: add base_op_type method

  mmrahorovic

  committed
  1a40e6a

  Copy full SHA for 1a40e6a

• [transform]: add transformation to infer MVAU hw custom-op

  mmrahorovic

  committed
  5e1ed9b

  Copy full SHA for 5e1ed9b

• removed mvu rtl code to clean up PR

  mmrahorovic

  committed
  63c73c2

  Copy full SHA for 63c73c2

• [test mvau]: modified to support new custom-ops

  mmrahorovic

  committed
  472ce11

  Copy full SHA for 472ce11

• removed rtl refactoring steps

  mmrahorovic

  committed
  31083d5

  Copy full SHA for 31083d5

• removed old rtl custom-op

  mmrahorovic

  committed
  0032743

  Copy full SHA for 0032743

• removed old specialize_to_rtl transform

  mmrahorovic

  committed
  04ec562

  Copy full SHA for 04ec562

• removed rtl custom-op test

  mmrahorovic

  committed
  de778cf

  Copy full SHA for de778cf

Commits on Feb 1, 2024

• Merge remote-tracking branch 'upstream/refactor/rtl_integration' into refactor/mvu_vvu

  mmrahorovic

  committed
  4a47437

  Copy full SHA for 4a47437

• [vvau hls]: add custom op to dict

  mmrahorovic

  committed
  911239c

  Copy full SHA for 911239c

• [vvu hw-op]: refactored hw custom-op VVAU

  mmrahorovic

  committed
  b1ee540

  Copy full SHA for b1ee540

• [vvau hls-op]: refactored HLS custom-op VVAU

  mmrahorovic

  committed
  bc44a4d

  Copy full SHA for bc44a4d

• [convert-to-hw]: added transformations to infer binary-MVAU and VVAU

  mmrahorovic

  committed
  faabc0f

  Copy full SHA for faabc0f