Code

BERT Layer Built-In#2184

Code

Closed

MaximilianSchreff wants to merge 10 commits intoapache:mainapache/systemds:mainfrom MaximilianSchreff:bert_layerMaximilianSchreff/systemds:bert_layerCopy head branch name to clipboard

+647-1

Commits

Commits on Jan 25, 2025

• Bert Layer forward pass

  MaximilianSchreff

  committed
  1fb904d

  Copy full SHA for 1fb904d

• Fixed bug

  MaximilianSchreff

  committed
  a480bbd

  Copy full SHA for a480bbd

• bert layer forward pass testing script

  MaximilianSchreff

  committed
  1757944

  Copy full SHA for 1757944

• Java automated unit tests for forward bert layer

  MaximilianSchreff

  committed
  767602f

  Copy full SHA for 767602f

• Small tweaks

  MaximilianSchreff

  committed
  0519335

  Copy full SHA for 0519335

• Testing data for test case

  MaximilianSchreff

  committed
  7223ae0

  Copy full SHA for 7223ae0

• Bug in MultiAttentionLayerTest

  MaximilianSchreff

  committed
  3ee1e00

  Copy full SHA for 3ee1e00

• GELU activation support in BERT layer

  MaximilianSchreff

  committed
  ba985bd

  Copy full SHA for ba985bd

• New GELU test case

  MaximilianSchreff

  committed
  043338b

  Copy full SHA for 043338b

Commits on Jan 26, 2025

• Added intermediate outputs to output of forward pass for use in backward pass

  MaximilianSchreff

  committed
  1eefe7c

  Copy full SHA for 1eefe7c