Code

Agents: Short-Horizon Actor Critic#262

Code

Open

peabody124 wants to merge 10 commits intogoogle:maingoogle/brax:mainfrom peabody124:shacpeabody124/brax:shacCopy head branch name to clipboard

+851-8

Commits

Commits on Nov 18, 2022

• SHAC: check in stub based on PPO

  peabody124

  committed
  2171b08

  Copy full SHA for 2171b08

• Basic SHAC equations

  Show description for 63db1f1
  peabody124

  committed
  63db1f1

  Copy full SHA for 63db1f1

Commits on Nov 19, 2022

• SHAC: start to split actor/critic learning

  Show description for b7dad1e
  peabody124

  committed
  b7dad1e

  Copy full SHA for b7dad1e

• SHAC: differentiate rewards w.r.t. actions

  peabody124

  committed
  9b5111c

  Copy full SHA for 9b5111c

• Envs: fast differentiable environment

  Show description for 727d5bc
  peabody124

  committed
  727d5bc

  Copy full SHA for 727d5bc

• APG: test on fast_differentiable

  Show description for 5d35010
  peabody124

  committed
  5d35010

  Copy full SHA for 5d35010

• SHAC: passing unit tests now

  peabody124

  committed
  44830aa

  Copy full SHA for 44830aa

• SHAC: add target network

  peabody124

  committed
  4000c95

  Copy full SHA for 4000c95

Commits on Nov 20, 2022

• SHAC: layer norm and gradient clipping

  Show description for 8ff7005
  peabody124

  committed
  8ff7005

  Copy full SHA for 8ff7005

Commits on Dec 1, 2022

• SHAC: tweak layer norm

  peabody124

  committed
  afec266

  Copy full SHA for afec266