From the source
Sakana AI introduced PC-ALM, a local-learning alternative to backpropagation that trains 1000-layer neural networks using only local dynamics.
- The method generalizes predictive coding with an augmented Lagrangian, introducing dual neurons (Lagrange multipliers) as part of layer-local dynamics, enabling signal propagation to arbitrary depth in deep narrow networks where standard predictive coding struggles.


