#Adam

The Adam optimizer explained: the algorithm that trains most neural networks

Adam combined momentum with per-parameter learning rates and became the default way to train deep learning models. How it works, why it won and its known pitfalls.

AI Desk·Oct 18·4 min read