Deep Learning Meetup – RAdam: New State of the Art Optimizer

Lets talk about RAdam: A new state of the Art optimizer

Paper: On the Variance of the Adaptive Learning Rate and Beyond
(https://arxiv.org/abs/1908.03265v

Article: https://medium.com/@lessw/new-state-of-the-art-ai-optimizer-rectified-adam-radam-5d854730807b

If you can have a read of the paper or article before you come!

6:00 – Arrive
6:30 – Introductions
6:35 – Discussion
7:30 – End