Kingma et al. (2014) — ARXIV-1412.6980
date: is when this note was filed; published: is what the paper is about.
Luria measures staleness from the former, so putting a publication date in
date: would report every unreviewed note as years overdue.
Key takeaways
- Combines the advantages of AdaGrad and RMSProp.
- Corrects bias in the moment estimates.