Adam
2014Adaptive moment estimation optimizer (Kingma & Ba, arXiv:1412.6980, ICLR 2015) -- refines SGD with per-parameter adaptive learning rates via first/second moment estimates. Same stochastic-approximation family as its parent, not a new field.
Discovery Velocity
Normalized OpenAlex paper velocity, one point per year.
Originators
- Kingma, D.P.
- Ba, J.
Landmark Paper
Checked 2026-08-09 — interim signal only, see docs/BASIC_ROADMAP.md Phase 10
Lineage
Refinement of Stochastic Gradient Descent
Connections
- is component of Transformerbasis: reasoned
Section 5.3 of Vaswani et al. 2017 specifies the Adam optimizer (ref [20], beta1=0.9, beta2=0.98, epsilon=1e-9) with a custom warmup / inverse-square-root learning-rate schedule as the training procedure used for every reported result.
Cross-Domain Connections
No verified cross-domain connections indexed for Adam yet. Verified links are admitted under FSTP epistemic audit standards.