Attention Mechanism (2014)

Bahdanau et al. (2014) introduced attention for neural machine translation, allowing models to dynamically focus on relevant input parts. The key insight behind transformers.