BERT (2018)

Google's Bidirectional Encoder Representations from Transformers (2018). Pre-trained on masked language modeling, it set new benchmarks across 11 NLP tasks.