GPT-1 (2018)

OpenAI's first Generative Pre-trained Transformer (2018). Demonstrated that unsupervised pre-training on text followed by fine-tuning could achieve strong NLP performance.