LSTM (1997)

Hochreiter and Schmidhuber's 1997 Long Short-Term Memory solved the vanishing gradient problem with gated memory cells. Dominated sequence modeling for 20 years.