AI history

How did we get to today’s AI?

100 milestones · 1904 to today · each checked in at least 2 sources

Back to the timeline
Language

Attention is added to neural machine translation

In September 2014, Dzmitry Bahdanau, Kyunghyun Cho and Yoshua Bengio published a new design for translation by neural networks. While writing each word, the model looks back at the source words that matter most.

Why it mattersAttention became a standard part of language models, and in 2017 the transformer was built on attention alone.

Who and what
  • Dzmitry Bahdanau
  • Kyunghyun Cho
  • Yoshua Bengio
  • Université de Montréal
  • Jacobs University Bremen
  • Attention
  • Machine translation
We count only the page and your answer.Thank you. We counted only this page and your answer.
Next · LearnHow today’s AI models work: a short course

Checked 4 October 2026Corrections