AI history

How did we get to today’s AI?

100 milestones · 1904 to today · each checked in at least 2 sources

Every milestone, oldest first

100 milestones

Foundations · 1900–1949

AI is born · 1950–1975

Expert systems, networks and learning · 1976–1999

Data, GPUs and deep learning · 2000–2016

The transformer era · 2017–today

Back to the timeline
Language

Google’s BERT reads language in both directions

Google researchers introduced BERT, a language model that uses the words on both sides of a word to understand it. It set new best results on eleven language tests, and Google shared the code in November 2018.

Why it mattersOpen code let anyone build on it, and in October 2019 Google said it was bringing BERT to Search.

Built on
Who and what
  • Jacob Devlin
  • Ming-Wei Chang
  • Kenton Lee
  • Kristina Toutanova
  • Google38 stories
  • Transformer
  • Masked language modelling
  • Pre-training and fine-tuning
We count only the page and your answer.Thank you. We counted only this page and your answer.
Next · LearnHow today’s AI models work: a short course

Checked 4 October 2026Corrections