AI history

How did we get to today’s AI?

100 milestones · 1904 to today · each checked in at least 2 sources

Back to the timeline
Language

OpenAI publishes its first GPT language model

OpenAI researchers trained a transformer on thousands of books, then fine-tuned it on each task. It beat the best earlier results on 9 of the 12 tests the authors studied.

Why it mattersIt started OpenAI’s GPT line: GPT-2 and GPT-3 kept its design and trained larger models on more text.

Built on
Who and what
  • Alec Radford
  • Karthik Narasimhan
  • Tim Salimans
  • Ilya Sutskever
  • OpenAI60 stories
  • Transformer
  • Generative pre-training
  • Fine-tuning
We count only the page and your answer.Thank you. We counted only this page and your answer.
Next · LearnHow today’s AI models work: a short course

Checked 4 October 2026Corrections