AI history

How did we get to today’s AI?

100 milestones · 1904 to today · each checked in at least 2 sources

AI methods: the milestones

36 milestones
Back to the timeline
AI methods

Deep belief nets: a fast way to train deep networks

In July 2006, Geoffrey Hinton, Simon Osindero and Yee-Whye Teh published a fast way to train neural networks with many layers. It trains one layer at a time, then fine-tunes the whole network.

Why it mattersIt made networks with many layers trainable and was a milestone on the road to what is now called deep learning.

Note Deep networks were studied before 2006: a survey by Jürgen Schmidhuber traces them back to 1965 and says the name “deep learning” took off around 2006.

Built on
Who and what
  • Geoffrey Hinton
  • Simon Osindero
  • Yee-Whye Teh
  • University of Toronto
  • National University of Singapore
  • Deep learning
  • Neural networks
We count only the page and your answer.Thank you. We counted only this page and your answer.
Next · LearnHow today’s AI models work: a short course

Checked 4 October 2026Corrections