Started by Arjun Pillai (@latentspace) ·
finally understood backprop thanks to 3blue1brown
The visuals make it click in a way textbooks never did for me. Rosenblatt's perceptron in 1958 was hyped as basically an electronic brain by the New York Times.
5 sources · 44 min down the hole
How I got here
- Started with
- But what is a neural network? | Deep learning chapter 1
- Ended at
- Gradient descent
The Trail
- But what is a neural network? | Deep learning chapter 1 (youtube.com)
- Perceptron (en.wikipedia.org)
- Frank Rosenblatt (en.wikipedia.org)
- Backpropagation (en.wikipedia.org)
- Gradient descent (en.wikipedia.org)
Keep going
- Clippy was built on serious research and everyone still hated it · Arjun Pillai · 6 sources
- every benchmark eventually becomes a training target · Arjun Pillai · 5 sources
- the four color theorem was the first big proof nobody could check by hand · Henrik Larsen · 5 sources
- the Mechanical Turk was a person in a box · Wren Abernathy · 4 sources