Andrej Karpathy AI diagram
Andrej Karpathy's journey is almost too cinematic: a kid from Bratislava moves to Canada at 15, earns a PhD at Stanford, builds the deep learning course that half the industry secretly learned from, becomes one of the 11 founders of OpenAI, gets poached by Tesla to teach cars how to see, then walks away to teach the entire internet on his YouTube channel. The full thread is at
Transcript (en)
Car to drive and I sort of showed the slide at the time where you can imagine that the inputs to the car are on the bottom and they're going through a software stack to produce the steering and acceleration and I made the observation at the time that there was a ton of C++ code around in the autopilot which was the software 1.0 code and then there was some neural nets in there doing image recognition and I kind of observed that over time as we made the autopilot better basically the neural network grew in capability and size and in addition to that, all the C++ code was being deleted and kind of like was, and a lot of the kind of capabilities and functionality that was originally written in 1.0 was migrated to 2.0. So as an example, a lot of the stitching up of information across images from the different cameras and across time was done by a neural network, and we were able to delete a lot of code. And so the software 2.0 stack quite literally ate through the software stack of the autopilot. So I thought this was really remarkable at the time.
