ReportingPrimary source

Deep Neural Nets: 33 years ago and 33 years from now

.post-header h1 { font-size: 35px; } .post pre, .post code { background-color: #fcfcfc; font-size: 13px; /* make code smaller for this post... */ } The Yann LeCun et al. (1989) paper Backpropagation Applied to Handwritten Zip Code Recognition is I believe of some historical si…

Karpathy Blog·Monday, March 14, 2022 at 7:00 AM UTC

Andrej Karpathy

Founder · Eureka Labs

Fetching source· Pulling live content from karpathy.github.io…

Read original →

More from Andrej Karpathy

ReportingThursday, February 12, 2026 at 7:00 AM UTC
microgpt
.post-header h1 { font-size: 35px; } .post pre, .post code { background-color: #fcfcfc; font-size: 13px; /* make code smaller for this post... */ } This is a brief guide to my new art project microgpt , a single file of 200 lines of pure Python with no dependencies that trains…
Karpathy Blog
ReportingMonday, June 21, 2021 at 10:00 AM UTC
A from-scratch tour of Bitcoin in Python
.wrap { max-width: 900px; } p { font-family: sans-serif; font-size: 15px; font-weight: 300; overflow-wrap: break-word; /* allow wrapping of very very long strings, like txids */ } .post pre, .post code { background-color: #fafafa; font-size: 13px; /* make code smaller for this…
Karpathy Blog
ReportingSaturday, March 27, 2021 at 10:00 AM UTC
Short Story on AI: Forward Pass
p { text-align: justify; } .post pre, .post code { border: none; background-color: #eee; } The inspiration for this short story came to me while reading Kevin Lacker’s Giving GPT-3 a Turing Test . It is probably worth it (though not required) to skim this post to get a bit of …
Karpathy Blog
ReportingThursday, June 11, 2020 at 10:00 AM UTC
Biohacking Lite
Throughout my life I never paid too much attention to health, exercise, diet or nutrition. I knew that you’re supposed to get some exercise and eat vegetables or something, but it stopped at that (“mom said”-) level of abstraction. I also knew that I can probably get away with…
Karpathy Blog
ReportingThursday, April 25, 2019 at 9:00 AM UTC
A Recipe for Training Neural Networks
Some few weeks ago I posted a tweet on “the most common neural net mistakes”, listing a few common gotchas related to training neural nets. The tweet got quite a bit more engagement than I anticipated (including a webinar :)). Clearly, a lot of people have personally encounter…
Karpathy Blog
ReportingSaturday, January 20, 2018 at 11:00 AM UTC
(started posting on Medium instead)
The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared. I’ve certainly become less active on blogs since I’ve joined Tesla, but whenever I do get a chance to post something I have recently been defaulting to doing it on Medium becau…
Karpathy Blog

Deep Neural Nets: 33 years ago and 33 years from now

microgpt

A from-scratch tour of Bitcoin in Python

Short Story on AI: Forward Pass

Biohacking Lite

A Recipe for Training Neural Networks

(started posting on Medium instead)