January 1, 2026

DIY AI: NumPy vs C — Gloves off

Build a Deep Learning Library

Build a Deep Learning Library: DIY buzz, C purists grumble, Karpathy fans nod along

TLDR: A free online book shows how to build your own AI tool with NumPy, training simple models on handwritten digits. Comments erupted into a friendly brawl: C-language loyalists want more grit, others praise NumPy for clarity, and many compare it to Karpathy’s lectures while dropping their own DIY repos.

Forget downloading yet another AI toolkit — this free online book says build your own. Starting with a blank file and NumPy (a popular math toolbox), it walks you to a “teach-your-code-to-learn” engine and simple layers, then trains handwritten digits (MNIST) and baby versions of image models. It’s free, with pay‑what‑you‑want on Gumroad, and there’s even an email for feedback. The crowd showed up with soldering irons and receipts: amitav1 flexed a C++ attempt to build a whole chatbot brain, sharing a repo; csantini chimed in that DIY is the best way to learn, linking claudioflow; grandimam cheered it as perfect for software engineers fed up with black boxes.

Then came the spice. yunnpp waved the C flag: NumPy is comfy, but real understanding means wrestling pointers, not pillows. Others shot back that NumPy keeps the math honest, and beginners shouldn’t get lost in memory gymnastics. silentsea90 asked if this is basically Karpathy’s “Zero to Hero” — cue the meme wars of “Karpathy approved” vs “we were doing this before it was cool.” Jokes flew: “DIY or die,” “I, for one, welcome our C overlords,” and “autograd is just your code doing its own homework.” Beginners cheered, purists sharpened their knives

Key Points

  • The book teaches how to build a deep learning library from scratch.
  • Implementation uses NumPy as the foundational tool.
  • It includes developing a functional autograd engine and layer modules.
  • The library is applied to train MNIST with simple CNN and simple ResNet examples.
  • The resource is free online with a pay-what-you-want option via Gumroad and provides an email for feedback.

Hottest takes

"Shelling out to numpy isn’t particularly exciting" — yunnpp
"best way to learn neural nets and backprop" — csantini
"The goal was to build an entire LLM, but I only got to neural networks" — amitav1
Made with <3 by @siedrix and @shesho from CDMX. Powered by Forge&Hive.