Neural Networks & Computer Vision
Deep learning from scratch β perceptrons, backprop, CNNs, RNNs, transformers, and hands-on projects.
π Assignments & course material (original docs shared in the course)
Why deep learning quietly took over the world
β± 19 min read Β· π 4 topics
Welcome to your very first Neural Nets class.
Why "deep" actually wins β a second, deeper look
β± 20 min read Β· π 4 topics
In Session 1 we met the headline idea: stack many layers and the network learns its own features.
From Perceptron to Multi-Layer Perceptron
β± 20 min read Β· π 4 topics
Welcome back!
How a neural network actually learns
β± 20 min read Β· π 4 topics
This is the session where the magic stops being magic.
How a neural net measures its mistakes β and fixes them
β± 21 min read Β· π 5 topics
In Session 4 we learned how backpropagation figures out which way each weight should move.
Regularization β Fighting Overfitting
β± 21 min read Β· π 5 topics
Your network can train perfectly on its homework and still flunk the real exam.
Why training a deep net sometimes just⦠fails (and how to fix it)
β± 23 min read Β· π 5 topics
You've built a network, you've picked a loss, you press "train" β and the loss either sits flat forever or explodes into NaN .
Let's actually build a neural network β twice
β± 20 min read Β· π 4 topics
Up to now we've been learning the pieces: neurons, activations, gradient descent, backprop, regularization, initialization.
Convolutions β Seeing with Neural Networks
β± 23 min read Β· π 5 topics
Welcome to the start of the Computer Vision part of the course.
The famous CNNs, from a tiny digit reader to 152 layers deep
β± 19 min read Β· π 5 topics
Last session you learned what a convolution is .
Standing on the shoulders of giant models
β± 18 min read Β· π 4 topics
In Session 10 we built powerful CNN architectures.
Teaching a network to remember: how RNNs read things in order
β± 20 min read Β· π 5 topics
Until now our networks looked at one thing at a time β one image, one fixed row of features.
Teaching a network to remember (and forget) on purpose
β± 21 min read Β· π 5 topics
Last session we built plain RNNs and watched them choke on long sequences β the dreaded vanishing gradient.
Teaching a network to translate β and to look back
β± 17 min read Β· π 4 topics
Last few sessions we built up RNNs, LSTMs and GRUs β networks that read sequences one step at a time.
The Transformer, from the dot product up
β± 21 min read Β· π 5 topics
Last session we taught a recurrent network to translate by reading one word at a time and leaning on an attention "spotlight." Today we take a boldβ¦
BERT, GPT & how machines chop text into tokens
β± 21 min read Β· π 5 topics
Last session we built the Transformer from scratch.
Turn your photo into a Van Gogh painting
β± 19 min read Β· π 4 topics
This is a project week β we build something real and beautiful from scratch.
Build a Shakespeare bot and a translator
β± 21 min read Β· π 4 topics
This is a project week β less lecture, more building.
Let's build a tiny GPT, from scratch, that writes text
β± 22 min read Β· π 4 topics
This is a project session β no new theory dumped on you, just rolling up our sleeves and building a real, runnable mini-Transformer in PyTorch .
Project Week: train your very own small language model
β± 19 min read Β· π 4 topics
This is the capstone β the session where everything you've learned becomes a real, running thing.