πŸ“š Study Notes / Home / Neural Nets
Subject 03 Β· Neural Networks & Computer Vision

Neural Networks & Computer Vision

Deep learning from scratch β€” perceptrons, backprop, CNNs, RNNs, transformers, and hands-on projects.

πŸ“Ž Assignments & course material (original docs shared in the course)

SESSION 01

Why deep learning quietly took over the world

⏱ 19 min read Β· πŸ“– 4 topics

Welcome to your very first Neural Nets class.

Read notes β†’
SESSION 02

Why "deep" actually wins β€” a second, deeper look

⏱ 20 min read Β· πŸ“– 4 topics

In Session 1 we met the headline idea: stack many layers and the network learns its own features.

Read notes β†’
SESSION 03

From Perceptron to Multi-Layer Perceptron

⏱ 20 min read Β· πŸ“– 4 topics

Welcome back!

Read notes β†’
SESSION 04

How a neural network actually learns

⏱ 20 min read Β· πŸ“– 4 topics

This is the session where the magic stops being magic.

Read notes β†’
SESSION 05

How a neural net measures its mistakes β€” and fixes them

⏱ 21 min read Β· πŸ“– 5 topics

In Session 4 we learned how backpropagation figures out which way each weight should move.

Read notes β†’
SESSION 06

Regularization β€” Fighting Overfitting

⏱ 21 min read Β· πŸ“– 5 topics

Your network can train perfectly on its homework and still flunk the real exam.

Read notes β†’
SESSION 07

Why training a deep net sometimes just… fails (and how to fix it)

⏱ 23 min read Β· πŸ“– 5 topics

You've built a network, you've picked a loss, you press "train" β€” and the loss either sits flat forever or explodes into NaN .

Read notes β†’
SESSION 08

Let's actually build a neural network β€” twice

⏱ 20 min read Β· πŸ“– 4 topics

Up to now we've been learning the pieces: neurons, activations, gradient descent, backprop, regularization, initialization.

Read notes β†’
SESSION 09

Convolutions β€” Seeing with Neural Networks

⏱ 23 min read Β· πŸ“– 5 topics

Welcome to the start of the Computer Vision part of the course.

Read notes β†’
SESSION 10

The famous CNNs, from a tiny digit reader to 152 layers deep

⏱ 19 min read Β· πŸ“– 5 topics

Last session you learned what a convolution is .

Read notes β†’
SESSION 11

Standing on the shoulders of giant models

⏱ 18 min read Β· πŸ“– 4 topics

In Session 10 we built powerful CNN architectures.

Read notes β†’
SESSION 12

Teaching a network to remember: how RNNs read things in order

⏱ 20 min read Β· πŸ“– 5 topics

Until now our networks looked at one thing at a time β€” one image, one fixed row of features.

Read notes β†’
SESSION 13

Teaching a network to remember (and forget) on purpose

⏱ 21 min read Β· πŸ“– 5 topics

Last session we built plain RNNs and watched them choke on long sequences β€” the dreaded vanishing gradient.

Read notes β†’
SESSION 14

Teaching a network to translate β€” and to look back

⏱ 17 min read Β· πŸ“– 4 topics

Last few sessions we built up RNNs, LSTMs and GRUs β€” networks that read sequences one step at a time.

Read notes β†’
SESSION 15

The Transformer, from the dot product up

⏱ 21 min read Β· πŸ“– 5 topics

Last session we taught a recurrent network to translate by reading one word at a time and leaning on an attention "spotlight." Today we take a bold…

Read notes β†’
SESSION 16

BERT, GPT & how machines chop text into tokens

⏱ 21 min read Β· πŸ“– 5 topics

Last session we built the Transformer from scratch.

Read notes β†’
SESSION 17

Turn your photo into a Van Gogh painting

⏱ 19 min read Β· πŸ“– 4 topics

This is a project week β€” we build something real and beautiful from scratch.

Read notes β†’
SESSION 18

Build a Shakespeare bot and a translator

⏱ 21 min read Β· πŸ“– 4 topics

This is a project week β€” less lecture, more building.

Read notes β†’
SESSION 19

Let's build a tiny GPT, from scratch, that writes text

⏱ 22 min read Β· πŸ“– 4 topics

This is a project session β€” no new theory dumped on you, just rolling up our sleeves and building a real, runnable mini-Transformer in PyTorch .

Read notes β†’
SESSION 20

Project Week: train your very own small language model

⏱ 19 min read Β· πŸ“– 4 topics

This is the capstone β€” the session where everything you've learned becomes a real, running thing.

Read notes β†’