Learn ML / Stage 4

4 · Deep learning

Neural networks, from first principles to transformers and language models. Builds on stages 1 to 3.

By the end of this stage, you can…build and train a neural network in PyTorch, explain backpropagation, choose between a CNN, a recurrent network and a transformer for a given kind of data, and read the methods section of a deep learning paper.

What you will learn

• Neural network basics Essential
• PyTorch and JAX Essential
• Convolutional networks Essential
• Sequence models: RNNs and LSTMs Essential
• Transformers and language models Essential
• Generative models Essential
• Graph neural networks Essential
• Interpretability If you need it

Resources per subject