Free courses

The foundations behind the code.

Study material on the foundations of computing and machine learning. Each concept is presented with its formal definition, its geometric reading where it has one, and its implementation.

Intermediate

Foundations of LLMs

What exactly is optimised when a language model is trained: self-supervised pre-training, the scaling laws and their correction, and the objectives that separate one architecture family from another.

  • llm
  • pre training
  • transformers
  • machine learning
8 lessons2 modules
01

Manipulable figures

Concepts are introduced through figures that can be manipulated, so that intuition precedes the algebraic formulation.

02

Definition and code

Each lesson states the formal definition alongside its corresponding implementation, keeping theory and computation together.

03

Freely available

The complete material is available without prior registration or restrictions.