Skip to main content

Ctrl+K

LLM Systems Cookbook

Part I — Foundations

Foundations: GPU programming and the roofline

Part II — Inference engines

Inference engines

Part III — Serving and scaling

Serving and scaling

Part IV — Training and fine-tuning

Training and fine-tuning
- Mixed precision, gradient accumulation, and activation checkpointing
- DDP vs FSDP2

Part V — Retrieval-augmented generation

Retrieval-augmented generation

Part VI — Agent frameworks

Agent frameworks

Part VII — Evaluation

Evaluation

Part VIII — Production patterns

Production patterns

Reference

Glossary
A 70-notebook curriculum for LLM systems engineering

Search

Ctrl+K

By Muhammad Hassan Ahmed

Last updated on 2026-07-13.