← Back

Scaling Book

My worked solutions to the exercises in How to Scale Your Model

  1. Roofline
  2. TPUs
  3. Sharding · notebook
  4. Transformers
  5. Training
  6. Applied Llama 3 Training
  7. Inference
  8. Applied Llama 3 Inference
  9. Profiling
  10. JAX · videos + notebook