Scalability, Availability, Reliability, Latency & Throughput

The vocabulary of scale: how systems grow, how they fail, how to do availability math, and why p99 (not the average) decides your architecture.

About 75 minutes · 17 exam questions · 9 interview questions · 2 code labs

What you will learn

  1. Scalability: vertical vs horizontal, and what "scalable" actually means
  2. Stateless vs stateful services and session externalization
  3. Finding single points of failure (SPOFs)
  4. Availability math: nines, serial and parallel composition
  5. Reliability vs availability vs durability; MTBF and MTTR
  6. Latency vs throughput and Little's Law
  7. Tail latency and fan-out amplification
  8. Bottleneck identification: find the constraint before scaling anything
  9. Amdahl's Law and the Universal Scalability Law (USL)
  10. Cloud-native layering: separating storage from compute

Previous: Scaling One App from 1 User to 1 Million (and Beyond) · Next: Capacity, Storage, Bandwidth & Peak Estimation