Reliability / 4 / 4
Observability
Checkout takes 2.4 seconds and every service says it is fine. How logs, a propagated request id, RED and USE metrics, an alert on p95 and a distributed trace find the slow part.
- 13 min
- Intermediate
- 11 steps
- Checkout p95
- 2 400 ms
- Time to find cause
- 5 400 s
- Telemetry per day
- 0.4 GB
- request
- reply
- redelivery
- duplicate
- lost
Numbers are a model scenario, not measurements
The real request
Customer app → APIRequest
POST /v1/orders HTTP/1.1
Host: api.example.com
Response
HTTP/1.1 201 Created1
X-Response-Time2: 2380ms
201 Created— Success. Nothing failed, so no error log and no exception to follow.X-Response-Time— 2.4 seconds. The only clue, and it says nothing about where the time went.
Course: 42 lessons
01 Foundations
02 Scaling
03 Data & storage
04 Communication
05 Reliability
06 Architecture
07 Security
08 Shipping
09 Whole systems
10 Business processes