Reliability / 6 / 6
Backpressure
A mobile app sends analytics events to an ingest API, which keeps them in memory until a writer stores them. When the database slows down, events arrive faster than they leave, the buffer has no limit, and the API dies of memory with 1.8 million events already confirmed. Backpressure is how a system says "slower" back up the chain: a bounded buffer, a chosen way to overflow, 429 with Retry-After, consumers that pull, shedding by priority and a limit at the door.
- 14 min
- Intermediate
- 10 steps
- API memory
- 40 MB
- Event delay
- 0.5 s
- Events lost
- 0
- Events turned away
- 0 %
- request
- reply
- redelivery
- duplicate
- lost
Numbers are a model scenario, not measurements
The real request
Mobile apps → Ingest APIRequest
POST /v1/events HTTP/1.12
Host: ingest.example.com
Authorization: hidden
{
"device": 1"d_7f",
"events": [
{ "type": "screen_view", "ts": 1763481600 },
{ "type": "add_to_cart", "ts": 1763481602 }
]
}
Response
HTTP/1.1 202 Accepted3
{ "accepted": 450 }
device— Which phone sent the batch.events— Up to 50 events per request, so the app does not open a connection per tap.202 Accepted— "Taken", not "stored". The event lives only in the API's memory so far.accepted— How many events of the batch the API took.
What happens if…?
Put in your own numbers: the result and the formula update at once.
Events per second arriving at the API.
Writers storing events in parallel.
How long one writer needs to store one event. 5 ms while the DB is slow.
Result
- Load ρ
- 0.60
- Chance to wait
- 29%
- Average wait in the buffer
- 0.4ms
- Total delay
- 2.4ms
- Average events in the buffer
- 0.4
Working
μ = 1000 / 2 ms = 500.0/s
ρ = λ / (c × μ) = 1 200 / (4 × 500.0) = 0.60
P(wait) = ErlangC(c = 4, λ/μ = 2.40) = 0.287
Wq = P(wait) / (c × μ − λ) = 0.287 / 800.0 = 0.4 msA simplified teaching model: it shows direction and scale, not a benchmark.
Build it yourselfCheat sheetCompare lessons
Course: 74 lessons
01 Foundations
02 Scaling
03 Data & storage
04 Communication
05 Reliability
06 Architecture
07 Security
08 Shipping
09 Whole systems
10 Business processes
11 Case studies