mufassall

Communication / 2 / 5

Message queues

A shop sends an order email through a provider that takes 100 messages a second, and a sale brings 600 orders a second. How a queue absorbs the spike, and what you must set on it: leases, acks, backoff, a dead-letter queue and backpressure.

  • 14 min
  • Intermediate
  • 12 steps
Order p95
950 ms
Backlog
0
Email delay
1 s
Lost emails
0 /h
Open in Lab
30%
  • request
  • reply
  • redelivery
  • duplicate
  • lost

Numbers are a model scenario, not measurements

The real request

Shop API → Mail provider

Request

POST /v1/send HTTP/1.1
Host: mail.example.com
Authorization1: hidden

{
  "to": "u_42@example.com",
  "template": 2"order_paid",
  "order_id": "ord_5521"
}

Response

HTTP/1.1 202 Accepted
X-Response-Time3: 820 ms
  1. Authorization · hidden — The shop's API key at the provider. Hidden here.
  2. template — Which email to send. The provider fills it with the order data.
  3. X-Response-Time — 820 ms of every order request is spent waiting for someone else.
Course: 42 lessons
  1. 01 Foundations

    1. The life of a request
    2. Latency and throughput
    3. Napkin math
  2. 02 Scaling

    1. Scaling up vs scaling out
    2. Load balancing
    3. Stateless servers
    4. Caching
    5. CDN and edge caching
  3. 03 Data & storage

    1. SQL and NoSQL
    2. Database indexes
    3. Storage engines: B-tree and LSM
    4. Database replication
    5. Sharding
    6. Consistent hashing
    7. Unique IDs
    8. CAP: when the link breaks
    9. Consensus and leader election
    10. Transactions
    11. File uploads
  4. 04 Communication

    1. API styles
    2. Message queues
    3. Pub/sub and event logs
    4. Real-time updates
    5. Reliable callbacks
  5. 05 Reliability

    1. Redundancy and failover
    2. Rate limiting
    3. Timeouts and retries
    4. Observability
  6. 06 Architecture

    1. Microservices
    2. Service discovery
    3. Sagas and the outbox
    4. Batch vs stream
  7. 07 Security

    1. Authentication
    2. Authorization
    3. Encryption and secrets
  8. 08 Shipping

    1. Testing
    2. CI/CD: from commit to production
  9. 09 Whole systems

    1. From requirements to design
    2. Design a URL shortener
    3. Design a news feed
    4. Design a chat
  10. 10 Business processes

    1. Payment gateway