mufassall

Communication / 4 / 5

Real-time updates

A chat must show a new message the moment it is sent. Polling, long polling, Server-Sent Events and WebSockets, and what it takes to run many open connections.

  • 13 min
  • Intermediate
  • 11 steps
Requests
50 000 /s
Delivery delay
1 000 ms
Missed
0 /min
Open in Lab
85%70%
  • request
  • reply
  • redelivery
  • duplicate
  • lost

Numbers are a model scenario, not measurements

The real request

Bob → Chat server

Request

GET /rooms/r_17/updates?since=m_730 HTTP/1.11
Host: chat.example.com
Authorization: hidden

Response

HTTP/1.1 200 OK
{
  "messages": 2[]
}
  1. since — The last message the client has. The server returns only newer ones.
  2. messages — Empty. The server read the database and spent a request to say “nothing”.
Course: 42 lessons
  1. 01 Foundations

    1. The life of a request
    2. Latency and throughput
    3. Napkin math
  2. 02 Scaling

    1. Scaling up vs scaling out
    2. Load balancing
    3. Stateless servers
    4. Caching
    5. CDN and edge caching
  3. 03 Data & storage

    1. SQL and NoSQL
    2. Database indexes
    3. Storage engines: B-tree and LSM
    4. Database replication
    5. Sharding
    6. Consistent hashing
    7. Unique IDs
    8. CAP: when the link breaks
    9. Consensus and leader election
    10. Transactions
    11. File uploads
  4. 04 Communication

    1. API styles
    2. Message queues
    3. Pub/sub and event logs
    4. Real-time updates
    5. Reliable callbacks
  5. 05 Reliability

    1. Redundancy and failover
    2. Rate limiting
    3. Timeouts and retries
    4. Observability
  6. 06 Architecture

    1. Microservices
    2. Service discovery
    3. Sagas and the outbox
    4. Batch vs stream
  7. 07 Security

    1. Authentication
    2. Authorization
    3. Encryption and secrets
  8. 08 Shipping

    1. Testing
    2. CI/CD: from commit to production
  9. 09 Whole systems

    1. From requirements to design
    2. Design a URL shortener
    3. Design a news feed
    4. Design a chat
  10. 10 Business processes

    1. Payment gateway