mufassall

Architecture / 2 / 4

Service discovery

An orders service calls inventory instances that start, stop and move. How a registry with heartbeats replaces hard-coded IPs, and the three ways to ask it: from the client, through DNS, or through a load balancer.

  • 11 min
  • Intermediate
  • 9 steps
Failed stock calls
0.1 %
Time to stop calling a dead instance
—
Live inventory instances
2
Open in Lab
40%45%45%
  • request
  • reply
  • redelivery
  • duplicate
  • lost

Numbers are a model scenario, not measurements

The real request

Orders service → Inventory A

Request

GET /v1/stock/sku_19 HTTP/1.1
Host1: 192.0.2.11:8080

Response

HTTP/1.1 200 OK
{
  "sku": "sku_19",
  "qty": 214
}
  1. Host — A raw IP and port. The caller knows exactly which machine it is talking to.
  2. qty — 14 in stock. The order can go ahead.
Course: 42 lessons
  1. 01 Foundations

    1. The life of a request
    2. Latency and throughput
    3. Napkin math
  2. 02 Scaling

    1. Scaling up vs scaling out
    2. Load balancing
    3. Stateless servers
    4. Caching
    5. CDN and edge caching
  3. 03 Data & storage

    1. SQL and NoSQL
    2. Database indexes
    3. Storage engines: B-tree and LSM
    4. Database replication
    5. Sharding
    6. Consistent hashing
    7. Unique IDs
    8. CAP: when the link breaks
    9. Consensus and leader election
    10. Transactions
    11. File uploads
  4. 04 Communication

    1. API styles
    2. Message queues
    3. Pub/sub and event logs
    4. Real-time updates
    5. Reliable callbacks
  5. 05 Reliability

    1. Redundancy and failover
    2. Rate limiting
    3. Timeouts and retries
    4. Observability
  6. 06 Architecture

    1. Microservices
    2. Service discovery
    3. Sagas and the outbox
    4. Batch vs stream
  7. 07 Security

    1. Authentication
    2. Authorization
    3. Encryption and secrets
  8. 08 Shipping

    1. Testing
    2. CI/CD: from commit to production
  9. 09 Whole systems

    1. From requirements to design
    2. Design a URL shortener
    3. Design a news feed
    4. Design a chat
  10. 10 Business processes

    1. Payment gateway