mufassall

Shipping / 2 / 2

CI/CD: from commit to production

A team deploys once a week, by hand, and every third deploy breaks something. Step by step the path from commit to production becomes automatic, small and reversible, and the team ends up deploying a dozen times a day.

  • 14 min
  • Intermediate
  • 10 steps
Deploys
0.1 /day
Failed deploys
30 %
Time to restore
5 400 s
Error rate
40 %
Open in Lab
45%
  • request
  • reply
  • redelivery
  • duplicate
  • lost

Numbers are a model scenario, not measurements

The real request

Developer → Blue servers

Request

$ ssh deploy@192.0.2.12
$ scp api-build.zip /srv/api/1
$ unzip -o /srv/api/api-build.zip
$ systemctl restart api2
api: missing env PAYMENTS_URL, exiting3
(same by hand on 5 more servers)
  1. scp — A file copied by hand. Nobody can say later which build is on which server.
  2. restart — All users of this server are cut off during the restart.
  3. missing env — The new code needs a setting that exists only on the developer's laptop.
Course: 42 lessons
  1. 01 Foundations

    1. The life of a request
    2. Latency and throughput
    3. Napkin math
  2. 02 Scaling

    1. Scaling up vs scaling out
    2. Load balancing
    3. Stateless servers
    4. Caching
    5. CDN and edge caching
  3. 03 Data & storage

    1. SQL and NoSQL
    2. Database indexes
    3. Storage engines: B-tree and LSM
    4. Database replication
    5. Sharding
    6. Consistent hashing
    7. Unique IDs
    8. CAP: when the link breaks
    9. Consensus and leader election
    10. Transactions
    11. File uploads
  4. 04 Communication

    1. API styles
    2. Message queues
    3. Pub/sub and event logs
    4. Real-time updates
    5. Reliable callbacks
  5. 05 Reliability

    1. Redundancy and failover
    2. Rate limiting
    3. Timeouts and retries
    4. Observability
  6. 06 Architecture

    1. Microservices
    2. Service discovery
    3. Sagas and the outbox
    4. Batch vs stream
  7. 07 Security

    1. Authentication
    2. Authorization
    3. Encryption and secrets
  8. 08 Shipping

    1. Testing
    2. CI/CD: from commit to production
  9. 09 Whole systems

    1. From requirements to design
    2. Design a URL shortener
    3. Design a news feed
    4. Design a chat
  10. 10 Business processes

    1. Payment gateway