mufassall

Data & storage / 11 / 11

File uploads

A video app where phones upload 180 MB files and thousands watch them. Why bytes should not pass through your API, and how presigned URLs, multipart upload, a worker and a CDN share the job.

  • 13 min
  • Intermediate
  • 11 steps
Upload p95
94 s
Failed uploads
7 %
Monthly cost
1 900 $
Open in Lab
85%70%
  • request
  • reply
  • redelivery
  • duplicate
  • lost

Numbers are a model scenario, not measurements

The real request

Phone app → API

Request

POST /videos HTTP/1.1
Host: api.example.com
Authorization1: hidden
Content-Type: multipart/form-data; boundary=x9
Content-Length2: 188743680

<180 MB of video bytes>

Response

HTTP/1.1 201 Created
X-Response-Time3: 94 s
  1. Authorization · hidden — The user's token. A secret, hidden here.
  2. Content-Length — 180 MB in one request body. A drop at 99% means starting again.
  3. X-Response-Time — 94 seconds for one request. Load balancers and proxies often cut at 60.
Course: 42 lessons
  1. 01 Foundations

    1. The life of a request
    2. Latency and throughput
    3. Napkin math
  2. 02 Scaling

    1. Scaling up vs scaling out
    2. Load balancing
    3. Stateless servers
    4. Caching
    5. CDN and edge caching
  3. 03 Data & storage

    1. SQL and NoSQL
    2. Database indexes
    3. Storage engines: B-tree and LSM
    4. Database replication
    5. Sharding
    6. Consistent hashing
    7. Unique IDs
    8. CAP: when the link breaks
    9. Consensus and leader election
    10. Transactions
    11. File uploads
  4. 04 Communication

    1. API styles
    2. Message queues
    3. Pub/sub and event logs
    4. Real-time updates
    5. Reliable callbacks
  5. 05 Reliability

    1. Redundancy and failover
    2. Rate limiting
    3. Timeouts and retries
    4. Observability
  6. 06 Architecture

    1. Microservices
    2. Service discovery
    3. Sagas and the outbox
    4. Batch vs stream
  7. 07 Security

    1. Authentication
    2. Authorization
    3. Encryption and secrets
  8. 08 Shipping

    1. Testing
    2. CI/CD: from commit to production
  9. 09 Whole systems

    1. From requirements to design
    2. Design a URL shortener
    3. Design a news feed
    4. Design a chat
  10. 10 Business processes

    1. Payment gateway