Konspekt · Arxitektura
Saga va outbox
Muammo
Bitta buyurtma uchun boshqa ikki servisda to'lov va ombor bandi kerak, har birining o'z bazasi bor. Hammasini o'raydigan bitta tranzaksiya yo'q. Uchalasini butun tizimni qulflamasdan qanday kelishtirib turish mumkin.
Nimani o'rganasiz
- Nega bitta baza tranzaksiyasi uchta servisni qamray olmaydi
- Ikki fazali commit (2PC) nimaga tushadi va undan nega qochishadi
- Saga: lokal qadamlar va kompensatsiya, orkestratsiya yoki xoreografiya
- Outbox: bazaga yozish va hodisa endi bir-biridan ajralmaydi
Diagramma kod sifatida
Darsdagi yakuniy sxemani matn ko'rinishida oling va Jira, GitLab, GitHub, Notion yoki hujjatga qo'ying: Mermaid u yerlarda o'zi chiziladi. D2 va PlantUML (Confluence, IntelliJ) uchun alohida variantlar bor.
Mermaid: sxema
flowchart LR
n_client(["Do'kon ilovasi"])
n_orders["Buyurtmalar"]
n_odb[("Buyurtmalar bazasi")]
n_payments["To'lovlar"]
n_inventory["Ombor"]
n_bus[["Hodisalar logi"]]
n_relay("Outbox relay")
n_client -->|"chaqiruv"| n_orders
n_orders -->|"chaqiruv"| n_odb
n_bus ==>|"dublikat"| n_payments
n_payments -.->|"asinxron"| n_bus
n_bus -->|"asinxron"| n_inventory
n_relay -->|"chaqiruv"| n_odb
n_relay ==>|"dublikat"| n_busMermaid: so'rovlar ketma-ketligi
sequenceDiagram
participant n_client as Do'kon ilovasi
participant n_orders as Buyurtmalar
participant n_inventory as Ombor
participant n_payments as To'lovlar
participant n_odb as Buyurtmalar bazasi
participant n_bus as Hodisalar logi
Note over n_client,n_orders: Bitta buyurtma, uchta baza
n_client->>n_orders: POST /orders HTTP/1.1
n_orders-->>n_client: HTTP/1.1 202 Accepted
Note over n_orders,n_inventory: Pul yechildi, ombor chaqiruvi yiqildi
n_orders->>n_inventory: POST /reservations HTTP/1.1
n_inventory-->>n_orders: HTTP/1.1 503 Service Unavailable
Note over n_orders,n_payments: Ikki fazali commit: avval hamma ovoz beradi
n_orders->>n_payments: PREPARE tx=ord_1042
n_payments-->>n_orders: VOTE yes
Note over n_orders,n_payments: Koordinator ovozdan keyin yiqildi
n_orders-xn_payments: PREPARE tx=ord_1042 -#62; VOTE yes
Note over n_orders,n_odb: Saga: lokal tranzaksiyalar zanjiri
n_orders->>n_odb: INSERT INTO sagas (id, order_id, step, status)
n_odb-->>n_orders: UPDATE 1
Note over n_orders,n_payments: Xato: kompensatsiya bilan qaytarish
n_orders->>n_payments: POST /charges/ch_88/refunds HTTP/1.1
n_payments-->>n_orders: HTTP/1.1 201 Created
Note over n_orders,n_bus: Xoreografiya: servislar hodisalarga javob beradi
n_orders->>n_bus: produce topic=orders key=1042
n_bus-->>n_orders: ack partition=3 offset=7713
Note over n_orders,n_bus: Bazaga saqlandi, hodisa yuborilmadi
n_orders-xn_bus: produce topic=orders key=1042
Note over n_orders,n_odb: Outbox: hodisa buyurtma bilan birga yoziladi
n_orders->>n_odb: BEGIN#59;
n_odb-->>n_orders: COMMIT
Note over n_bus,n_payments: At-least-once: iste'molchi takrorni tashlaydi
n_bus->>n_payments: deliver topic=orders key=1042 offset=7714
n_payments-->>n_bus: INSERT INTO processed (event_id) VALUES ('ev_5c1') ON CONFLICT DO NOTHINGD2
direction: right
n_client: "Do'kon ilovasi" {
shape: rectangle
}
n_orders: "Buyurtmalar" {
shape: rectangle
}
n_odb: "Buyurtmalar bazasi" {
shape: cylinder
}
n_payments: "To'lovlar" {
shape: rectangle
}
n_inventory: "Ombor" {
shape: rectangle
}
n_bus: "Hodisalar logi" {
shape: queue
}
n_relay: "Outbox relay" {
shape: rectangle
style.multiple: true
}
n_client -> n_orders: "chaqiruv"
n_orders -> n_odb: "chaqiruv"
n_bus -> n_payments: "dublikat" {
style.stroke-width: 4
}
n_payments -> n_bus: "asinxron" {
style.stroke-dash: 3
}
n_bus -> n_inventory: "asinxron"
n_relay -> n_odb: "chaqiruv"
n_relay -> n_bus: "dublikat" {
style.stroke-width: 4
}PlantUML: so'rovlar ketma-ketligi
@startuml
participant "Do'kon ilovasi" as n_client
participant "Buyurtmalar" as n_orders
participant "Ombor" as n_inventory
participant "To'lovlar" as n_payments
database "Buyurtmalar bazasi" as n_odb
queue "Hodisalar logi" as n_bus
note over n_client, n_orders : Bitta buyurtma, uchta baza
n_client -> n_orders : POST /orders HTTP/1.1
n_orders --> n_client : HTTP/1.1 202 Accepted
note over n_orders, n_inventory : Pul yechildi, ombor chaqiruvi yiqildi
n_orders -> n_inventory : POST /reservations HTTP/1.1
n_inventory --> n_orders : HTTP/1.1 503 Service Unavailable
note over n_orders, n_payments : Ikki fazali commit: avval hamma ovoz beradi
n_orders -> n_payments : PREPARE tx=ord_1042
n_payments --> n_orders : VOTE yes
note over n_orders, n_payments : Koordinator ovozdan keyin yiqildi
n_orders ->x n_payments : [yo'qoldi] PREPARE tx=ord_1042 -> VOTE yes
note over n_orders, n_odb : Saga: lokal tranzaksiyalar zanjiri
n_orders -> n_odb : INSERT INTO sagas (id, order_id, step, status)
n_odb --> n_orders : UPDATE 1
note over n_orders, n_payments : Xato: kompensatsiya bilan qaytarish
n_orders -> n_payments : POST /charges/ch_88/refunds HTTP/1.1
n_payments --> n_orders : HTTP/1.1 201 Created
note over n_orders, n_bus : Xoreografiya: servislar hodisalarga javob beradi
n_orders ->> n_bus : produce topic=orders key=1042
n_bus -->> n_orders : ack partition=3 offset=7713
note over n_orders, n_bus : Bazaga saqlandi, hodisa yuborilmadi
n_orders ->x n_bus : [yo'qoldi] produce topic=orders key=1042
note over n_orders, n_odb : Outbox: hodisa buyurtma bilan birga yoziladi
n_orders -> n_odb : BEGIN;
n_odb --> n_orders : COMMIT
note over n_bus, n_payments : At-least-once: iste'molchi takrorni tashlaydi
n_bus ->> n_payments : [dublikat] deliver topic=orders key=1042 offset=7714
n_payments -->> n_bus : INSERT INTO processed (event_id) VALUES ('ev_5c1') ON CONFLICT DO NOTHING
@endumlPlantUML: komponentlar
@startuml
left to right direction
agent "Do'kon ilovasi" as n_client
component "Buyurtmalar" as n_orders
database "Buyurtmalar bazasi" as n_odb
component "To'lovlar" as n_payments
component "Ombor" as n_inventory
queue "Hodisalar logi" as n_bus
collections "Outbox relay" as n_relay
n_client --> n_orders : chaqiruv
n_orders --> n_odb : chaqiruv
n_bus -[bold]-> n_payments : dublikat
n_payments ..> n_bus : asinxron
n_bus --> n_inventory : asinxron
n_relay --> n_odb : chaqiruv
n_relay -[bold]-> n_bus : dublikat
@endumlXulosa
Servislar oralig'idagi ish uchun to'rt qoida.
1) Servislar orasida tranzaksiya yo'q; 2PC'dan qoching, u hammani eng sekin node'da to'xtatadi. 2) Saga ishlating: lokal qadamlar, har biri uchun kompensatsiya, orkestrator yoki hodisalar orqali. 3) Hodisalarni ma'lumot bilan bir tranzaksiyada outbox orqali yozing. 4) Yetkazish kamida bir marta, shuning uchun har iste'molchi event_id bo'yicha takrorni tashlaydi.
Ko'rsatkichlar: boshida va oxirida
| Ko'rsatkich | Boshida | Oxirida |
|---|---|---|
| Buyurtma p95 | 320 ms | 190 ms |
| Pul yechildi, buyurtma yo'q | 0/kun | 0/kun |
| Yo'qolgan hodisalar | 0/kun | 0/kun |
Qadamlar
- Holat Bitta buyurtma, uchta baza
Do'kon ilovasi buyurtma beradi.
- Muammo Pul yechildi, ombor chaqiruvi yiqildi
To'lovlar kartadan pulni yechdi.
- Holat Ikki fazali commit: avval hamma ovoz beradi
Koordinator (bu yerda Buyurtmalar) har bir ishtirokchidan prepare qilishni so'raydi: ishni bajar, qatorlarni qulfla va ovoz ber.
- Muammo Koordinator ovozdan keyin yiqildi
Buyurtmalar ovoz va qaror orasida yiqildi.
- Yechim Saga: lokal tranzaksiyalar zanjiri
Global qulfdan voz kechamiz.
- Yechim Xato: kompensatsiya bilan qaytarish
Ombor «qolmagan» deb javob berdi.
- Holat Xoreografiya: servislar hodisalarga javob beradi
Xuddi shu sagani yuritishning boshqa yo'li: orkestrator yo'q.
- Muammo Bazaga saqlandi, hodisa yuborilmadi
Buyurtmalar buyurtmani commit qiladi, keyin hodisani e'lon qiladi: ikki alohida yozuv.
- Yechim Outbox: hodisa buyurtma bilan birga yoziladi
Buyurtmalar buyurtmani va hodisani bitta lokal tranzaksiyada
outboxjadvaliga yozadi. - Yechim At-least-once: iste'molchi takrorni tashlaydi
Relay
ev_5c1qatorini e'lon qildi va uni «yuborildi» deb belgilashdan oldin yiqildi. - Xulosa Xulosa
Servislar oralig'idagi ish uchun to'rt qoida.
Atamalar
- Ikki fazali commit (2PC)
- Koordinator avval hamma ishtirokchidan prepare va ovoz so'raydi, hamma "ha" desa commit yuboradi. Ishtirokchilar butun davomida qulf ushlaydi va koordinator yiqilsa osilib qoladi, shuning uchun undan qochishadi.
- Saga
- Bir nechta servisdagi ish lokal tranzaksiyalar zanjiri sifatida bajariladi, har qadamning kompensatsiyasi bor. Biror qadam yiqilsa, oldingi qadamlar kompensatsiya bilan qaytariladi; zanjirni orkestrator yoki hodisalar (xoreografiya) boshqaradi.
- Outbox
- Servis ma'lumotni ham, hodisani ham bitta lokal tranzaksiyada outbox jadvaliga yozadi, alohida relay esa hodisani broker'ga yuboradi. Hodisa kechikishi mumkin, lekin endi yo'qolmaydi.
- At-least-once yetkazish
- Xabar kamida bir marta yetkaziladi, ba'zan esa ikki marta. Shuning uchun iste'molchi takrorni event_id bo'yicha tashlaydi yoki idempotent yozadi.