mufassall

Konspekt · Arxitektura

Saga va outbox

15 daq · Yuqori · mufassall.dtwin.uz/uz/l/sagas/

← Darsni ochish

Muammo

Bitta buyurtma uchun boshqa ikki servisda to'lov va ombor bandi kerak, har birining o'z bazasi bor. Hammasini o'raydigan bitta tranzaksiya yo'q. Uchalasini butun tizimni qulflamasdan qanday kelishtirib turish mumkin.

Nimani o'rganasiz

  • Nega bitta baza tranzaksiyasi uchta servisni qamray olmaydi
  • Ikki fazali commit (2PC) nimaga tushadi va undan nega qochishadi
  • Saga: lokal qadamlar va kompensatsiya, orkestratsiya yoki xoreografiya
  • Outbox: bazaga yozish va hodisa endi bir-biridan ajralmaydi
Yakuniy sahna
30%30%

Diagramma kod sifatida

Darsdagi yakuniy sxemani matn ko'rinishida oling va Jira, GitLab, GitHub, Notion yoki hujjatga qo'ying: Mermaid u yerlarda o'zi chiziladi. D2 va PlantUML (Confluence, IntelliJ) uchun alohida variantlar bor.

Mermaid: sxema

flowchart LR
  n_client(["Do'kon ilovasi"])
  n_orders["Buyurtmalar"]
  n_odb[("Buyurtmalar bazasi")]
  n_payments["To'lovlar"]
  n_inventory["Ombor"]
  n_bus[["Hodisalar logi"]]
  n_relay("Outbox relay")
  n_client -->|"chaqiruv"| n_orders
  n_orders -->|"chaqiruv"| n_odb
  n_bus ==>|"dublikat"| n_payments
  n_payments -.->|"asinxron"| n_bus
  n_bus -->|"asinxron"| n_inventory
  n_relay -->|"chaqiruv"| n_odb
  n_relay ==>|"dublikat"| n_bus

Mermaid: so'rovlar ketma-ketligi

sequenceDiagram
  participant n_client as Do'kon ilovasi
  participant n_orders as Buyurtmalar
  participant n_inventory as Ombor
  participant n_payments as To'lovlar
  participant n_odb as Buyurtmalar bazasi
  participant n_bus as Hodisalar logi
  Note over n_client,n_orders: Bitta buyurtma, uchta baza
  n_client->>n_orders: POST /orders HTTP/1.1
  n_orders-->>n_client: HTTP/1.1 202 Accepted
  Note over n_orders,n_inventory: Pul yechildi, ombor chaqiruvi yiqildi
  n_orders->>n_inventory: POST /reservations HTTP/1.1
  n_inventory-->>n_orders: HTTP/1.1 503 Service Unavailable
  Note over n_orders,n_payments: Ikki fazali commit: avval hamma ovoz beradi
  n_orders->>n_payments: PREPARE tx=ord_1042
  n_payments-->>n_orders: VOTE yes
  Note over n_orders,n_payments: Koordinator ovozdan keyin yiqildi
  n_orders-xn_payments: PREPARE tx=ord_1042 -#62; VOTE yes
  Note over n_orders,n_odb: Saga: lokal tranzaksiyalar zanjiri
  n_orders->>n_odb: INSERT INTO sagas (id, order_id, step, status)
  n_odb-->>n_orders: UPDATE 1
  Note over n_orders,n_payments: Xato: kompensatsiya bilan qaytarish
  n_orders->>n_payments: POST /charges/ch_88/refunds HTTP/1.1
  n_payments-->>n_orders: HTTP/1.1 201 Created
  Note over n_orders,n_bus: Xoreografiya: servislar hodisalarga javob beradi
  n_orders->>n_bus: produce topic=orders key=1042
  n_bus-->>n_orders: ack partition=3 offset=7713
  Note over n_orders,n_bus: Bazaga saqlandi, hodisa yuborilmadi
  n_orders-xn_bus: produce topic=orders key=1042
  Note over n_orders,n_odb: Outbox: hodisa buyurtma bilan birga yoziladi
  n_orders->>n_odb: BEGIN#59;
  n_odb-->>n_orders: COMMIT
  Note over n_bus,n_payments: At-least-once: iste'molchi takrorni tashlaydi
  n_bus->>n_payments: deliver topic=orders key=1042 offset=7714
  n_payments-->>n_bus: INSERT INTO processed (event_id) VALUES ('ev_5c1') ON CONFLICT DO NOTHING

D2

direction: right

n_client: "Do'kon ilovasi" {
  shape: rectangle
}
n_orders: "Buyurtmalar" {
  shape: rectangle
}
n_odb: "Buyurtmalar bazasi" {
  shape: cylinder
}
n_payments: "To'lovlar" {
  shape: rectangle
}
n_inventory: "Ombor" {
  shape: rectangle
}
n_bus: "Hodisalar logi" {
  shape: queue
}
n_relay: "Outbox relay" {
  shape: rectangle
  style.multiple: true
}

n_client -> n_orders: "chaqiruv"
n_orders -> n_odb: "chaqiruv"
n_bus -> n_payments: "dublikat" {
  style.stroke-width: 4
}
n_payments -> n_bus: "asinxron" {
  style.stroke-dash: 3
}
n_bus -> n_inventory: "asinxron"
n_relay -> n_odb: "chaqiruv"
n_relay -> n_bus: "dublikat" {
  style.stroke-width: 4
}

PlantUML: so'rovlar ketma-ketligi

@startuml
participant "Do'kon ilovasi" as n_client
participant "Buyurtmalar" as n_orders
participant "Ombor" as n_inventory
participant "To'lovlar" as n_payments
database "Buyurtmalar bazasi" as n_odb
queue "Hodisalar logi" as n_bus
note over n_client, n_orders : Bitta buyurtma, uchta baza
n_client -> n_orders : POST /orders HTTP/1.1
n_orders --> n_client : HTTP/1.1 202 Accepted
note over n_orders, n_inventory : Pul yechildi, ombor chaqiruvi yiqildi
n_orders -> n_inventory : POST /reservations HTTP/1.1
n_inventory --> n_orders : HTTP/1.1 503 Service Unavailable
note over n_orders, n_payments : Ikki fazali commit: avval hamma ovoz beradi
n_orders -> n_payments : PREPARE tx=ord_1042
n_payments --> n_orders : VOTE yes
note over n_orders, n_payments : Koordinator ovozdan keyin yiqildi
n_orders ->x n_payments : [yo'qoldi] PREPARE tx=ord_1042 -> VOTE yes
note over n_orders, n_odb : Saga: lokal tranzaksiyalar zanjiri
n_orders -> n_odb : INSERT INTO sagas (id, order_id, step, status)
n_odb --> n_orders : UPDATE 1
note over n_orders, n_payments : Xato: kompensatsiya bilan qaytarish
n_orders -> n_payments : POST /charges/ch_88/refunds HTTP/1.1
n_payments --> n_orders : HTTP/1.1 201 Created
note over n_orders, n_bus : Xoreografiya: servislar hodisalarga javob beradi
n_orders ->> n_bus : produce topic=orders key=1042
n_bus -->> n_orders : ack partition=3 offset=7713
note over n_orders, n_bus : Bazaga saqlandi, hodisa yuborilmadi
n_orders ->x n_bus : [yo'qoldi] produce topic=orders key=1042
note over n_orders, n_odb : Outbox: hodisa buyurtma bilan birga yoziladi
n_orders -> n_odb : BEGIN;
n_odb --> n_orders : COMMIT
note over n_bus, n_payments : At-least-once: iste'molchi takrorni tashlaydi
n_bus ->> n_payments : [dublikat] deliver topic=orders key=1042 offset=7714
n_payments -->> n_bus : INSERT INTO processed (event_id) VALUES ('ev_5c1') ON CONFLICT DO NOTHING
@enduml

PlantUML: komponentlar

@startuml
left to right direction
agent "Do'kon ilovasi" as n_client
component "Buyurtmalar" as n_orders
database "Buyurtmalar bazasi" as n_odb
component "To'lovlar" as n_payments
component "Ombor" as n_inventory
queue "Hodisalar logi" as n_bus
collections "Outbox relay" as n_relay
n_client --> n_orders : chaqiruv
n_orders --> n_odb : chaqiruv
n_bus -[bold]-> n_payments : dublikat
n_payments ..> n_bus : asinxron
n_bus --> n_inventory : asinxron
n_relay --> n_odb : chaqiruv
n_relay -[bold]-> n_bus : dublikat
@enduml

Xulosa

Servislar oralig'idagi ish uchun to'rt qoida.

1) Servislar orasida tranzaksiya yo'q; 2PC'dan qoching, u hammani eng sekin node'da to'xtatadi. 2) Saga ishlating: lokal qadamlar, har biri uchun kompensatsiya, orkestrator yoki hodisalar orqali. 3) Hodisalarni ma'lumot bilan bir tranzaksiyada outbox orqali yozing. 4) Yetkazish kamida bir marta, shuning uchun har iste'molchi event_id bo'yicha takrorni tashlaydi.

Ko'rsatkichlar: boshida va oxirida

Ko'rsatkichBoshidaOxirida
Buyurtma p95320 ms190 ms
Pul yechildi, buyurtma yo'q0/kun0/kun
Yo'qolgan hodisalar0/kun0/kun

Qadamlar

  1. Holat Bitta buyurtma, uchta baza

    Do'kon ilovasi buyurtma beradi.

  2. Muammo Pul yechildi, ombor chaqiruvi yiqildi

    To'lovlar kartadan pulni yechdi.

  3. Holat Ikki fazali commit: avval hamma ovoz beradi

    Koordinator (bu yerda Buyurtmalar) har bir ishtirokchidan prepare qilishni so'raydi: ishni bajar, qatorlarni qulfla va ovoz ber.

  4. Muammo Koordinator ovozdan keyin yiqildi

    Buyurtmalar ovoz va qaror orasida yiqildi.

  5. Yechim Saga: lokal tranzaksiyalar zanjiri

    Global qulfdan voz kechamiz.

  6. Yechim Xato: kompensatsiya bilan qaytarish

    Ombor «qolmagan» deb javob berdi.

  7. Holat Xoreografiya: servislar hodisalarga javob beradi

    Xuddi shu sagani yuritishning boshqa yo'li: orkestrator yo'q.

  8. Muammo Bazaga saqlandi, hodisa yuborilmadi

    Buyurtmalar buyurtmani commit qiladi, keyin hodisani e'lon qiladi: ikki alohida yozuv.

  9. Yechim Outbox: hodisa buyurtma bilan birga yoziladi

    Buyurtmalar buyurtmani va hodisani bitta lokal tranzaksiyada outbox jadvaliga yozadi.

  10. Yechim At-least-once: iste'molchi takrorni tashlaydi

    Relay ev_5c1 qatorini e'lon qildi va uni «yuborildi» deb belgilashdan oldin yiqildi.

  11. Xulosa Xulosa

    Servislar oralig'idagi ish uchun to'rt qoida.

Atamalar

Ikki fazali commit (2PC)
Koordinator avval hamma ishtirokchidan prepare va ovoz so'raydi, hamma "ha" desa commit yuboradi. Ishtirokchilar butun davomida qulf ushlaydi va koordinator yiqilsa osilib qoladi, shuning uchun undan qochishadi.
Saga
Bir nechta servisdagi ish lokal tranzaksiyalar zanjiri sifatida bajariladi, har qadamning kompensatsiyasi bor. Biror qadam yiqilsa, oldingi qadamlar kompensatsiya bilan qaytariladi; zanjirni orkestrator yoki hodisalar (xoreografiya) boshqaradi.
Outbox
Servis ma'lumotni ham, hodisani ham bitta lokal tranzaksiyada outbox jadvaliga yozadi, alohida relay esa hodisani broker'ga yuboradi. Hodisa kechikishi mumkin, lekin endi yo'qolmaydi.
At-least-once yetkazish
Xabar kamida bir marta yetkaziladi, ba'zan esa ikki marta. Shuning uchun iste'molchi takrorni event_id bo'yicha tashlaydi yoki idempotent yozadi.