AGENT SKILL

cdc

Change Data Capture: database transaction log mining (Debezium), WAL replication, schema evolution, and real-time streaming

License 许可
MIT
最近更新
2026-11-09
Stars
★ 0
Forks
0

01 前言 Front Matter

name
cdc
risk
low
source
https://github.com/Mr-Nobody-Anonymous/All-skills
license
MIT
version
1.0.0
category
data-engineering
description
Change Data Capture: database transaction log mining (Debezium), WAL replication, schema evolution, and real-time streaming
imported_at
2026-09-20
source_path
awesome_skills/data-engineering/cdc/SKILL.md
source_repository
Mr-Nobody-Anonymous/All-skills
disable-model-invocation
false

03 SKILL.md 正文

Change Data Capture (CDC)

Scope

Change Data Capture captures row-level insert, update, and delete mutations directly from database transaction logs without query polling, streaming changes in real time.

Mechanics & Architecture

  • Log-Based Mining: Reading PostgreSQL Write-Ahead Logs (WAL) via pgoutput plugin, or MySQL binary logs (binlog).
  • Debezium CDC Architecture: Debezium connector captures row changes $\to$ Kafka topic per table $\to$ consumers parse envelope (before, after, op, ts_ms).
  • Zero Impact on Production: Avoids high-overhead SELECT * WHERE updated_at database polling.

Tools & Standards

  • Software: Debezium, Kafka Connect, AWS DMS.

04 同仓库更多 Skills