cdc
Change Data Capture: database transaction log mining (Debezium), WAL replication, schema evolution, and real-time streaming
- License 许可
- MIT
- 最近更新
- 2026-11-09
- Stars
- ★ 0
- Forks
- 0
01 前言 Front Matter
- name
- cdc
- risk
- low
- source
- https://github.com/Mr-Nobody-Anonymous/All-skills
- license
- MIT
- version
- 1.0.0
- category
- data-engineering
- description
- Change Data Capture: database transaction log mining (Debezium), WAL replication, schema evolution, and real-time streaming
- imported_at
- 2026-09-20
- source_path
- awesome_skills/data-engineering/cdc/SKILL.md
- source_repository
- Mr-Nobody-Anonymous/All-skills
- disable-model-invocation
- false
03 SKILL.md 正文
Change Data Capture (CDC)
Scope
Change Data Capture captures row-level insert, update, and delete mutations directly from database transaction logs without query polling, streaming changes in real time.
Mechanics & Architecture
- Log-Based Mining: Reading PostgreSQL Write-Ahead Logs (WAL) via
pgoutputplugin, or MySQL binary logs (binlog). - Debezium CDC Architecture: Debezium connector captures row changes $\to$ Kafka topic per table $\to$ consumers parse envelope (
before,after,op,ts_ms). - Zero Impact on Production: Avoids high-overhead
SELECT * WHERE updated_atdatabase polling.
Tools & Standards
- Software: Debezium, Kafka Connect, AWS DMS.
04 同仓库更多 Skills
dei-assessment
Assess diversity, equity, and inclusion with metrics. TRIGGERS - Use when user needs help with dei-assessment related tasks.
dei-action-plan
Create DEI action plans with goals and initiatives. TRIGGERS - Use when user needs help with dei-action-plan related tasks.
culture-fit-assessment
Design culture add assessment processes. TRIGGERS - Use when user needs help with culture-fit-assessment related tasks.
cowork-to-code-bridge
Use an already-installed, independently verified cowork-to-code bridge to run narrowly approved actions on the user's own macOS, Linux, or WSL2 machine through a local file queue.
counter-offer-response
Draft counter-offer responses for retention. TRIGGERS - Use when user needs help with counter-offer-response related tasks.
continuous-feedback-system
Design continuous feedback systems. TRIGGERS - Use when user needs help with continuous-feedback-system related tasks.