backpressure-and-flow-control
Design systems that apply backpressure and flow control so producers do not overwhelm consumers. Use when building streaming, messaging, or pipelined systems that must remain stable under load.
- License 许可
- MIT
- 最近更新
- 2026-07-22
- Stars
- ★ 7
- Forks
- 1
01 前言 Front Matter
- name
- backpressure-and-flow-control
- description
- Design systems that apply backpressure and flow control so producers do not overwhelm consumers. Use when building streaming, messaging, or pipelined systems that must remain stable under load.
03 SKILL.md 正文
Backpressure and Flow Control
Overview
Without backpressure, fast producers can overwhelm slow consumers, leading to unbounded queues, memory exhaustion, and cascading failures.
When to Use
- Streaming data pipelines
- Message consumers and event processors
- Any system with producers and consumers operating at different speeds
Techniques
- Bounded queues with clear overflow behavior
- Reactive streams / async pull-based models
- Rate limiting and load shedding
- Credit-based or window-based flow control
- Circuit breaking when downstream is unhealthy
Principles
- Prefer signaling upstream to slow down over unbounded buffering
- Make overload behavior explicit and observable
- Drop, sample, or reject work according to clear policy when necessary
Verification
- System remains stable when consumers slow down or stop
- Overload behavior is tested and documented
- Key metrics (queue depth, drop rate, latency) are visible
04 同仓库更多 Skills
compliance-monitoring
Design compliance monitoring and testing programs that verify controls work in practice and surface issues before regulators do. Use when building monitoring plans, compliance testing, or continuous control monitoring.
complaints-handling
Operate complaints-handling processes that meet regulatory standards — logging, timely resolution, root-cause analysis, and fair outcomes. Use when designing or improving regulated complaints frameworks or analyzing complaint themes for conduct risk.
aml-kyc-basics
Apply AML/KYC fundamentals — customer due diligence, monitoring, suspicious activity escalation, and recordkeeping — for financial crime compliance. Use when designing onboarding controls, transaction monitoring concepts, or AML program components in financial services.
ai-model-compliance
Apply compliance controls to AI and automated decision systems — transparency, fairness, human oversight, documentation, and regulatory alignment. Use when deploying AI in regulated processes (credit, fraud, customer decisions) or responding to AI governance expectations.
data-quality-management
Manage data quality end-to-end — dimensions, rules, remediation, and prevention — beyond one-off cleaning scripts. Use when building sustained data quality programs or fixing systemic accuracy, completeness, or consistency problems.
data-lineage
Capture and use data lineage — where data comes from, how it transforms, and what depends on it — for impact analysis, debugging, and trust. Use when tracing metric origins, assessing change impact, or diagnosing broken pipelines.