airflow
Apache Airflow: Directed Acyclic Graphs (DAGs), task dependencies, sensors, custom operators, XComs, and Celery/Kubernetes executors
- License 许可
- MIT
- 最近更新
- 2026-11-09
- Stars
- ★ 0
- Forks
- 0
01 前言 Front Matter
- name
- airflow
- risk
- low
- source
- https://github.com/Mr-Nobody-Anonymous/All-skills
- license
- MIT
- version
- 1.0.0
- category
- data-engineering
- description
- Apache Airflow: Directed Acyclic Graphs (DAGs), task dependencies, sensors, custom operators, XComs, and Celery/Kubernetes executors
- imported_at
- 2026-09-20
- source_path
- awesome_skills/data-engineering/airflow/SKILL.md
- source_repository
- Mr-Nobody-Anonymous/All-skills
- disable-model-invocation
- false
03 SKILL.md 正文
Apache Airflow Orchestration
Scope
Apache Airflow authoring, programmatic workflow scheduling, task dependency definition, SLA monitoring, and scalable distributed executor management.
Core Concepts & Invariants
- DAG Definition Invariants:
- DAG files must be lightweight and free of top-level code or database calls (parsed repeatedly by scheduler).
- Deterministic execution date (
data_interval_start,data_interval_end).
- Task Dependencies: Upstream/downstream bitshift operators:
extract >> transform >> load. - Executors: CeleryExecutor (Redis/RabbitMQ queue), KubernetesExecutor (dynamic ephemeral pod per task).
Tools & Standards
- Software: Apache Airflow 2.x, Astronomer.
04 同仓库更多 Skills
dei-assessment
Assess diversity, equity, and inclusion with metrics. TRIGGERS - Use when user needs help with dei-assessment related tasks.
dei-action-plan
Create DEI action plans with goals and initiatives. TRIGGERS - Use when user needs help with dei-action-plan related tasks.
culture-fit-assessment
Design culture add assessment processes. TRIGGERS - Use when user needs help with culture-fit-assessment related tasks.
cowork-to-code-bridge
Use an already-installed, independently verified cowork-to-code bridge to run narrowly approved actions on the user's own macOS, Linux, or WSL2 machine through a local file queue.
counter-offer-response
Draft counter-offer responses for retention. TRIGGERS - Use when user needs help with counter-offer-response related tasks.
continuous-feedback-system
Design continuous feedback systems. TRIGGERS - Use when user needs help with continuous-feedback-system related tasks.