domino-airflow-kubeflow
Run Domino Jobs from an external orchestrator. Covers Apache Airflow (a PythonOperator task on the Public Jobs API, or python-domino's DominoOperator and DominoSparkOperator), Kubeflow Pipelines (a KFP component that starts a Job over REST and polls it), installing python-domino on workers, credentials outside Domino (Personal Access Token or service-account token, never an API key), network reachability, mapping DAG tasks to Jobs, polling status, fetching logs and results. Use when the user mentions Airflow, a DAG, DominoOperator, Kubeflow, KFP, an external scheduler or orchestrator, or wants a pipeline that lives outside Domino to trigger and wait for Domino Jobs. For pipelines inside Domino use domino-flows; for a recurring single Job use a scheduled Job (domino-jobs).
- License 许可
- MIT
- 最近更新
- 2026-11-14
- Stars
- ★ 5
- Forks
- 4
01 前言 Front Matter
- name
- domino-airflow-kubeflow
- description
- Run Domino Jobs from an external orchestrator. Covers Apache Airflow (a PythonOperator task on the Public Jobs API, or python-domino's DominoOperator and DominoSparkOperator), Kubeflow Pipelines (a KFP component that starts a Job over REST and polls it), installing python-domino on workers, credentials outside Domino (Personal Access Token or service-account token, never an API key), network reachability, mapping DAG tasks to Jobs, polling status, fetching logs and results. Use when the user mentions Airflow, a DAG, DominoOperator, Kubeflow, KFP, an external scheduler or orchestrator, or wants a pipeline that lives outside Domino to trigger and wait for Domino Jobs. For pipelines inside Domino use domino-flows; for a recurring single Job use a scheduled Job (domino-jobs).
- compatibility
- Domino 6.3 and Domino Cloud. The orchestrator runs outside Domino, so it needs the deployment URL and a Personal Access Token or service-account token; DOMINO_API_PROXY and the localhost:8899 access-token endpoint exist only inside Domino runs. python-domino 2.x (the Airflow operators ship with it).
02 资源文件 3
- 参考文档AIRFLOW.md11.7 KB
- 参考文档JOBS-API-PATTERN.md4.9 KB
- 参考文档KUBEFLOW.md6.3 KB
03 SKILL.md 正文
Airflow and Kubeflow integration
Applies to Domino 6.3 and Domino Cloud.
Product page: https://docs.domino.ai/cloud/platform-capabilities/features/integrations (6.3:
same path under /6.3/). The orchestrator is its own service outside Domino; each pipeline step
starts a Domino Job through the Domino API and waits for it; the code that does the work
lives in the Domino project. Domino keeps reproducibility, the orchestrator keeps the schedule.
Pick the right tool first
| Situation | Use |
|---|---|
| Multi-step DAG that should run inside Domino with lineage and typed artifacts | domino-flows |
| One Job on a cron | a scheduled Job, domino-jobs |
| An existing Airflow or Kubeflow deployment already orchestrates the data estate | this skill |
What the orchestrator needs
- Network path from its workers to the Domino deployment URL (the one users open in a
browser), exported as
DOMINO_API_HOSTon the worker. Nothing from inside a run (DOMINO_API_PROXY,localhost:8899) exists on an Airflow worker or a KFP pod. - A token: a Personal Access Token for a pipeline that acts as you, or a service-account
token for unattended automation, created in Domino and held in the orchestrator's own secret
mechanism (Domino variables are not readable there). Legacy user API keys are deprecated; do
not copy the
DOMINO_USER_API_KEYthe product page and python-domino's example still show. https://docs.domino.ai/cloud/reference/api/domino-api-authentication - Project id and command per step, plus optional environment id and hardware tier id.
Airflow: recommended pattern (Public Jobs API, requests only)
Works on Airflow 2 and 3, installs under Airflow's constraints, and fails the task on every non-success outcome:
from datetime import datetime
from airflow import DAG
from airflow.decorators import task
@task
def run_domino_job(run_command: str) -> str:
import os, time, requests
base = os.environ["DOMINO_API_HOST"].rstrip("/") # deployment URL, set on the worker
headers = {"Authorization": "Bearer " + open(os.environ["DOMINO_TOKEN_FILE"]).readline().strip()}
job = requests.post(f"{base}/api/jobs/v1/jobs", headers=headers, timeout=60,
json={"projectId": os.environ["DOMINO_PROJECT_ID"], "runCommand": run_command}).json()["job"]
while not job["status"]["isCompleted"]:
time.sleep(30)
job = requests.get(f"{base}/api/jobs/beta/jobs/{job['id']}", headers=headers, timeout=60).json()["job"]
if job["status"]["executionStatus"] != "Succeeded": # Stopped, Failed or Error
raise RuntimeError(f"Domino job {job['id']} ended {job['status']['executionStatus']}")
return job["commitDetails"]["outputCommitId"]
with DAG("domino_pipeline", start_date=datetime(2026, 1, 1), schedule="@daily", catchup=False):
run_domino_job("python prepare.py") >> run_domino_job("python train.py 20")
The output commit id becomes the task's XCom value; a downstream task reads result files from it. Request fields, logs, result hand-off and failure handling: JOBS-API-PATTERN.md.
Airflow: python-domino operators
pip install dominodatalab ships domino.airflow.DominoOperator and DominoSparkOperator.
Read these before choosing them; details and a DAG in AIRFLOW.md:
DominoOperatorstarts Jobs with python-domino'sruns_start_blockingon the legacy v1 Runs API (/v1/projects/{owner}/{project}/runs; not in the Public API, may change in a future Domino version). python-domino's README: usejob_startfor all new development.DominoSparkOperatorusesjob_start_blockingon the v4 Jobs API (non-public route; may change in a future Domino version) and takesenvironment_id,hardware_tier_nameand a Spark, Ray, Dask or MPIcompute_cluster_properties. It raises only when the Job endsFailed; a Job that endsErrororStoppedreturns normally and the task goes green. AIRFLOW.md has a subclass that checksexecutionStatus == "Succeeded".DominoOperatorfails on any non-success.dominodatalab2.2.0 pinspackagingandpython-dateutilbelow Airflow's constraints, so a constraints-based install fails to resolve and a plain install downgrades Airflow's dependencies; give the worker a dedicated virtual environment or use the pattern above (AIRFLOW.md). The[airflow]extra pinsapache-airflow==2.2.4; do not use it on an existing Airflow.- Both operators import
airflow.utils.decorators.apply_defaults, removed in Airflow 3.0. - Neither accepts
auth_token: pass a token file asdomino_token_fileor setDOMINO_TOKEN_FILE.
Kubeflow in one screen
No Domino-specific KFP component exists: install a client and call the API. The same
requests function as the Airflow task above, wrapped in
@dsl.component(base_image="python:3.12", packages_to_install=["requests"]), with the token
mounted from a Kubernetes Secret by kfp.kubernetes.use_secret_as_env(task, secret_name=..., secret_key_to_env={"token": "DOMINO_TOKEN"}) (pip install kfp[kubernetes]). The component
returns the output commit id so the next component can read a result file from it. Full
components, pipeline, secret creation and logs on failure: KUBEFLOW.md.
Pitfalls
DominoOperator.commandis a list; withisDirect=Truepass the whole shell command as its single element (command=["python -V"]).tieronDominoOperatoris validated against hardware tier names visible to the project.Domino(...)calls/versionon construction, so a worker with no network path to Domino fails at client creation, not at Job start.- Default
max_poll_timeis 6000 s (100 min); longer Jobs need a larger value or the task fails while the Job keeps running. - python-domino reads
DOMINO_API_HOST,DOMINO_TOKEN_FILEand the deprecatedDOMINO_USER_API_KEYfrom the environment; passauth_tokeninstead of setting the key. - Each step is a separate Job with its own input commit; hand data between steps through Datasets, Data Sources or the output commit, not the local filesystem.
Related skills
- domino-jobs: Job bodies, hardware tiers, logs, scheduled Jobs
- domino-flows: orchestration inside Domino
- domino-python-sdk: python-domino client and auth order
- domino-api-intro: hosts, pagination, errors
04 同仓库更多 Skills
tags-and-properties
Manage Domino tags and properties via the Tags (Taxonomy) API at /api/taxonomy/v1. Covers namespaces and tags (create, list, update, deprecate, delete; tag entities such as projects, models, datasets, apps, project templates, NetApp volumes, environments; query by tag; autocomplete; merge; CSV import/export) and properties (typed metadata fields - text, number, date, boolean, url, user, organization, select, multi_select - with per-entity values, groups and versioned entities like model_version/app_version). Use when organizing entities with tags, building hierarchical namespaces, defining typed metadata fields, setting property values, finding entities by tag, bulk-tagging during onboarding, or migrating a taxonomy across environments.
netapp-volumes
Work with Domino Volumes for NetApp ONTAP (NetApp Volumes) - shared, multi-terabyte storage with near-instant snapshots. Covers creating volumes, attaching them to projects, mount paths (/mnt/netapp-volumes/ or /domino/netapp-volumes/), snapshots and tags, roles, deletion, mounting volumes in jobs, and the NetApp Volumes REST API (/remotefs/v1). Use when managing large-scale shared data, taking fast no-copy snapshots, or integrating NetApp ONTAP storage with Domino.
domino-workspaces
Work with Domino Workspaces - interactive sessions running Jupyter, JupyterLab, VS Code or RStudio on a hardware tier with a compute environment. Covers launching and configuring a Workspace, what persists across stop and resume, file paths and syncing for DFS and Git-based Projects, package and home-directory persistence, SSH access from a local IDE, the Workspace API routes, and troubleshooting. Use when setting up or debugging an interactive development session in Domino.
domino-ui-bootstrap
Bootstrap or retrofit a Vite + React 18 + TypeScript project so it uses the Domino design system (`@dominodatalab/extensions-tools`). Scoped to a **fully standalone SPA frontend for a Domino application or extension**, not snippets, library additions, or work inside an existing Domino monorepo package. Use whenever the user wants to create, scaffold, refactor, retrofit, or set up such an SPA (a React app, web app, frontend, UI, or extension) that should "look like Domino", use Domino components, follow the Domino design system, or integrate with the Domino platform, including when they mention DominoThemeProviderDecorator, extensions-tools, or base-components without saying "Domino". Also use to make an existing standalone React/Vite project "Domino-styled" or add Domino theming. Handles React 18 / react-router 5 pinning, Storybook MCP registration, theme provider wiring, and build verification.
domino-trace-setup
Set up GenAI tracing for an LLM or agent application in Domino by checking the Domino SDK and MLflow requirements (the DSE needs nothing installed), then adding a tracing_setup.py helper, span evaluators, a config.yaml, and @add_tracing / DominoAgentContext wiring. Use when the user asks to add tracing, observability, or evaluation to an agent or LLM app running on Domino.
domino-rust-apps
Build a Rust web app (axum) in Domino and ship it as a Domino App that starts from a prebuilt binary. Covers installing a pinned Rust toolchain into a Compute Environment with rustup, Cargo project defaults (edition 2024, rust-toolchain.toml, Cargo.lock, Clippy pedantic, rustfmt, cargo-nextest, cargo-deny), rust-analyzer for the IDE and coding agents, check hooks, calling Domino as the viewer with extended identity propagation, dev and release build profiles, keeping target/ out of Git and Domino storage, and an app.sh that runs the binary in App Preview and deployments without compiling. Use when the user wants a Rust app, API, dashboard or Proa site on Domino, a performance-sensitive or correctness-critical App, or asks to set up Rust, cargo, Clippy, nextest or rust-analyzer in a Domino Workspace or environment.