[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7DHCXMSJWCW1P7Y324NGR78":3,"skill-same:01M7DHCXMSJWCW1P7Y324NGR78":63},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":27,"commitSha":28,"skillDirectory":5,"forksCount":29,"repositoryHtmlUrl":30,"repositoryHomepageUrl":6,"ownerHtmlUrl":31,"ownerBlogUrl":32,"ownerDescription":33,"updatedAt":34,"install":35,"resources":48},"01M7DHCXMSJWCW1P7Y324NGR78","gcp-managed-airflow-migrations",null,"Provides guidance for migrating Apache Airflow DAGs in Managed Service for Apache Airflow (MSAA; formerly Cloud Composer). Covers migration to Airflow 2.11.1 (MSAA Gen 2 and 3) and Airflow 3 (MSAA Gen 3), including environment inspection, GCS download\u002Fupload and scanning patterns for breaking changes.","SaiVatsal\u002FSkills-I-Use","SaiVatsal","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F242597752?v=4","01M7D5YM1T4VXW9203M0GFAHZ1","SaiVatsalPolimera","01M7D5YM2D61ST39XVR2V7B7ZJ",3,"Apache-2.0","https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fgcp-managed-airflow-migrations\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: gcp-managed-airflow-migrations\ndescription: Provides guidance for migrating Apache Airflow DAGs in Managed Service\n  for Apache Airflow (MSAA; formerly Cloud Composer). Covers migration to Airflow\n  2.11.1 (MSAA Gen 2 and 3) and Airflow 3 (MSAA Gen 3), including environment inspection,\n  GCS download\u002Fupload and scanning patterns for breaking changes.\nlicense: Apache-2.0\nmetadata:\n  version: v1\n  publisher: google\n---\n\n# Managed Service for Apache Airflow (formerly Cloud Composer) Migration Guide\n\nThis skill guides you through the process of adjusting Airflow DAGs from an\nexisting Managed Service for Apache Airflow (formerly Cloud Composer)\nenvironment (or available locally) to make them compatible with **Airflow\n2.11.1** (MSAA Gen 2 or 3) or **Airflow 3** (MSAA Gen 3).\n\n--------------------------------------------------------------------------------\n\n## Phase 1: Discovery & Download\n\nBefore making any changes, download the existing DAG files if explicitly\nrequested. Inspect the source environment to confirm source version only if\nexplicitly requested. For detailed instructions about environment inspection and\ndownloading files check references\u002Fenvironment-inspection.md.\n\n--------------------------------------------------------------------------------\n\n## Phase 2: Target Version & Dependency Mapping\n\n### 2.1 Airflow 2.11.1+ Dependency Mapping\n\nIf migrating to Airflow 2.11.1 (MSAA Gen 2) or Airflow 3, use the list below to\ntrace the version progression of key dependencies. The list covers changes\nneeded to get to Airflow 2.11.1. Take them into account when migrating from\nAirflow 2 (earlier than 2.11.1) to Airflow 3.\n\n### Composer 2.10.0 (Airflow 2.10.2)\n\n-   **Google Provider**: `10.26.0`\n-   **SSH Provider**: `3.14.0`\n-   **HTTP Provider**: `4.13.3`\n-   **Breaking Changes**: *Baseline for oldest fully documented source.*\n\n### Composer 2.15.3 (Airflow 2.10.5)\n\n-   **Google Provider**: `18.0.0`\n-   **SSH Provider**: `4.1.4`\n-   **HTTP Provider**: `5.3.4`\n-   **Breaking Changes**:\n    -   **SSH Provider 4.0.0:** Hook `timeout` removed; `get_conn()` context\n        manager.\n    -   **HTTP Provider 5.0.0:** `SimpleHttpOperator` -> `HttpOperator`.\n    -   **Google Provider 11.0.0:** `BigQueryExecuteQueryOperator` removed.\n    -   **Google Provider 12.0.0:** Legacy Data Pipeline operators removed.\n    -   **Google Provider 13.0.0:** `AutoMLBatchPredictOperator` removed.\n    -   **Google Provider 17.0.0:** `BigQueryCreateEmptyTableOperator` and\n        `BigQueryCreateExternalTableOperator` removed; Life Sciences operators\n        removed.\n    -   **Google Provider 18.0.0:** Legacy DV360 operators removed.\n\n### Composer 2.16.1 (Airflow 2.10.5)\n\n-   **Google Provider**: `19.0.0`\n-   **SSH Provider**: `4.1.6`\n-   **HTTP Provider**: `5.5.0`\n-   **Breaking Changes**: **Google Provider 19.0.0:** AutoML operators removed\n    (use Vertex AI).\n\n### Composer 2.17.0 (Target Airflow 2.11.1)\n\n-   **Google Provider**: **`20.0.0`**\n-   **SSH Provider**: **`5.0.0`**\n-   **HTTP Provider**: **`6.0.2`**\n-   **Breaking Changes**:\n    -   **SSH Provider 5.0.0:** `sshtunnel` removed (native tunneling).\n    -   **HTTP Provider 6.0.0:** JSON serialization.\n    -   **Google Provider 20.0.0:** ADLS Gen2 migration.\n\n### 2.2 Airflow 3 Migration\n\nIf migrating to Airflow 3 (MSAA Gen 3), note that this is a major version\nupgrade with significant changes, including:\n\n*   Decoupled Task SDK (imports change from `airflow` to `airflow.sdk`).\n*   Removal of direct metadata DB access.\n*   Renaming of `Dataset` to `Asset`.\n*   Removal of SubDAGs and SLAs.\n*   Changes to context variables availability.\n\nTake into account all applicable changes within Airflow 2 (e.g. when migrating\nfrom Airflow 2.10.2, apply changes needed to move to Airflow 2.11.1 and Airflow\n3 migration changes on top of that).\n\n--------------------------------------------------------------------------------\n\n## Phase 3: Analysis & Remediation (Scanning Downloaded Files)\n\nRun the scan commands from the root of your local workspace\n(`.\u002Fmigration_workspace` unless indicated otherwise).\n\n--------------------------------------------------------------------------------\n\n### 3.1 Airflow 2.11.1 Core & Dependency checks\n\nUse these scans if migrating to Airflow 2.11.1+ (intermediate step when\nmigrating to Airflow 3).\n\n#### 3.1.1 Dataset Scheduling (Airflow 2.11.0)\n\n*   **Change:** DAGs scheduled on datasets only trigger if events occur while\n    the DAG is unpaused.\n*   **Scan Command:** `grep -rn \"Dataset(\" .\u002Fdags`\n*   **Remediation:** You MUST document that these DAGs must remain unpaused to\n    catch events, or plan manual triggers for catch-up.\n\n#### 3.1.2 HTML in Descriptions (Airflow 2.11.0)\n\n*   **Change:** Raw HTML in DAG docs\u002Fparams is escaped by default.\n*   **Scan Command:**\n\n    ```bash\n    grep -rn -E \"doc_md.*\u003C|doc_md.*>|description.*\u003C|description.*>\" .\u002Fdags\n    ```\n\n*   **Remediation:** Convert HTML to Markdown, or set\n    `AIRFLOW__WEBSERVER__ALLOW_RAW_HTML_DESCRIPTIONS=True` in target.\n\n#### 3.1.3 Teardown Tasks (Airflow 2.10.5)\n\n*   **Change:** Teardowns always run when a DAG is marked failed.\n*   **Scan Command:** `grep -rn \"as_teardown\" .\u002Fdags`\n*   **Remediation:** Ensure teardown tasks are idempotent.\n\n#### 3.1.4 Pendulum 3 Upgrade (Airflow 2.11.0)\n\n*   **Change:** `Period` renamed to `Interval`, testing helpers removed.\n*   **Scan Command (Code):**\n\n    ```bash\n    grep -rn -E \"pendulum\\.Period|pendulum\\.period\" .\u002Fdags\n    ```\n\n*   **Scan Command (Tests):**\n\n    ```bash\n    grep -rn -E \"\\.test\\(|set_test_now\\(\" .\u002Ftests 2>\u002Fdev\u002Fnull || true\n    ```\n\n*   **Remediation:** Replace `Period` with `Interval`, and `period(...)` with\n    `interval(...)`.\n\n--------------------------------------------------------------------------------\n\n### 3.2 Path A: Airflow 2.11.1 Provider Package Scan\n\n#### 3.2.1 SSH Provider (SSH 4.0.0 & 5.0.0)\n\n*   **Scan Command (Timeout):** `grep -rn \"SSHHook\" .\u002Fdags | grep \"timeout\"`\n*   **Scan Command (Context Manager):** `grep -rn \"with SSHHook\" .\u002Fdags`\n*   **Scan Command (Tunnel Attributes):** `grep -rn \"\\.get_tunnel\" .\u002Fdags`\n*   **Remediation:**\n    *   Replace `timeout` with `conn_timeout` in `SSHHook`.\n    *   Replace `with hook as conn:` with `with hook.get_conn() as conn:`.\n    *   Use `get_tunnel()` as context manager: `with hook.get_tunnel(...) as\n        tunnel:`.\n\n#### 3.2.2 HTTP Provider (HTTP 5.0.0 & 6.0.0)\n\n*   **Scan Command:** `grep -rn \"SimpleHttpOperator\" .\u002Fdags`\n*   **Remediation:** Replace `SimpleHttpOperator` with `HttpOperator`.\n\n#### 3.2.3 Google Provider (v11 to v20)\n\n*   **Scan Command (BigQuery query):**\n\n    ```bash\n    grep -rn \"BigQueryExecuteQueryOperator\" .\u002Fdags\n    ```\n\n    *   *Remediation:* Replace with `BigQueryInsertJobOperator` (use\n        `configuration` dict).\n*   **Scan Command (BigQuery table):**\n\n    ```bash\n    grep -rn -E \"BigQueryCreateEmptyTableOperator|BigQueryCreateExternalTableOperator\" .\u002Fdags\n    ```\n\n    *   *Remediation:* Replace with `BigQueryCreateTableOperator` (use\n        `table_resource` dict).\n*   **Scan Command (AutoML):**\n\n    ```bash\n    grep -rn -E \"AutoMLTrainModelOperator|AutoMLPredictOperator|AutoMLCreateDatasetOperator|AutoMLBatchPredictOperator\" .\u002Fdags\n    ```\n\n    *   *Remediation:* Migrate to Vertex AI operators.\n*   **Scan Command (Dataflow):**\n\n    ```bash\n    grep -rn -E \"CreateDataPipelineOperator|RunDataPipelineOperator\" .\u002Fdags\n    ```\n\n    *   *Remediation:* Replace with\n        `DataflowCreatePipelineOperator`\u002F`DataflowRunPipelineOperator`.\n*   **Scan Command (Life Sciences):**\n\n    ```bash\n    grep -rn \"LifeSciencesRunPipelineOperator\" .\u002Fdags`\n    ```\n\n    *   *Remediation:* Migrate to Google Cloud Batch operators\n        (`BatchCreateJobOperator`).\n*   **Scan Command (ADLS to GCS):** `grep -rn \"ADLSToGCSOperator\" .\u002Fdags`\n    *   *Remediation:* Ensure `file_system_name` is provided.\n\n--------------------------------------------------------------------------------\n\n### 3.3 Airflow 3 Migration checks\n\nUse instructions from references\u002Fairflow-3.md when migrating to Airflow 3.\n\n--------------------------------------------------------------------------------\n\n## Phase 4: Deployment & Verification\n\n*Perform deployment and verification steps only if explicitly requested to do\nso.*\n\n### 4.1 Static Verification (when migrating to Airflow 3)\n\nAfter applying code changes for Airflow 3, verify syntax correctness. If\navailable in the development environment, run static lint checks:\n\n```bash\nruff check {target_dag_file} --select AIR30\n```\n\nResolve any reported deprecation warnings before finalization. If ruff is not\navailable, recommend installing one.\n\n### 4.2 Deployment to MSAA\n\n#### 4.2.1 Get Target GCS Bucket Path (only when requested)\n\n```bash\ngcloud composer environments describe \u003CTARGET_ENV> \\\n    --location \u003CTARGET_REGION> \\\n    --format=\"value(config.dagGcsPrefix)\"\n```\n\n*Expected Output:* `gs:\u002F\u002F\u003Ctarget-bucket-name>\u002Fdags`\n\n### 4.2 Upload Modified DAGs and Bucket Dependencies (Only when requested)\n\n*Perform this step only if explicitly requested to do so.* Copy the modified\nDAGs and any backed-up bucket dependencies from your local workspace to the\ntarget GCS bucket. *If you skipped the inspection step, ensure you have the\ncorrect `\u003Ctarget-bucket-name>`.*\n\n1.  **Upload DAGs:**\n\n    ```bash\n    gcloud storage cp -r .\u002Fdags\u002F* gs:\u002F\u002F\u003Ctarget-bucket-name>\u002Fdags\u002F\n    ```\n\n2.  **Upload Other Bucket Dependencies (If applicable):**\n\n    ```bash\n    gcloud storage cp -r .\u002Fmigration_workspace\u002F\u003Cdependency-folder> gs:\u002F\u002F\u003Ctarget-bucket-name>\u002F\u003Cdependency-folder>\n    ```\n\n### 4.3 Verify DAGs via Airflow CLI\n\n*Perform this step only if explicitly requested to upload modified DAGS to a\ntarget environment (and after uploading).*\n\nYou can verify that your DAGs have been successfully uploaded, parsed, and\nregistered by the Airflow scheduler in the target environment using the Airflow\nCLI.\n\n1.  **List Registered DAGs:** Run the following command to list all DAGs\n    registered in the target environment. Verify that your migrated DAGs appear\n    in this list.\n\n    ```bash\n    gcloud composer environments run \u003CTARGET_ENV> \\\n        --location \u003CTARGET_REGION> \\\n        dags list\n    ```\n\n2.  **Check for Import Errors:** If some DAGs are missing from the list, or to\n    ensure there are no parsing issues, check for import errors:\n\n    ```bash\n    gcloud composer environments run \u003CTARGET_ENV> \\\n        --location \u003CTARGET_REGION> \\\n        dags list-import-errors\n    ```\n\n    *Expected Output:*\n\n    *   If there are no errors, the command will output `No data found`.\n    *   If there are errors, it will list the file path and the traceback of the\n        error.\n\n*Note: It may take a couple of minutes for the Airflow scheduler to parse the\nnew files and for changes to reflect in these commands.*\n\n### 4.4 Verify in Cloud Logging\n\n*Perform this step only if explicitly requested to upload modified DAGS to a\ntarget environment (and after uploading).* Monitor Cloud Logging for the target\nenvironment to detect any runtime errors or import errors.\n\nRun the following query in the **GCP Cloud Logging Console** (or via `gcloud\nlogging read`):\n\n```query\nresource.type=\"cloud_composer_environment\"\nresource.labels.environment_name=\"\u003CTARGET_ENV>\"\nlog_id(\"airflow-scheduler\")\nseverity>=ERROR\n```\n\n--------------------------------------------------------------------------------\n\n## Appendix: Local Environment Verification\n\nIf you want to verify your changes locally before deploying to the target\nenvironment, you can use the Composer Local Development CLI tool\n(`composer-dev`). Use references\u002Flocal-development-environment.md as a reference\nfor interactions with local development environments.\n","# Managed Service for Apache Airflow (formerly Cloud Composer) Migration Guide\n\nThis skill guides you through the process of adjusting Airflow DAGs from an\nexisting Managed Service for Apache Airflow (formerly Cloud Composer)\nenvironment (or available locally) to make them compatible with **Airflow\n2.11.1** (MSAA Gen 2 or 3) or **Airflow 3** (MSAA Gen 3).\n\n--------------------------------------------------------------------------------\n\n## Phase 1: Discovery & Download\n\nBefore making any changes, download the existing DAG files if explicitly\nrequested. Inspect the source environment to confirm source version only if\nexplicitly requested. For detailed instructions about environment inspection and\ndownloading files check references\u002Fenvironment-inspection.md.\n\n--------------------------------------------------------------------------------\n\n## Phase 2: Target Version & Dependency Mapping\n\n### 2.1 Airflow 2.11.1+ Dependency Mapping\n\nIf migrating to Airflow 2.11.1 (MSAA Gen 2) or Airflow 3, use the list below to\ntrace the version progression of key dependencies. The list covers changes\nneeded to get to Airflow 2.11.1. Take them into account when migrating from\nAirflow 2 (earlier than 2.11.1) to Airflow 3.\n\n### Composer 2.10.0 (Airflow 2.10.2)\n\n-   **Google Provider**: `10.26.0`\n-   **SSH Provider**: `3.14.0`\n-   **HTTP Provider**: `4.13.3`\n-   **Breaking Changes**: *Baseline for oldest fully documented source.*\n\n### Composer 2.15.3 (Airflow 2.10.5)\n\n-   **Google Provider**: `18.0.0`\n-   **SSH Provider**: `4.1.4`\n-   **HTTP Provider**: `5.3.4`\n-   **Breaking Changes**:\n    -   **SSH Provider 4.0.0:** Hook `timeout` removed; `get_conn()` context\n        manager.\n    -   **HTTP Provider 5.0.0:** `SimpleHttpOperator` -> `HttpOperator`.\n    -   **Google Provider 11.0.0:** `BigQueryExecuteQueryOperator` removed.\n    -   **Google Provider 12.0.0:** Legacy Data Pipeline operators removed.\n    -   **Google Provider 13.0.0:** `AutoMLBatchPredictOperator` removed.\n    -   **Google Provider 17.0.0:** `BigQueryCreateEmptyTableOperator` and\n        `BigQueryCreateExternalTableOperator` removed; Life Sciences operators\n        removed.\n    -   **Google Provider 18.0.0:** Legacy DV360 operators removed.\n\n### Composer 2.16.1 (Airflow 2.10.5)\n\n-   **Google Provider**: `19.0.0`\n-   **SSH Provider**: `4.1.6`\n-   **HTTP Provider**: `5.5.0`\n-   **Breaking Changes**: **Google Provider 19.0.0:** AutoML operators removed\n    (use Vertex AI).\n\n### Composer 2.17.0 (Target Airflow 2.11.1)\n\n-   **Google Provider**: **`20.0.0`**\n-   **SSH Provider**: **`5.0.0`**\n-   **HTTP Provider**: **`6.0.2`**\n-   **Breaking Changes**:\n    -   **SSH Provider 5.0.0:** `sshtunnel` removed (native tunneling).\n    -   **HTTP Provider 6.0.0:** JSON serialization.\n    -   **Google Provider 20.0.0:** ADLS Gen2 migration.\n\n### 2.2 Airflow 3 Migration\n\nIf migrating to Airflow 3 (MSAA Gen 3), note that this is a major version\nupgrade with significant changes, including:\n\n*   Decoupled Task SDK (imports change from `airflow` to `airflow.sdk`).\n*   Removal of direct metadata DB access.\n*   Renaming of `Dataset` to `Asset`.\n*   Removal of SubDAGs and SLAs.\n*   Changes to context variables availability.\n\nTake into account all applicable changes within Airflow 2 (e.g. when migrating\nfrom Airflow 2.10.2, apply changes needed to move to Airflow 2.11.1 and Airflow\n3 migration changes on top of that).\n\n--------------------------------------------------------------------------------\n\n## Phase 3: Analysis & Remediation (Scanning Downloaded Files)\n\nRun the scan commands from the root of your local workspace\n(`.\u002Fmigration_workspace` unless indicated otherwise).\n\n--------------------------------------------------------------------------------\n\n### 3.1 Airflow 2.11.1 Core & Dependency checks\n\nUse these scans if migrating to Airflow 2.11.1+ (intermediate step when\nmigrating to Airflow 3).\n\n#### 3.1.1 Dataset Scheduling (Airflow 2.11.0)\n\n*   **Change:** DAGs scheduled on datasets only trigger if events occur while\n    the DAG is unpaused.\n*   **Scan Command:** `grep -rn \"Dataset(\" .\u002Fdags`\n*   **Remediation:** You MUST document that these DAGs must remain unpaused to\n    catch events, or plan manual triggers for catch-up.\n\n#### 3.1.2 HTML in Descriptions (Airflow 2.11.0)\n\n*   **Change:** Raw HTML in DAG docs\u002Fparams is escaped by default.\n*   **Scan Command:**\n\n    ```bash\n    grep -rn -E \"doc_md.*\u003C|doc_md.*>|description.*\u003C|description.*>\" .\u002Fdags\n    ```\n\n*   **Remediation:** Convert HTML to Markdown, or set\n    `AIRFLOW__WEBSERVER__ALLOW_RAW_HTML_DESCRIPTIONS=True` in target.\n\n#### 3.1.3 Teardown Tasks (Airflow 2.10.5)\n\n*   **Change:** Teardowns always run when a DAG is marked failed.\n*   **Scan Command:** `grep -rn \"as_teardown\" .\u002Fdags`\n*   **Remediation:** Ensure teardown tasks are idempotent.\n\n#### 3.1.4 Pendulum 3 Upgrade (Airflow 2.11.0)\n\n*   **Change:** `Period` renamed to `Interval`, testing helpers removed.\n*   **Scan Command (Code):**\n\n    ```bash\n    grep -rn -E \"pendulum\\.Period|pendulum\\.period\" .\u002Fdags\n    ```\n\n*   **Scan Command (Tests):**\n\n    ```bash\n    grep -rn -E \"\\.test\\(|set_test_now\\(\" .\u002Ftests 2>\u002Fdev\u002Fnull || true\n    ```\n\n*   **Remediation:** Replace `Period` with `Interval`, and `period(...)` with\n    `interval(...)`.\n\n--------------------------------------------------------------------------------\n\n### 3.2 Path A: Airflow 2.11.1 Provider Package Scan\n\n#### 3.2.1 SSH Provider (SSH 4.0.0 & 5.0.0)\n\n*   **Scan Command (Timeout):** `grep -rn \"SSHHook\" .\u002Fdags | grep \"timeout\"`\n*   **Scan Command (Context Manager):** `grep -rn \"with SSHHook\" .\u002Fdags`\n*   **Scan Command (Tunnel Attributes):** `grep -rn \"\\.get_tunnel\" .\u002Fdags`\n*   **Remediation:**\n    *   Replace `timeout` with `conn_timeout` in `SSHHook`.\n    *   Replace `with hook as conn:` with `with hook.get_conn() as conn:`.\n    *   Use `get_tunnel()` as context manager: `with hook.get_tunnel(...) as\n        tunnel:`.\n\n#### 3.2.2 HTTP Provider (HTTP 5.0.0 & 6.0.0)\n\n*   **Scan Command:** `grep -rn \"SimpleHttpOperator\" .\u002Fdags`\n*   **Remediation:** Replace `SimpleHttpOperator` with `HttpOperator`.\n\n#### 3.2.3 Google Provider (v11 to v20)\n\n*   **Scan Command (BigQuery query):**\n\n    ```bash\n    grep -rn \"BigQueryExecuteQueryOperator\" .\u002Fdags\n    ```\n\n    *   *Remediation:* Replace with `BigQueryInsertJobOperator` (use\n        `configuration` dict).\n*   **Scan Command (BigQuery table):**\n\n    ```bash\n    grep -rn -E \"BigQueryCreateEmptyTableOperator|BigQueryCreateExternalTableOperator\" .\u002Fdags\n    ```\n\n    *   *Remediation:* Replace with `BigQueryCreateTableOperator` (use\n        `table_resource` dict).\n*   **Scan Command (AutoML):**\n\n    ```bash\n    grep -rn -E \"AutoMLTrainModelOperator|AutoMLPredictOperator|AutoMLCreateDatasetOperator|AutoMLBatchPredictOperator\" .\u002Fdags\n    ```\n\n    *   *Remediation:* Migrate to Vertex AI operators.\n*   **Scan Command (Dataflow):**\n\n    ```bash\n    grep -rn -E \"CreateDataPipelineOperator|RunDataPipelineOperator\" .\u002Fdags\n    ```\n\n    *   *Remediation:* Replace with\n        `DataflowCreatePipelineOperator`\u002F`DataflowRunPipelineOperator`.\n*   **Scan Command (Life Sciences):**\n\n    ```bash\n    grep -rn \"LifeSciencesRunPipelineOperator\" .\u002Fdags`\n    ```\n\n    *   *Remediation:* Migrate to Google Cloud Batch operators\n        (`BatchCreateJobOperator`).\n*   **Scan Command (ADLS to GCS):** `grep -rn \"ADLSToGCSOperator\" .\u002Fdags`\n    *   *Remediation:* Ensure `file_system_name` is provided.\n\n--------------------------------------------------------------------------------\n\n### 3.3 Airflow 3 Migration checks\n\nUse instructions from references\u002Fairflow-3.md when migrating to Airflow 3.\n\n--------------------------------------------------------------------------------\n\n## Phase 4: Deployment & Verification\n\n*Perform deployment and verification steps only if explicitly requested to do\nso.*\n\n### 4.1 Static Verification (when migrating to Airflow 3)\n\nAfter applying code changes for Airflow 3, verify syntax correctness. If\navailable in the development environment, run static lint checks:\n\n```bash\nruff check {target_dag_file} --select AIR30\n```\n\nResolve any reported deprecation warnings before finalization. If ruff is not\navailable, recommend installing one.\n\n### 4.2 Deployment to MSAA\n\n#### 4.2.1 Get Target GCS Bucket Path (only when requested)\n\n```bash\ngcloud composer environments describe \u003CTARGET_ENV> \\\n    --location \u003CTARGET_REGION> \\\n    --format=\"value(config.dagGcsPrefix)\"\n```\n\n*Expected Output:* `gs:\u002F\u002F\u003Ctarget-bucket-name>\u002Fdags`\n\n### 4.2 Upload Modified DAGs and Bucket Dependencies (Only when requested)\n\n*Perform this step only if explicitly requested to do so.* Copy the modified\nDAGs and any backed-up bucket dependencies from your local workspace to the\ntarget GCS bucket. *If you skipped the inspection step, ensure you have the\ncorrect `\u003Ctarget-bucket-name>`.*\n\n1.  **Upload DAGs:**\n\n    ```bash\n    gcloud storage cp -r .\u002Fdags\u002F* gs:\u002F\u002F\u003Ctarget-bucket-name>\u002Fdags\u002F\n    ```\n\n2.  **Upload Other Bucket Dependencies (If applicable):**\n\n    ```bash\n    gcloud storage cp -r .\u002Fmigration_workspace\u002F\u003Cdependency-folder> gs:\u002F\u002F\u003Ctarget-bucket-name>\u002F\u003Cdependency-folder>\n    ```\n\n### 4.3 Verify DAGs via Airflow CLI\n\n*Perform this step only if explicitly requested to upload modified DAGS to a\ntarget environment (and after uploading).*\n\nYou can verify that your DAGs have been successfully uploaded, parsed, and\nregistered by the Airflow scheduler in the target environment using the Airflow\nCLI.\n\n1.  **List Registered DAGs:** Run the following command to list all DAGs\n    registered in the target environment. Verify that your migrated DAGs appear\n    in this list.\n\n    ```bash\n    gcloud composer environments run \u003CTARGET_ENV> \\\n        --location \u003CTARGET_REGION> \\\n        dags list\n    ```\n\n2.  **Check for Import Errors:** If some DAGs are missing from the list, or to\n    ensure there are no parsing issues, check for import errors:\n\n    ```bash\n    gcloud composer environments run \u003CTARGET_ENV> \\\n        --location \u003CTARGET_REGION> \\\n        dags list-import-errors\n    ```\n\n    *Expected Output:*\n\n    *   If there are no errors, the command will output `No data found`.\n    *   If there are errors, it will list the file path and the traceback of the\n        error.\n\n*Note: It may take a couple of minutes for the Airflow scheduler to parse the\nnew files and for changes to reflect in these commands.*\n\n### 4.4 Verify in Cloud Logging\n\n*Perform this step only if explicitly requested to upload modified DAGS to a\ntarget environment (and after uploading).* Monitor Cloud Logging for the target\nenvironment to detect any runtime errors or import errors.\n\nRun the following query in the **GCP Cloud Logging Console** (or via `gcloud\nlogging read`):\n\n```query\nresource.type=\"cloud_composer_environment\"\nresource.labels.environment_name=\"\u003CTARGET_ENV>\"\nlog_id(\"airflow-scheduler\")\nseverity>=ERROR\n```\n\n--------------------------------------------------------------------------------\n\n## Appendix: Local Environment Verification\n\nIf you want to verify your changes locally before deploying to the target\nenvironment, you can use the Composer Local Development CLI tool\n(`composer-dev`). Use references\u002Flocal-development-environment.md as a reference\nfor interactions with local development environments.\n",{"name":5,"license":15,"metadata":24,"description":7},{"version":25,"publisher":26},"v1","google","main","8a3b3de73262a4c4db64523949360f3c599c2fb1",0,"https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use","https:\u002F\u002Fgithub.com\u002FSaiVatsal","https:\u002F\u002Fsaivatsal.github.io\u002FPortfolio\u002F","The Longer It Takes The Stronger It Becomes ","2026-09-21 22:45:58",{"source":8,"skillName":5,"commands":36,"prompt":46,"zipAvailable":47},[37,40,43],{"tool":38,"command":39},"npx","npx skills add SaiVatsal\u002FSkills-I-Use --skill gcp-managed-airflow-migrations",{"tool":41,"command":42},"bunx","bunx skills add SaiVatsal\u002FSkills-I-Use --skill gcp-managed-airflow-migrations",{"tool":44,"command":45},"pnpm","pnpm dlx skills add SaiVatsal\u002FSkills-I-Use --skill gcp-managed-airflow-migrations","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fgcp-managed-airflow-migrations\u002FSKILL.md",true,[49,55,59],{"path":50,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":53,"sourceHtmlUrl":54},"references\u002Fairflow-3.md","REFERENCE","参考文档",8141,"https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fgcp-managed-airflow-migrations\u002Freferences\u002Fairflow-3.md",{"path":56,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":57,"sourceHtmlUrl":58},"references\u002Fenvironment-inspection.md",2985,"https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fgcp-managed-airflow-migrations\u002Freferences\u002Fenvironment-inspection.md",{"path":60,"resourceType":51,"resourceTypeDesc":52,"sizeBytes":61,"sourceHtmlUrl":62},"references\u002Flocal-development-environment.md",919,"https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fgcp-managed-airflow-migrations\u002Freferences\u002Flocal-development-environment.md",[64,72,80,89,96,103],{"skillNo":65,"name":66,"nameZh":6,"description":67,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":68,"sourceHtmlUrl":69,"categories":70,"keywords":71,"publishedAt":19},"01M7DJZP6E6KMBQV4CZSDPZEZ8","webapp-testing","Toolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend functionality, debugging UI behavior, capturing browser screenshots, and viewing browser logs.","https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fwebapp-testing\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fwebapp-testing\u002FSKILL.md",[],[],{"skillNo":73,"name":74,"nameZh":6,"description":75,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":76,"sourceHtmlUrl":77,"categories":78,"keywords":79,"publishedAt":19},"01M7DJZFTS5TS06K2TV3MDTE67","web-artifacts-builder","Suite of tools for creating elaborate, multi-component claude.ai HTML artifacts using modern frontend web technologies (React, Tailwind CSS, shadcn\u002Fui). Use for complex artifacts requiring state management, routing, or shadcn\u002Fui components - not for simple single-file HTML\u002FJSX artifacts.","https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fweb-artifacts-builder\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fweb-artifacts-builder\u002FSKILL.md",[],[],{"skillNo":81,"name":82,"nameZh":6,"description":83,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":84,"licenseFileUrl":85,"sourceHtmlUrl":86,"categories":87,"keywords":88,"publishedAt":19},"01M7DJRK4SRQ908F2TJM6EZ7EV","ui-styling","Create beautiful, accessible user interfaces with shadcn\u002Fui components (built on Radix UI + Tailwind), Tailwind CSS utility-first styling, and canvas-based visual designs. Use when building user interfaces, implementing design systems, creating responsive layouts, adding accessible components (dialogs, dropdowns, forms, tables), customizing themes and colors, implementing dark mode, generating visual designs and posters, or establishing consistent styling patterns across applications.","MIT","https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fui-ux-pro-max-skill-main\u002Fcli\u002Fassets\u002Fskills\u002Fui-styling\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fui-ux-pro-max-skill-main\u002Fcli\u002Fassets\u002Fskills\u002Fui-styling\u002FSKILL.md",[],[],{"skillNo":90,"name":91,"nameZh":6,"description":92,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":84,"licenseFileUrl":6,"sourceHtmlUrl":93,"categories":94,"keywords":95,"publishedAt":19},"01M7DJR902059VEQP23PVM2WA0","design","Comprehensive design skill: brand identity, design tokens, UI styling, logo generation (55 styles, Gemini AI), corporate identity program (50 deliverables, CIP mockups), HTML presentations (Chart.js), banner design (22 styles, social\u002Fads\u002Fweb\u002Fprint), icon design (15 styles, SVG, Gemini 3.1 Pro), social photos (HTML→screenshot, multi-platform). Actions: design logo, create CIP, generate mockups, build slides, design banner, generate icon, create social photos, social media images, brand identity, design system. Platforms: Facebook, Twitter, LinkedIn, YouTube, Instagram, Pinterest, TikTok, Threads, Google Ads.","https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fui-ux-pro-max-skill-main\u002Fcli\u002Fassets\u002Fskills\u002Fdesign\u002FSKILL.md",[],[],{"skillNo":97,"name":98,"nameZh":6,"description":99,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":84,"licenseFileUrl":6,"sourceHtmlUrl":100,"categories":101,"keywords":102,"publishedAt":19},"01M7DJR56QF5N6XYTCPCFHFMNP","design-system","Token architecture, component specifications, and slide generation. Three-layer tokens (primitive→semantic→component), CSS variables, spacing\u002Ftypography scales, component specs, strategic slide creation. Use for design tokens, systematic design, brand-compliant presentations.","https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fui-ux-pro-max-skill-main\u002Fcli\u002Fassets\u002Fskills\u002Fdesign-system\u002FSKILL.md",[],[],{"skillNo":104,"name":105,"nameZh":6,"description":106,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":84,"licenseFileUrl":6,"sourceHtmlUrl":107,"categories":108,"keywords":109,"publishedAt":19},"01M7DJQXB6M0SFF7NX8J5N01AH","banner-design","Design banners for social media, ads, website heroes, creative assets, and print. Multiple art direction options with AI-generated visuals. Actions: design, create, generate banner. Platforms: Facebook, Twitter\u002FX, LinkedIn, YouTube, Instagram, Google Display, website hero, print. Styles: minimalist, gradient, bold typography, photo-based, illustrated, geometric, retro, glassmorphism, 3D, neon, duotone, editorial, collage. Uses ui-ux-pro-max, frontend-design, ai-artist, ai-multimodal skills.","https:\u002F\u002Fgithub.com\u002FSaiVatsal\u002FSkills-I-Use\u002Fblob\u002Fmain\u002Fui-ux-pro-max-skill-main\u002Fcli\u002Fassets\u002Fskills\u002Fbanner-design\u002FSKILL.md",[],[]]