datalineage-bigquery-asset-impact-analysis
Analyzes the downstream impact (blast radius) when a BigQuery table or view is broken, stale, or modified. Identifies all downstream tables, dashboards, and processes that will be affected. Use when: - Performing a blast radius or impact analysis for a BigQuery table or view. - Assessing the consequences of modifying, deleting, or pausing updates to a BigQuery asset. - Identifying downstream dependencies (tables, dashboards, processes) of a BigQuery asset. Don't use for: - General BigQuery querying or data analysis (use BigQuery-related tools instead). - Non-BigQuery assets (e.g., Cloud Storage files) unless they are part of the BigQuery lineage. - Creating or modifying lineage links directly.
- License 许可
- MIT
- 最近更新
- 2026-10-17
- Stars
- ★ 8
- Forks
- 1
01 前言 Front Matter
- name
- datalineage-bigquery-asset-impact-analysis
- metadata
- { "category": "BigDataAndAnalytics" }
- description
- Analyzes the downstream impact (blast radius) when a BigQuery table or view is broken, stale, or modified. Identifies all downstream tables, dashboards, and processes that will be affected. Use when: - Performing a blast radius or impact analysis for a BigQuery table or view. - Assessing the consequences of modifying, deleting, or pausing updates to a BigQuery asset. - Identifying downstream dependencies (tables, dashboards, processes) of a BigQuery asset. Don't use for: - General BigQuery querying or data analysis (use BigQuery-related tools instead). - Non-BigQuery assets (e.g., Cloud Storage files) unless they are part of the BigQuery lineage. - Creating or modifying lineage links directly.
02 资源文件 1
- 参考文档references/mcp-usage.md1.2 KB
03 SKILL.md 正文
BigQuery Asset Impact Analysis
This skill guides the agent in performing a downstream impact analysis (blast radius assessment) when a BigQuery table or view is reported as broken, stale, missing, or when a user is planning maintenance and wants to know the consequences of modifying or pausing updates to an asset.
It relies primarily on the Google Cloud Data Lineage (Knowledge Catalog) MCP Server to discover relationships between assets.
Prerequisites
This skill requires access to the Google Cloud Data Lineage API and an active client connection to the Data Lineage MCP Server. For detailed connection configurations and tool schemas, refer to MCP Usage.
Analysis Workflow
1. Resolve the Asset's Fully Qualified Name (FQN)
- Ensure you have the correct FQN format for the BigQuery asset:
- Format:
bigquery:{project_id}.{dataset_id}.{table_or_view_id} - Example:
bigquery:my-prod-project.analytics.orders
- Format:
2. Determine Locations and Parent Path
Identify the locations to search and construct the Data Lineage API request:
- Discover Asset Location: Run the command
bq show --format=json {project_id}:{dataset_id}and extract thelocationfield (e.g.,us-central1orus). If location discovery fails due to permissions or missing tools, prompt the user for the dataset's location. - Set Parent Path: Set the
parentpath using the project ID and the MCP server's location. Consult theDataLineageServertool definition to find the configured region or location (e.g.,us). The format is:projects/{project_id}/locations/{mcp_server_location}. - Configure Search Scope: Include the discovered asset location in the
locationsarray of the payload (e.g.,["us-central1"]or["us", "us-central1"]).
3. Retrieve the Downstream Lineage Graph
Call the DataLineageServer:search_lineage tool to fetch downstream
relationships.
- Direction: Set to
DOWNSTREAM. - Search Parameters: Use
max_depth = 10andmax_process_per_link = 5as robust defaults.
4. Identify the Blast Radius
Traverse the returned lineage links to build the impact graph:
- Affected Assets: The
targetof each link represents a downstream asset that depends on your source asset. - Transform Processes: Inspect the
processesfield on each link. This identifies the ETL pipelines, BigQuery Views, or Scheduled Queries that propagate the data. - Direct vs. Indirect Impact:
- Direct Impact (Depth 1): Assets directly consuming the source asset.
If a link has
dependency_type: EXACT_COPY, mark the target as "Directly Stale / Identical Copy". - Indirect Impact (Depth > 1): Assets further down the stream that will experience cascading stale data or failures.
- Direct Impact (Depth 1): Assets directly consuming the source asset.
If a link has
5. Summarize and Format the Output
Present your findings clearly to the user using the following structure:
-
Executive Summary: State the total number of downstream assets affected and the maximum depth of the impact.
-
Critical Path: Highlight high-priority downstream assets (e.g., assets containing "prod", "dashboard", "reporting", or "master" in their names).
-
Blast Radius Table: A clean Markdown table listing the dependencies. You MUST include all columns:
Downstream Asset Transform Process Depth Impact Type bigquery:project.dataset.tableprojects/p/locations/l/processes/proc1 Direct bigquery:project.dataset.viewprojects/p/locations/l/processes/view2 Indirect -
Analysis Metadata: Provide transparency on the parameters and boundaries of your search so the user can choose to expand them:
- Locations Searched:
{list_of_locations_queried} - Parent Location:
{parent_path} - Depth Limit:
{max_depth} - Process per Link Limit:
{max_process_per_link} - Tip for User: Let the user know they can request to rerun the analysis with expanded locations or larger depth limits.
- Locations Searched:
Crucial Constraints & Guardrails
- Interpret Empty Responses Correctly:
- If the lineage response is empty, immediately assume that no dependencies exist in the queried locations and report this to the user.
- Strictly Banned Bypasses:
- Exclusively retrieve downstream relationships using the
DataLineageServer:search_lineagetool.
- Exclusively retrieve downstream relationships using the
- Verify Asset Existence First:
- If
bq showindicates the source table does not exist, stop and report this directly to the user. Do not attempt to guess alternative table names unless the user explicitly instructs you to do so.
- If
- No Output Shortcutting or Hallucinated Artifacts:
- Present the complete downstream blast radius table directly in your final response. Avoid telling the user you have created a separate Markdown file or artifact containing the details unless you have explicitly executed file-writing tools to create it.
Reference Directory
- MCP Usage: Using the Google Cloud Data Lineage remote MCP server and tool preferences.
External Documentation
04 同仓库更多 Skills
security-audit
Comprehensive security guidance, source code audit, vulnerability assessment, and penetration test review for codebases, APIs, microservices, CLI tools, libraries, and LLM-backed applications. Triggers on requests to audit a codebase, conduct security reviews, find vulnerabilities or flaws, pen-test source code, or when the user asks in Arabic (فحص أمني، تدقيق الكود أمنياً، مراجعة الثغرات، فحص أمان المشروع). Supports Guidance mode (focused review) and Full Audit mode (deterministic 6-phase harness).
malware-analysis-reversing
Production malware analysis workflows, reverse engineering methodologies, isolated sandbox triage, static/dynamic binary analysis, memory forensics, and YARA detection rule authoring.
application-security-pentesting
Production Application Security (AppSec) standards, OWASP Top 10 vulnerability remediation, SAST/DAST pipeline integration, secure code review, threat modeling, and defensive security posture.
oauth2-oidc-security-flows
Implement enterprise OAuth 2.1 and OpenID Connect (OIDC) authorization code flow with Proof Key for Code Exchange (PKCE), state and nonce verification, refresh token rotation, token revocation, and centralized IdP federation (Keycloak, Auth0, Okta). Trigger when building secure authentication, single sign-on (SSO), or third-party delegated authorization.
jwt-session-management-hardening
Harden JWT-based authentication and session lifecycles using asymmetric signing (RS256/EdDSA), JWKS rotation, strict claims validation, Redis-backed sliding window sessions, revocation lists, and secure HttpOnly cookie storage. Trigger when implementing token validation, session revocation, or hardening API authentication.
soc2-compliance-automation
Best practices for implementing SOC 2 Type II compliance controls, continuous evidence collection, infrastructure policy-as-code, and automated security monitoring. Use when automating Trust Services Criteria (Security, Availability, Confidentiality, Processing Integrity, Privacy), audit logging, IAM least privilege, or CI/CD security gates.