[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6HX2EPV1Z9FS0W5CSTPDKTC":3,"skill-same:01M6HX2EPV1Z9FS0W5CSTPDKTC":71},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":23,"publishedAt":38,"linkOnly":39,"markdownContent":40,"markdownBody":41,"frontMatter":42,"refName":43,"commitSha":44,"skillDirectory":45,"forksCount":46,"repositoryHtmlUrl":47,"repositoryHomepageUrl":6,"ownerHtmlUrl":48,"ownerBlogUrl":49,"ownerDescription":6,"updatedAt":50,"install":51,"resources":64},"01M6HX2EPV1Z9FS0W5CSTPDKTC","spreadsheet-validated-execution",null,"Execute Python scripts with prerequisite data validation and fallback strategies for inaccessible sources","HKUDS\u002FAgentPilot","HKUDS","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F118165258?v=4","01M6HW8VRNZP64G0P4MVJW2KKQ","✨Data Intelligence Lab@HKU✨","01M6HW8VWZVHBRHYH3T330PFWV",7993,"MIT","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Fbenchmarks\u002Fgdpval\u002Fskills\u002Fspreadsheet-direct-python-enhanced-enhanced\u002FSKILL.md",[18],{"categoryNo":19,"categoryName":20,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000004","电子表格","SCENARIO","使用场景",[24,25,26,27,28,29,30,31,32,33,34,35,36,37],"execution","spreadsheet","spreadsheet validated execution","python","validation","data","execute","fallback","data validation","strategies","scripts","sources","with","for","2026-11-10 10:12:30",false,"---\nname: spreadsheet-python-file-exec\nname: spreadsheet-validated-execution\ndescription: Execute Python scripts with prerequisite data validation and fallback strategies for inaccessible sources\n---\n\n# Direct Python Execution for Spreadsheet Tasks\n\n## When to Use This Skill\n\nUse this skill for spreadsheet operations that require verified source data:\n\n- **Before processing**: Verify data sources are accessible and contain expected data\n- Reading or writing complex Excel files with multiple sheets\n- Applying formulas, formatting, or data transformations\n- Working with `openpyxl`, `pandas`, or similar libraries\n- The operation involves multiple steps that could exceed agent step limits\n- You need precise control over error handling and debugging\n- Complex scripts benefit from file-based execution for better reliability\n\n## Critical: Data Source Validation First\n\n**Always validate data availability before attempting spreadsheet operations.** This prevents wasted iterations on unavailable data.\n\n### Pre-Execution Validation Checklist\n\n1. **Verify source accessibility**: Test connection to data URLs\u002Ffiles before building processing scripts\n2. **Confirm data format**: Ensure source data matches expected structure (columns, sheets, file type)\n3. **Check data completeness**: Validate required fields\u002Frows are present\n4. **Identify fallback sources**: Document alternative data sources if primary is unavailable\n\n### Validation Script Pattern\n\n```python\nimport sys\nimport os\nfrom pathlib import Path\n\ndef validate_source(source_path, required_fields=None):\n    \"\"\"Validate data source before processing\"\"\"\n    if not Path(source_path).exists():\n        return False, f\"Source file not found: {source_path}\"\n    \n    try:\n        # Check file is readable and non-empty\n        if os.path.getsize(source_path) == 0:\n            return False, \"Source file is empty\"\n        \n        if required_fields:\n            # Validate structure using pandas\n            import pandas as pd\n            df = pd.read_excel(source_path, nrows=1)\n            missing = set(required_fields) - set(df.columns)\n            if missing:\n                return False, f\"Missing required columns: {missing}\"\n        \n        return True, \"Source validated\"\n    except Exception as e:\n        return False, f\"Validation error: {str(e)}\"\n\n# Usage\nvalid, message = validate_source('input.xlsx', ['ID', 'Date', 'Value'])\nif not valid:\n    print(f\"ABORT: {message}\", file=sys.stderr)\n    sys.exit(1)\nprint(f\"OK: {message}\")\n```\n\n### Handling Inaccessible Data Sources\n\nWhen primary data sources are unavailable:\n\n1. **Report clearly**: Document the specific error (SSL, timeout, file not found)\n2. **Attempt fallbacks**: Check alternative sources in priority order:\n   - Local cached copies of the data\n   - Alternative API endpoints or URLs\n   - Different file formats from the same source\n   - Contact information for data provider\n3. **Graceful degradation**: If partial data is available, document what's missing\n4. **Escalation protocol**: For persistent failures, provide:\n   - Exact error messages and timestamps\n   - URLs\u002Fpaths that were attempted\n   - Workarounds already tried\n   - Recommended next steps for human intervention\n\n### Example: Multi-Source Fallback Pattern\n\n```python\nimport sys\nfrom pathlib import Path\n\nsources = [\n    'data\u002Fwells_current.xlsx',           # Primary: latest data\n    'data\u002Fwells_backup.xlsx',            # Fallback 1: backup copy\n    'data\u002Fwells_archive.xlsx',           # Fallback 2: archived version\n    '\u002Fcached\u002Fwells_data.xlsx',           # Fallback 3: system cache\n]\n\nselected_source = None\nfor source in sources:\n    if Path(source).exists():\n        selected_source = source\n        print(f\"Using fallback source: {source}\")\n        break\n\nif not selected_source:\n    print(\"CRITICAL: No data sources available\", file=sys.stderr)\n    print(\"Attempted sources:\", file=sys.stderr)\n    for s in sources:\n        print(f\"  - {s}\", file=sys.stderr)\n    sys.exit(1)\n\n# Proceed with selected_source\n```\n\n- Reading or writing complex Excel files with multiple sheets\n- Applying formulas, formatting, or data transformations\n- Working with `openpyxl`, `pandas`, or similar libraries\n- The operation involves multiple steps that could exceed agent step limits\n- You need precise control over error handling and debugging\n- Complex scripts benefit from file-based execution for better reliability\n\n## Why Direct Execution?\n\nThe `shell_agent` tool can:\n\n- Hit maximum step limits on complex multi-step operations\n- Produce unexplained errors on formatting operations\n- Fail on intricate spreadsheet reads\u002Fwrites due to iterative parsing\n- Fail to parse heredoc syntax correctly, causing 'unknown error' failures\n\nDirect `run_shell` with Python is more reliable because it:\n\n- Executes in a single step with no iteration limits\n- Provides clearer, immediate error messages\n- Handles complex operations without step constraints\n- Gives full control over library imports and execution flow\n- Writing scripts to `.py` files first avoids shell_agent parsing issues with heredocs\n\n## How to Use\n\n### Recommended Pattern: Write Script to File First\n\nFor complex multi-line scripts, especially when using shell_agent as executor:\n\n```bash\n# Step 1: Write the Python script to a file\ncat > process_spreadsheet.py \u003C\u003C 'EOF'\nimport openpyxl\nfrom openpyxl import Workbook\n\n# Your spreadsheet code here\nwb = openpyxl.load_workbook('file.xlsx')\n# ... operations ...\nwb.save('output.xlsx')\nprint('Success')\nEOF\n\n# Step 2: Execute the script\npython3 process_spreadsheet.py\n```\n\n### Alternative Pattern: Inline Heredoc (Simple Scripts Only)\n\nFor short, simple scripts when NOT using shell_agent as the executor:\n\n```bash\npython3 \u003C\u003C 'EOF'\nimport openpyxl\nfrom openpyxl import Workbook\n\n# Your spreadsheet code here\nwb = openpyxl.load_workbook('file.xlsx')\n# ... operations ...\nwb.save('output.xlsx')\nprint('Success')\nEOF\n```\n\n### Example 1: Read and Transform Excel Data\n\n**Write to file first, then execute:**\n\n```python\nimport pandas as pd\n\n# Load data from specific sheet\ndf = pd.read_excel('input.xlsx', sheet_name='Revenue')\n\n# Apply transformations\ndf['Net_Revenue'] = df['Gross_Revenue'] * (1 - df['Tax_Rate'])\n\n# Save results\ndf.to_excel('output.xlsx', index=False, sheet_name='Processed')\n```\n\n### Example 2: Multi-Sheet Operations with openpyxl\n\n**Write to file first, then execute:**\n\n```python\nfrom openpyxl import load_workbook\n\nwb = load_workbook('tour_data.xlsx')\n\n# Iterate through sheets\nfor sheet_name in wb.sheetnames:\n    ws = wb[sheet_name]\n    # Apply formatting or calculations\n    for row in ws.iter_rows(min_row=2, max_col=5):\n        # Process cells\n        pass\n\nwb.save('tour_data_processed.xlsx')\n```\n\n### Example 3: Complex Formatting Operations\n\n**Write to file first, then execute:**\n\n```python\nfrom openpyxl import load_workbook\nfrom openpyxl.styles import Font, PatternFill, Alignment\n\nwb = load_workbook('report.xlsx')\nws = wb.active\n\n# Apply header styling\nheader_fill = PatternFill(start_color='4472C4', fill_type='solid')\nheader_font = Font(bold=True, color='FFFFFF')\n\nfor cell in ws[1]:\n    cell.fill = header_fill\n    cell.font = header_font\n    cell.alignment = Alignment(horizontal='center')\n\nwb.save('report_formatted.xlsx')\n```\n\n### Example 4: Error Handling Pattern\n\n**Write to file first, then execute:**\n\n```python\nimport sys\nfrom openpyxl import load_workbook\n\ntry:\n    wb = load_workbook('data.xlsx')\n    ws = wb.active\n    \n    # Your operations here\n    value = ws['A1'].value\n    \n    wb.save('output.xlsx')\n    print(f\"Success: Processed {ws.max_row} rows\")\n    \nexcept Exception as e:\n    print(f\"Error: {str(e)}\", file=sys.stderr)\n    sys.exit(1)\n```\n\n## Best Practices\n\n1. **Prefer file-based execution** for complex scripts: write to `.py` file first, then execute via `run_shell`\n2. **Import only needed libraries** to reduce execution time\n3. **Print clear success\u002Ferror messages** for debugging\n4. **Save intermediate results** for complex multi-step transformations\n5. **Test with small data** before scaling to large spreadsheets\n6. **Use pandas for data manipulation** and openpyxl for formatting when both are needed\n7. **Clean up temporary script files** after execution if they won't be reused\n\n## When NOT to Use This Skill\n\n- Simple single-cell reads\u002Fwrites (use shell_agent or basic commands)\n- Operations that require interactive user input\n- Tasks where you need the agent to iteratively refine the approach\n\n## Common Libraries\n\n| Library | Best For |\n|---------|----------|\n| `openpyxl` | Reading\u002Fwriting .xlsx files, formatting, formulas |\n| `pandas` | Data manipulation, analysis, merging datasets |\n| `xlrd` | Reading older .xls files (read-only) |\n| `xlsxwriter` | Creating new .xlsx files with advanced formatting |\n\n## Troubleshooting\n\n**Issue**: Heredoc syntax fails with 'unknown error' when using shell_agent\n- **Solution**: Write the Python script to a `.py` file first, then execute it with `python3 script.py`. This pattern is significantly more reliable than inline heredoc execution when shell_agent is the executor.\n\n**Issue**: FileNotFoundError\n- **Solution**: Verify the file path is absolute or relative to the working directory\n\n**Issue**: PermissionError\n- **Solution**: Ensure the file is not open in another application\n\n**Issue**: MemoryError on large files\n- **Solution**: Process data in chunks using pandas `chunksize` parameter\n\n**Issue**: Formatting not applying\n- **Solution**: Ensure you're modifying cell styles before saving, and use `.copy()` for style objects\n\n## Data Validation Integration\n\nCombine validation with execution in a single script:\n\n```python\nimport sys\nfrom pathlib import Path\nimport pandas as pd\n\n# === PHASE 1: Validate ===\nsource_file = 'input_data.xlsx'\nif not Path(source_file).exists():\n    print(f\"ERROR: Source not found: {source_file}\", file=sys.stderr)\n    sys.exit(1)\n\ntry:\n    df = pd.read_excel(source_file)\n    if len(df) == 0:\n        print(\"ERROR: Source file is empty\", file=sys.stderr)\n        sys.exit(1)\n    print(f\"Validated: {len(df)} rows found\")\nexcept Exception as e:\n    print(f\"ERROR: Cannot read source: {e}\", file=sys.stderr)\n    sys.exit(1)\n\n# === PHASE 2: Process ===\ndf['calculated'] = df['value'] * 1.1\ndf.to_excel('output.xlsx', index=False)\nprint(\"Success: output.xlsx created\")\n```\n\n**Include validation at the start of every script:**\n\n```python\nimport sys\nfrom pathlib import Path\n\n# Validate BEFORE any processing\ninput_file = 'source.xlsx'\nif not Path(input_file).exists():\n    print(f\"FATAL: Input file missing: {input_file}\", file=sys.stderr)\n    sys.exit(1)\n\n# Now proceed with main logic\nfrom openpyxl import load_workbook\nwb = load_workbook(input_file)\n# ... rest of script ...\n```\n1. **Always validate sources first**: Check file existence and readability before processing\n2. **Document fallback sources**: Keep a list of alternative data locations\n3. **Fail fast on validation errors**: Exit immediately if source data is unavailable\n4. **Log validation results**: Include source paths and validation status in output\n5. **Print clear success\u002Ferror messages** for debugging\n6. **Save intermediate results** for complex multi-step transformations\n7. **Test with small data** before scaling to large spreadsheets\n8. **Use pandas for data manipulation** and openpyxl for formatting when both are needed\n9. **Clean up temporary script files** after execution if they won't be reused\n- Simple single-cell reads\u002Fwrites (use shell_agent or basic commands)\n- Tasks where source data is already confirmed available\n- Operations that require interactive user input\n- Tasks where you need the agent to iteratively refine the approach\n- **Solution**: Write the Python script to a `.py` file first, then execute it with `python3 script.py`. This pattern is significantly more reliable than inline heredoc execution when shell_agent is the executor.\n\n**Issue**: Source data unavailable (FileNotFoundError, connection timeout, SSL error)\n- **Solution**: \n  1. Confirm the exact error type and source path\u002FURL\n  2. Check for cached or backup copies in alternative locations\n  3. Verify network connectivity and proxy settings if fetching from web\n  4. Document all attempted sources and errors for escalation\n  5. Abort spreadsheet processing until data source is resolved\n\n**Issue**: Heredoc syntax fails with 'unknown error' when using shell_agent\n- **Solution**: Write the Python script to a `.py` file first, then execute it with `python3 script.py`. This pattern is significantly more reliable than inline heredoc execution when shell_agent is the executor.\n\n**Issue**: Data validation fails mid-execution\n- **Solution**: Structure scripts with explicit validation phase before processing phase. Use `sys.exit(1)` to halt immediately on validation failures.\n- **Solution**: Verify the file path is absolute or relative to the working directory. Add validation check at script start to catch this early.\n- **Solution**: Ensure the file is not open in another application\n- **Solution**: Ensure the file is not open in another application. Check file permissions with `ls -la` before processing.\n- **Solution**: Process data in chunks using pandas `chunksize` parameter\n- **Solution**: Process data in chunks using pandas `chunksize` parameter. Validate chunk count before processing.\n","# Direct Python Execution for Spreadsheet Tasks\n\n## When to Use This Skill\n\nUse this skill for spreadsheet operations that require verified source data:\n\n- **Before processing**: Verify data sources are accessible and contain expected data\n- Reading or writing complex Excel files with multiple sheets\n- Applying formulas, formatting, or data transformations\n- Working with `openpyxl`, `pandas`, or similar libraries\n- The operation involves multiple steps that could exceed agent step limits\n- You need precise control over error handling and debugging\n- Complex scripts benefit from file-based execution for better reliability\n\n## Critical: Data Source Validation First\n\n**Always validate data availability before attempting spreadsheet operations.** This prevents wasted iterations on unavailable data.\n\n### Pre-Execution Validation Checklist\n\n1. **Verify source accessibility**: Test connection to data URLs\u002Ffiles before building processing scripts\n2. **Confirm data format**: Ensure source data matches expected structure (columns, sheets, file type)\n3. **Check data completeness**: Validate required fields\u002Frows are present\n4. **Identify fallback sources**: Document alternative data sources if primary is unavailable\n\n### Validation Script Pattern\n\n```python\nimport sys\nimport os\nfrom pathlib import Path\n\ndef validate_source(source_path, required_fields=None):\n    \"\"\"Validate data source before processing\"\"\"\n    if not Path(source_path).exists():\n        return False, f\"Source file not found: {source_path}\"\n    \n    try:\n        # Check file is readable and non-empty\n        if os.path.getsize(source_path) == 0:\n            return False, \"Source file is empty\"\n        \n        if required_fields:\n            # Validate structure using pandas\n            import pandas as pd\n            df = pd.read_excel(source_path, nrows=1)\n            missing = set(required_fields) - set(df.columns)\n            if missing:\n                return False, f\"Missing required columns: {missing}\"\n        \n        return True, \"Source validated\"\n    except Exception as e:\n        return False, f\"Validation error: {str(e)}\"\n\n# Usage\nvalid, message = validate_source('input.xlsx', ['ID', 'Date', 'Value'])\nif not valid:\n    print(f\"ABORT: {message}\", file=sys.stderr)\n    sys.exit(1)\nprint(f\"OK: {message}\")\n```\n\n### Handling Inaccessible Data Sources\n\nWhen primary data sources are unavailable:\n\n1. **Report clearly**: Document the specific error (SSL, timeout, file not found)\n2. **Attempt fallbacks**: Check alternative sources in priority order:\n   - Local cached copies of the data\n   - Alternative API endpoints or URLs\n   - Different file formats from the same source\n   - Contact information for data provider\n3. **Graceful degradation**: If partial data is available, document what's missing\n4. **Escalation protocol**: For persistent failures, provide:\n   - Exact error messages and timestamps\n   - URLs\u002Fpaths that were attempted\n   - Workarounds already tried\n   - Recommended next steps for human intervention\n\n### Example: Multi-Source Fallback Pattern\n\n```python\nimport sys\nfrom pathlib import Path\n\nsources = [\n    'data\u002Fwells_current.xlsx',           # Primary: latest data\n    'data\u002Fwells_backup.xlsx',            # Fallback 1: backup copy\n    'data\u002Fwells_archive.xlsx',           # Fallback 2: archived version\n    '\u002Fcached\u002Fwells_data.xlsx',           # Fallback 3: system cache\n]\n\nselected_source = None\nfor source in sources:\n    if Path(source).exists():\n        selected_source = source\n        print(f\"Using fallback source: {source}\")\n        break\n\nif not selected_source:\n    print(\"CRITICAL: No data sources available\", file=sys.stderr)\n    print(\"Attempted sources:\", file=sys.stderr)\n    for s in sources:\n        print(f\"  - {s}\", file=sys.stderr)\n    sys.exit(1)\n\n# Proceed with selected_source\n```\n\n- Reading or writing complex Excel files with multiple sheets\n- Applying formulas, formatting, or data transformations\n- Working with `openpyxl`, `pandas`, or similar libraries\n- The operation involves multiple steps that could exceed agent step limits\n- You need precise control over error handling and debugging\n- Complex scripts benefit from file-based execution for better reliability\n\n## Why Direct Execution?\n\nThe `shell_agent` tool can:\n\n- Hit maximum step limits on complex multi-step operations\n- Produce unexplained errors on formatting operations\n- Fail on intricate spreadsheet reads\u002Fwrites due to iterative parsing\n- Fail to parse heredoc syntax correctly, causing 'unknown error' failures\n\nDirect `run_shell` with Python is more reliable because it:\n\n- Executes in a single step with no iteration limits\n- Provides clearer, immediate error messages\n- Handles complex operations without step constraints\n- Gives full control over library imports and execution flow\n- Writing scripts to `.py` files first avoids shell_agent parsing issues with heredocs\n\n## How to Use\n\n### Recommended Pattern: Write Script to File First\n\nFor complex multi-line scripts, especially when using shell_agent as executor:\n\n```bash\n# Step 1: Write the Python script to a file\ncat > process_spreadsheet.py \u003C\u003C 'EOF'\nimport openpyxl\nfrom openpyxl import Workbook\n\n# Your spreadsheet code here\nwb = openpyxl.load_workbook('file.xlsx')\n# ... operations ...\nwb.save('output.xlsx')\nprint('Success')\nEOF\n\n# Step 2: Execute the script\npython3 process_spreadsheet.py\n```\n\n### Alternative Pattern: Inline Heredoc (Simple Scripts Only)\n\nFor short, simple scripts when NOT using shell_agent as the executor:\n\n```bash\npython3 \u003C\u003C 'EOF'\nimport openpyxl\nfrom openpyxl import Workbook\n\n# Your spreadsheet code here\nwb = openpyxl.load_workbook('file.xlsx')\n# ... operations ...\nwb.save('output.xlsx')\nprint('Success')\nEOF\n```\n\n### Example 1: Read and Transform Excel Data\n\n**Write to file first, then execute:**\n\n```python\nimport pandas as pd\n\n# Load data from specific sheet\ndf = pd.read_excel('input.xlsx', sheet_name='Revenue')\n\n# Apply transformations\ndf['Net_Revenue'] = df['Gross_Revenue'] * (1 - df['Tax_Rate'])\n\n# Save results\ndf.to_excel('output.xlsx', index=False, sheet_name='Processed')\n```\n\n### Example 2: Multi-Sheet Operations with openpyxl\n\n**Write to file first, then execute:**\n\n```python\nfrom openpyxl import load_workbook\n\nwb = load_workbook('tour_data.xlsx')\n\n# Iterate through sheets\nfor sheet_name in wb.sheetnames:\n    ws = wb[sheet_name]\n    # Apply formatting or calculations\n    for row in ws.iter_rows(min_row=2, max_col=5):\n        # Process cells\n        pass\n\nwb.save('tour_data_processed.xlsx')\n```\n\n### Example 3: Complex Formatting Operations\n\n**Write to file first, then execute:**\n\n```python\nfrom openpyxl import load_workbook\nfrom openpyxl.styles import Font, PatternFill, Alignment\n\nwb = load_workbook('report.xlsx')\nws = wb.active\n\n# Apply header styling\nheader_fill = PatternFill(start_color='4472C4', fill_type='solid')\nheader_font = Font(bold=True, color='FFFFFF')\n\nfor cell in ws[1]:\n    cell.fill = header_fill\n    cell.font = header_font\n    cell.alignment = Alignment(horizontal='center')\n\nwb.save('report_formatted.xlsx')\n```\n\n### Example 4: Error Handling Pattern\n\n**Write to file first, then execute:**\n\n```python\nimport sys\nfrom openpyxl import load_workbook\n\ntry:\n    wb = load_workbook('data.xlsx')\n    ws = wb.active\n    \n    # Your operations here\n    value = ws['A1'].value\n    \n    wb.save('output.xlsx')\n    print(f\"Success: Processed {ws.max_row} rows\")\n    \nexcept Exception as e:\n    print(f\"Error: {str(e)}\", file=sys.stderr)\n    sys.exit(1)\n```\n\n## Best Practices\n\n1. **Prefer file-based execution** for complex scripts: write to `.py` file first, then execute via `run_shell`\n2. **Import only needed libraries** to reduce execution time\n3. **Print clear success\u002Ferror messages** for debugging\n4. **Save intermediate results** for complex multi-step transformations\n5. **Test with small data** before scaling to large spreadsheets\n6. **Use pandas for data manipulation** and openpyxl for formatting when both are needed\n7. **Clean up temporary script files** after execution if they won't be reused\n\n## When NOT to Use This Skill\n\n- Simple single-cell reads\u002Fwrites (use shell_agent or basic commands)\n- Operations that require interactive user input\n- Tasks where you need the agent to iteratively refine the approach\n\n## Common Libraries\n\n| Library | Best For |\n|---------|----------|\n| `openpyxl` | Reading\u002Fwriting .xlsx files, formatting, formulas |\n| `pandas` | Data manipulation, analysis, merging datasets |\n| `xlrd` | Reading older .xls files (read-only) |\n| `xlsxwriter` | Creating new .xlsx files with advanced formatting |\n\n## Troubleshooting\n\n**Issue**: Heredoc syntax fails with 'unknown error' when using shell_agent\n- **Solution**: Write the Python script to a `.py` file first, then execute it with `python3 script.py`. This pattern is significantly more reliable than inline heredoc execution when shell_agent is the executor.\n\n**Issue**: FileNotFoundError\n- **Solution**: Verify the file path is absolute or relative to the working directory\n\n**Issue**: PermissionError\n- **Solution**: Ensure the file is not open in another application\n\n**Issue**: MemoryError on large files\n- **Solution**: Process data in chunks using pandas `chunksize` parameter\n\n**Issue**: Formatting not applying\n- **Solution**: Ensure you're modifying cell styles before saving, and use `.copy()` for style objects\n\n## Data Validation Integration\n\nCombine validation with execution in a single script:\n\n```python\nimport sys\nfrom pathlib import Path\nimport pandas as pd\n\n# === PHASE 1: Validate ===\nsource_file = 'input_data.xlsx'\nif not Path(source_file).exists():\n    print(f\"ERROR: Source not found: {source_file}\", file=sys.stderr)\n    sys.exit(1)\n\ntry:\n    df = pd.read_excel(source_file)\n    if len(df) == 0:\n        print(\"ERROR: Source file is empty\", file=sys.stderr)\n        sys.exit(1)\n    print(f\"Validated: {len(df)} rows found\")\nexcept Exception as e:\n    print(f\"ERROR: Cannot read source: {e}\", file=sys.stderr)\n    sys.exit(1)\n\n# === PHASE 2: Process ===\ndf['calculated'] = df['value'] * 1.1\ndf.to_excel('output.xlsx', index=False)\nprint(\"Success: output.xlsx created\")\n```\n\n**Include validation at the start of every script:**\n\n```python\nimport sys\nfrom pathlib import Path\n\n# Validate BEFORE any processing\ninput_file = 'source.xlsx'\nif not Path(input_file).exists():\n    print(f\"FATAL: Input file missing: {input_file}\", file=sys.stderr)\n    sys.exit(1)\n\n# Now proceed with main logic\nfrom openpyxl import load_workbook\nwb = load_workbook(input_file)\n# ... rest of script ...\n```\n1. **Always validate sources first**: Check file existence and readability before processing\n2. **Document fallback sources**: Keep a list of alternative data locations\n3. **Fail fast on validation errors**: Exit immediately if source data is unavailable\n4. **Log validation results**: Include source paths and validation status in output\n5. **Print clear success\u002Ferror messages** for debugging\n6. **Save intermediate results** for complex multi-step transformations\n7. **Test with small data** before scaling to large spreadsheets\n8. **Use pandas for data manipulation** and openpyxl for formatting when both are needed\n9. **Clean up temporary script files** after execution if they won't be reused\n- Simple single-cell reads\u002Fwrites (use shell_agent or basic commands)\n- Tasks where source data is already confirmed available\n- Operations that require interactive user input\n- Tasks where you need the agent to iteratively refine the approach\n- **Solution**: Write the Python script to a `.py` file first, then execute it with `python3 script.py`. This pattern is significantly more reliable than inline heredoc execution when shell_agent is the executor.\n\n**Issue**: Source data unavailable (FileNotFoundError, connection timeout, SSL error)\n- **Solution**: \n  1. Confirm the exact error type and source path\u002FURL\n  2. Check for cached or backup copies in alternative locations\n  3. Verify network connectivity and proxy settings if fetching from web\n  4. Document all attempted sources and errors for escalation\n  5. Abort spreadsheet processing until data source is resolved\n\n**Issue**: Heredoc syntax fails with 'unknown error' when using shell_agent\n- **Solution**: Write the Python script to a `.py` file first, then execute it with `python3 script.py`. This pattern is significantly more reliable than inline heredoc execution when shell_agent is the executor.\n\n**Issue**: Data validation fails mid-execution\n- **Solution**: Structure scripts with explicit validation phase before processing phase. Use `sys.exit(1)` to halt immediately on validation failures.\n- **Solution**: Verify the file path is absolute or relative to the working directory. Add validation check at script start to catch this early.\n- **Solution**: Ensure the file is not open in another application\n- **Solution**: Ensure the file is not open in another application. Check file permissions with `ls -la` before processing.\n- **Solution**: Process data in chunks using pandas `chunksize` parameter\n- **Solution**: Process data in chunks using pandas `chunksize` parameter. Validate chunk count before processing.\n",{"name":5,"description":7},"main","6b84b0689ca0d9e7b1e4061188ff6b60758e0f8a","openspace\u002Fbenchmarks\u002Fgdpval\u002Fskills\u002Fspreadsheet-direct-python-enhanced-enhanced",940,"https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot","https:\u002F\u002Fgithub.com\u002FHKUDS","https:\u002F\u002Fsites.google.com\u002Fview\u002Fchaoh","2026-11-06 23:04:01",{"source":8,"skillName":5,"commands":52,"prompt":62,"zipAvailable":63},[53,56,59],{"tool":54,"command":55},"npx","npx skills add HKUDS\u002FAgentPilot --skill spreadsheet-validated-execution",{"tool":57,"command":58},"bunx","bunx skills add HKUDS\u002FAgentPilot --skill spreadsheet-validated-execution",{"tool":60,"command":61},"pnpm","pnpm dlx skills add HKUDS\u002FAgentPilot --skill spreadsheet-validated-execution","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Fbenchmarks\u002Fgdpval\u002Fskills\u002Fspreadsheet-direct-python-enhanced-enhanced\u002FSKILL.md",true,[65],{"path":66,"resourceType":67,"resourceTypeDesc":68,"sizeBytes":69,"sourceHtmlUrl":70},".skill_id","OTHER","其他",57,"https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Fbenchmarks\u002Fgdpval\u002Fskills\u002Fspreadsheet-direct-python-enhanced-enhanced\u002F.skill_id",[72,91,110,133,156,178],{"skillNo":73,"name":74,"nameZh":6,"description":75,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":76,"categories":77,"keywords":78,"publishedAt":38},"01M6HYB297NDABRERJRVG0K8R0","agentpilot","Set up AgentPilot and use its single entry to prepare missing inputs and run configured RSI experiments. Use when the user requests AgentPilot installation or work with AgentPilot.","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fplugins\u002Fagentpilot\u002Fskills\u002Fagentpilot\u002FSKILL.md",[],[74,79,80,36,81,82,83,84,85,86,87,88,89,90],"prepare","requests","missing","installation","rsi","up","use","user","work","SET","run","experiments",{"skillNo":92,"name":93,"nameZh":6,"description":94,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":95,"categories":96,"keywords":97,"publishedAt":38},"01M6HYAYWXTTE1J7DJM0MFNQ4H","remember","Review auto-memory entries and propose promotions to OPENSPACE.md, OPENSPACE.local.md, or retained auto-memory topics; detect duplicates, stale facts, conflicts, and ambiguous entries before making changes.","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Fopenspace\u002Fskills\u002Fremember\u002FSKILL.md",[],[93,98,99,100,101,102,103,104,105,106,107,108,109],"memory","review","auto","openspace","changes","facts","detect","entries","local","conflicts","stale","duplicates",{"skillNo":111,"name":112,"nameZh":6,"description":113,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":114,"categories":115,"keywords":119,"publishedAt":38},"01M6HYAVMPM4SBDV60R2B5HPV8","skill-discovery","Search reusable OpenSpace skills locally, and browse cloud packages step by step when a cloud skill may help. Reusing proven skills saves tokens, improves reliability, and extends your capabilities beyond built-in tools.","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Fopenspace\u002Fhost_skills\u002Fskill-discovery\u002FSKILL.md",[116],{"categoryNo":117,"categoryName":118,"taxonomyType":21,"taxonomyTypeDesc":22},"01JBSEEDCAT000000000000023","Skill与智能体开发",[120,121,122,101,123,124,125,126,127,128,129,130,131,132],"skill discovery","discovery","reusable","step by step","tokens","packages","help","cloud","reliability","capabilities","browse","search","Tools",{"skillNo":134,"name":135,"nameZh":6,"description":136,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":137,"categories":138,"keywords":140,"publishedAt":38},"01M6HYAR811B3RB0M50RBEDGN6","delegate-task","Delegate tasks to OpenSpace — a full-stack autonomous worker for coding, DevOps, web research, and desktop automation, backed by an extensive MCP tool and skill library. Skills auto-improve through use, reducing token consumption over time. A cloud community lets agents share and collectively evolve reusable skills.","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Fopenspace\u002Fhost_skills\u002Fdelegate-task\u002FSKILL.md",[139],{"categoryNo":117,"categoryName":118,"taxonomyType":21,"taxonomyTypeDesc":22},[141,142,143,101,144,145,146,147,148,122,100,85,149,150,151,37,152,153,154,155],"delegate","task","delegate task","time","improve","desktop automation","worker","community","autonomous","tool","stack","share","tasks","automation","MCP",{"skillNo":157,"name":158,"nameZh":6,"description":159,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":160,"categories":161,"keywords":162,"publishedAt":38},"01M6HYAM9FSGV6E52AYENDQXYH","write-special-chars-ts-check","Workaround for write_file failures caused by special characters (apostrophes, backticks, template literals) using a Python heredoc script, plus a reliable TypeScript type-checking step that filters output to only the newly-written files to avoid being misled by pre-existing errors.","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Flegacy\u002Fv1\u002Fshowcase\u002Fskills\u002Fwrite-special-chars-ts-check\u002FSKILL.md",[],[163,164,165,166,167,168,169,170,171,27,172,173,174,175,37,176,177],"write special chars ts check","write","check","type","files","filters","only","template","file","typescript","output","Existing","type-checking","errors","script",{"skillNo":179,"name":180,"nameZh":6,"description":181,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":182,"categories":183,"keywords":184,"publishedAt":38},"01M6HYAH05HGV7SVWSVR8PJRQD","write-special-chars-readback","Workaround for write_file failures caused by special characters (apostrophes, backticks, template literals) using a Python heredoc script, with mandatory post-write verification via read_file and cleanup of \u002Ftmp helper scripts.","https:\u002F\u002Fgithub.com\u002FHKUDS\u002FAgentPilot\u002Fblob\u002Fmain\u002Fopenspace\u002Flegacy\u002Fv1\u002Fshowcase\u002Fskills\u002Fwrite-special-chars-readback\u002FSKILL.md",[],[185,186,164,36,37,177,187,188,189,34,190,170,171,191,192,27],"write special chars readback","readback","helper","post","via","read","verification","cleanup"]