[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M75MD8MNQQT5DCXFDETG4F68":3,"skill-same:01M75MD8MNQQT5DCXFDETG4F68":63},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":15,"categories":16,"keywords":17,"publishedAt":18,"linkOnly":19,"markdownContent":20,"markdownBody":21,"frontMatter":22,"refName":43,"commitSha":44,"skillDirectory":45,"forksCount":13,"repositoryHtmlUrl":46,"repositoryHomepageUrl":47,"ownerHtmlUrl":48,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":49,"install":50,"resources":62},"01M75MD8MNQQT5DCXFDETG4F68","data-research",null,"Structured data research: search sources, extract structured data,\narchive raw sources, maintain canonical tracker pages, deduplicate.\nParameterized via YAML recipes for investor updates, donations,\ncompany updates, or any email-to-structured-data pipeline.","Sigmacodeat\u002FSigmabrain","Sigmacodeat","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F220578687?v=4","01M75M8ZBH9439AFP2NTF8K98S","01M75M8ZC680S4377SFWSKP0D1",0,"MIT","https:\u002F\u002Fgithub.com\u002FSigmacodeat\u002FSigmabrain\u002Fblob\u002Fmain\u002Fserver\u002Fskills\u002Fdata-research\u002FSKILL.md",[],[],"2026-11-12 13:55:43",false,"---\nname: data-research\nversion: 1.0.0\ndescription: |\n  Structured data research: search sources, extract structured data,\n  archive raw sources, maintain canonical tracker pages, deduplicate.\n  Parameterized via YAML recipes for investor updates, donations,\n  company updates, or any email-to-structured-data pipeline.\ntriggers:\n  - \"research\"\n  - \"track\"\n  - \"extract from email\"\n  - \"investor updates\"\n  - \"donations\"\n  - \"build a tracker\"\n  - \"data dig\"\ntools:\n  - search\n  - query\n  - get_page\n  - put_page\n  - add_link\n  - add_timeline_entry\n  - put_raw_data\n  - file_upload\nmutating: true\n---\n\n# Data Research\n\nStructured research pipeline: search sources, extract structured data,\narchive raw, deduplicate, update canonical trackers, backlink entities.\n\n## Contract\n\nOne skill for any email-to-structured-data pipeline. The only differences\nbetween tracking investor updates, expenses, and company metrics\nare the **search queries**, **extraction schemas**, and **tracker page format**.\nAll three use the same 7-phase pipeline with parameterized recipes.\n\n## When to Use\n\n- User wants to track structured data from email, web, or API sources\n- User says \"research\", \"track\", \"extract from email\", \"build a tracker\"\n- User mentions investor updates, donations, company metrics, filings\n- User wants to set up recurring data collection (with cron recipe)\n\n## Phases\n\n### Phase 1: Define Research Recipe\n\nAsk the user what they want to track. Either:\n- Pick a built-in recipe: investor-updates, expense-tracker, company-updates\n- Define a custom recipe with: source queries, classification rules, extraction schema,\n  tracker page path, tracker format\n\nRecipes are YAML files at `~\u002F.gbrain\u002Frecipes\u002F{name}.yaml`. Use `gbrain research init`\nto scaffold a new one.\n\n### Phase 2: Search Sources\n\nBrain first (maybe we already have this data). Then:\n- **Email** via credential gateway: windowed queries (quarterly, monthly if truncated)\n- **Web** via search: public filings, press releases, regulatory data\n- **APIs**: any structured data source the recipe defines\n- **Attachments**: PDF extraction, HTML stripping\n\n### Phase 3: Classify\n\nDeterministic first (regex patterns from recipe), LLM fallback.\nLog every LLM fallback for future regex improvement (fail-improve loop).\nSkip marketing, newsletters, noise based on recipe's classification rules.\n\n### Phase 4: Extract Structured Data\n\n**EXTRACTION INTEGRITY RULE:**\n1. Save raw source immediately (before any extraction)\n2. Extract fields using deterministic regex first, LLM fallback\n3. When summarizing batch results: **re-read from saved files**\n4. Never trust LLM working memory after batch processing\n\nThis prevents a known hallucination bug where batch-processed amounts were\n13\u002F13 wrong from LLM working memory while saved files were correct.\n\n### Phase 5: Archive Raw Sources\n\n- `put_raw_data` for email bodies, API responses\n- `file_upload` for PDF attachments, documents\n- Create `.redirect.yaml` pointers for large files in storage\n- Every tracker entry must link back to its raw source\n\n### Phase 6: Deduplicate\n\nBefore adding to tracker:\n- Exact match (same key fields) → skip\n- Fuzzy match (same entity + date + similar amount within tolerance) → flag for review\n- Different amount for same entity+date → add with note (could be correction)\n\n### Phase 7: Update Canonical Tracker + Backlink\n\n- Parse existing tracker page (markdown table)\n- Append new entries in correct section (grouped by year\u002Fquarter\u002Fentity)\n- Compute running totals\n- Backlink every mentioned entity (person → people\u002F page, company → companies\u002F page)\n- Uses enrichment service for entity pages\n\n## Built-In Recipes\n\nThree example recipes ship with GBrain (see `~\u002F.gbrain\u002Frecipes\u002F`):\n\n1. **investor-updates** — extract MRR, ARR, growth, burn, runway, headcount from investor update emails\n2. **expense-tracker** — extract amounts, recipients, platforms from receipt emails (subscriptions, services, recurring charges)\n3. **company-updates** — extract revenue, users, key metrics from portfolio company update emails\n\n## Anti-Patterns\n\n- Trusting LLM working memory for amounts after batch processing (use extraction integrity rule)\n- Creating tracker entries without raw source links\n- Running without deduplication (leads to double-counted entries)\n- Hardcoding source-specific patterns in the pipeline code (use recipes)\n\n## Output Format\n\nBrain page at the recipe's `tracker_page` path with markdown tables:\n\n```markdown\n### 2026\n\n| Date | Company | MRR | ARR | Growth | Status |\n|------|---------|-----|-----|--------|--------|\n| 2026-04-01 | Example Co | $188K | $2.3M | +14.7% MoM | [Source](link) |\n```\n\nEach entry links to its raw source. Running totals at the bottom of each section.\n\n## Conventions\n\nReferences `skills\u002Fconventions\u002Fquality.md` for citation and back-linking rules.\n","# Data Research\n\nStructured research pipeline: search sources, extract structured data,\narchive raw, deduplicate, update canonical trackers, backlink entities.\n\n## Contract\n\nOne skill for any email-to-structured-data pipeline. The only differences\nbetween tracking investor updates, expenses, and company metrics\nare the **search queries**, **extraction schemas**, and **tracker page format**.\nAll three use the same 7-phase pipeline with parameterized recipes.\n\n## When to Use\n\n- User wants to track structured data from email, web, or API sources\n- User says \"research\", \"track\", \"extract from email\", \"build a tracker\"\n- User mentions investor updates, donations, company metrics, filings\n- User wants to set up recurring data collection (with cron recipe)\n\n## Phases\n\n### Phase 1: Define Research Recipe\n\nAsk the user what they want to track. Either:\n- Pick a built-in recipe: investor-updates, expense-tracker, company-updates\n- Define a custom recipe with: source queries, classification rules, extraction schema,\n  tracker page path, tracker format\n\nRecipes are YAML files at `~\u002F.gbrain\u002Frecipes\u002F{name}.yaml`. Use `gbrain research init`\nto scaffold a new one.\n\n### Phase 2: Search Sources\n\nBrain first (maybe we already have this data). Then:\n- **Email** via credential gateway: windowed queries (quarterly, monthly if truncated)\n- **Web** via search: public filings, press releases, regulatory data\n- **APIs**: any structured data source the recipe defines\n- **Attachments**: PDF extraction, HTML stripping\n\n### Phase 3: Classify\n\nDeterministic first (regex patterns from recipe), LLM fallback.\nLog every LLM fallback for future regex improvement (fail-improve loop).\nSkip marketing, newsletters, noise based on recipe's classification rules.\n\n### Phase 4: Extract Structured Data\n\n**EXTRACTION INTEGRITY RULE:**\n1. Save raw source immediately (before any extraction)\n2. Extract fields using deterministic regex first, LLM fallback\n3. When summarizing batch results: **re-read from saved files**\n4. Never trust LLM working memory after batch processing\n\nThis prevents a known hallucination bug where batch-processed amounts were\n13\u002F13 wrong from LLM working memory while saved files were correct.\n\n### Phase 5: Archive Raw Sources\n\n- `put_raw_data` for email bodies, API responses\n- `file_upload` for PDF attachments, documents\n- Create `.redirect.yaml` pointers for large files in storage\n- Every tracker entry must link back to its raw source\n\n### Phase 6: Deduplicate\n\nBefore adding to tracker:\n- Exact match (same key fields) → skip\n- Fuzzy match (same entity + date + similar amount within tolerance) → flag for review\n- Different amount for same entity+date → add with note (could be correction)\n\n### Phase 7: Update Canonical Tracker + Backlink\n\n- Parse existing tracker page (markdown table)\n- Append new entries in correct section (grouped by year\u002Fquarter\u002Fentity)\n- Compute running totals\n- Backlink every mentioned entity (person → people\u002F page, company → companies\u002F page)\n- Uses enrichment service for entity pages\n\n## Built-In Recipes\n\nThree example recipes ship with GBrain (see `~\u002F.gbrain\u002Frecipes\u002F`):\n\n1. **investor-updates** — extract MRR, ARR, growth, burn, runway, headcount from investor update emails\n2. **expense-tracker** — extract amounts, recipients, platforms from receipt emails (subscriptions, services, recurring charges)\n3. **company-updates** — extract revenue, users, key metrics from portfolio company update emails\n\n## Anti-Patterns\n\n- Trusting LLM working memory for amounts after batch processing (use extraction integrity rule)\n- Creating tracker entries without raw source links\n- Running without deduplication (leads to double-counted entries)\n- Hardcoding source-specific patterns in the pipeline code (use recipes)\n\n## Output Format\n\nBrain page at the recipe's `tracker_page` path with markdown tables:\n\n```markdown\n### 2026\n\n| Date | Company | MRR | ARR | Growth | Status |\n|------|---------|-----|-----|--------|--------|\n| 2026-04-01 | Example Co | $188K | $2.3M | +14.7% MoM | [Source](link) |\n```\n\nEach entry links to its raw source. Running totals at the bottom of each section.\n\n## Conventions\n\nReferences `skills\u002Fconventions\u002Fquality.md` for citation and back-linking rules.\n",{"name":5,"tools":23,"version":32,"mutating":33,"triggers":34,"description":42},[24,25,26,27,28,29,30,31],"search","query","get_page","put_page","add_link","add_timeline_entry","put_raw_data","file_upload","1.0.0",true,[35,36,37,38,39,40,41],"research","track","extract from email","investor updates","donations","build a tracker","data dig","Structured data research: search sources, extract structured data,\narchive raw sources, maintain canonical tracker pages, deduplicate.\nParameterized via YAML recipes for investor updates, donations,\ncompany updates, or any email-to-structured-data pipeline.\n","main","b8e699fc7cff8641b94a51ac9d4aa599fcc03ae5","server\u002Fskills\u002Fdata-research","https:\u002F\u002Fgithub.com\u002FSigmacodeat\u002FSigmabrain","https:\u002F\u002Fsigmabrain.vercel.app","https:\u002F\u002Fgithub.com\u002FSigmacodeat","2026-07-09 09:21:55",{"source":8,"skillName":5,"commands":51,"prompt":61,"zipAvailable":33},[52,55,58],{"tool":53,"command":54},"npx","npx skills add Sigmacodeat\u002FSigmabrain --skill data-research",{"tool":56,"command":57},"bunx","bunx skills add Sigmacodeat\u002FSigmabrain --skill data-research",{"tool":59,"command":60},"pnpm","pnpm dlx skills add Sigmacodeat\u002FSigmabrain --skill data-research","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FSigmacodeat\u002FSigmabrain\u002Fblob\u002Fmain\u002Fserver\u002Fskills\u002Fdata-research\u002FSKILL.md",[],[64,70,76,83,90,96],{"skillNo":65,"name":66,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":67,"categories":68,"keywords":69,"publishedAt":18},"01M75MW3405DES0348DPKVF20G","query-helper","https:\u002F\u002Fgithub.com\u002FSigmacodeat\u002FSigmabrain\u002Fblob\u002Fmain\u002Fserver\u002Ftest\u002Ffixtures\u002Fskill-catalog\u002Fskills\u002Fquery-helper\u002FSKILL.md",[],[],{"skillNo":71,"name":72,"nameZh":6,"description":6,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":73,"categories":74,"keywords":75,"publishedAt":18},"01M75MW29T3N856QPT2SK467A3","broken","https:\u002F\u002Fgithub.com\u002FSigmacodeat\u002FSigmabrain\u002Fblob\u002Fmain\u002Fserver\u002Ftest\u002Ffixtures\u002Fskill-catalog\u002Fskills\u002Fbroken\u002FSKILL.md",[],[],{"skillNo":77,"name":78,"nameZh":6,"description":79,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":80,"categories":81,"keywords":82,"publishedAt":18},"01M75MVZV51CX9W3Y602M0GJR9","brain-ops","Read, enrich, and write brain pages with source attribution.","https:\u002F\u002Fgithub.com\u002FSigmacodeat\u002FSigmabrain\u002Fblob\u002Fmain\u002Fserver\u002Ftest\u002Ffixtures\u002Fskill-catalog\u002Fskills\u002Fbrain-ops\u002FSKILL.md",[],[],{"skillNo":84,"name":85,"nameZh":6,"description":86,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":87,"categories":88,"keywords":89,"publishedAt":18},"01M75MVXQAQBVNQBZPKPEBPRHV","signal-detector","Always-on ambient signal capture for the OpenClaw reference fixture.","https:\u002F\u002Fgithub.com\u002FSigmacodeat\u002FSigmabrain\u002Fblob\u002Fmain\u002Fserver\u002Ftest\u002Ffixtures\u002Fopenclaw-reference-minimal\u002Fskills\u002Fsignal-detector\u002FSKILL.md",[],[],{"skillNo":91,"name":25,"nameZh":6,"description":92,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":93,"categories":94,"keywords":95,"publishedAt":18},"01M75MVWJN0EV5EFW6JMMC73XC","Look up brain pages in the OpenClaw reference fixture.","https:\u002F\u002Fgithub.com\u002FSigmacodeat\u002FSigmabrain\u002Fblob\u002Fmain\u002Fserver\u002Ftest\u002Ffixtures\u002Fopenclaw-reference-minimal\u002Fskills\u002Fquery\u002FSKILL.md",[],[],{"skillNo":97,"name":98,"nameZh":6,"description":99,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":100,"categories":101,"keywords":102,"publishedAt":18},"01M75MVVA7Q6PMDBTPQGT49M6M","context-now","ALWAYS-ON time-sensitivity discipline for the OpenClaw reference fixture.","https:\u002F\u002Fgithub.com\u002FSigmacodeat\u002FSigmabrain\u002Fblob\u002Fmain\u002Fserver\u002Ftest\u002Ffixtures\u002Fopenclaw-reference-minimal\u002Fskills\u002Fcontext-now\u002FSKILL.md",[],[]]