[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M75FD73MBXJAEJJYDG618XD4":3,"skill-same:01M75FD73MBXJAEJJYDG618XD4":121},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":98,"commitSha":99,"skillDirectory":100,"forksCount":101,"repositoryHtmlUrl":102,"repositoryHomepageUrl":6,"ownerHtmlUrl":103,"ownerBlogUrl":104,"ownerDescription":105,"updatedAt":106,"install":107,"resources":120},"01M75FD73MBXJAEJJYDG618XD4","tech-news-digest",null,"Generate tech news digests with unified source model, quality scoring, and multi-format output. Six-source data collection from RSS feeds, Twitter\u002FX KOLs, GitHub releases, GitHub Trending, Reddit, and web search. Pipeline-based scripts with retry mechanisms and deduplication. Supports Discord, email, and markdown templates.","javimosch\u002Fopen-claw-skills","javimosch","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F12900508?v=4","01M6D3F2AS6PV75ET9PZ1QGP8J","Javier Leandro Arancibia","01M75B8NCTAJG9WH5YNZH7C3D8",0,"MIT","https:\u002F\u002Fgithub.com\u002Fjavimosch\u002Fopen-claw-skills\u002Fblob\u002Fmain\u002Fskills\u002Fdinstein\u002Ftech-news-digest\u002FSKILL.md",[],[],"2026-11-12 13:55:43",false,"---\nname: tech-news-digest\ndescription: Generate tech news digests with unified source model, quality scoring, and multi-format output. Six-source data collection from RSS feeds, Twitter\u002FX KOLs, GitHub releases, GitHub Trending, Reddit, and web search. Pipeline-based scripts with retry mechanisms and deduplication. Supports Discord, email, and markdown templates.\nversion: \"3.15.0\"\nhomepage: https:\u002F\u002Fgithub.com\u002Fdraco-agent\u002Ftech-news-digest\nsource: https:\u002F\u002Fgithub.com\u002Fdraco-agent\u002Ftech-news-digest\nmetadata:\n  openclaw:\n    requires:\n      bins: [\"python3\"]\n    optionalBins: [\"mail\", \"msmtp\", \"gog\", \"gh\", \"openssl\", \"weasyprint\"]\nenv:\n  - name: TWITTER_API_BACKEND\n    required: false\n    description: \"Twitter API backend: 'official', 'twitterapiio', or 'auto' (default: auto)\"\n  - name: X_BEARER_TOKEN\n    required: false\n    description: Twitter\u002FX API bearer token for KOL monitoring (official backend)\n  - name: TWITTERAPI_IO_KEY\n    required: false\n    description: twitterapi.io API key for KOL monitoring (twitterapiio backend)\n  - name: TAVILY_API_KEY\n    required: false\n    description: Tavily Search API key (alternative to Brave)\n  - name: WEB_SEARCH_BACKEND\n    required: false\n    description: \"Web search backend: auto (default), brave, or tavily\"\n  - name: BRAVE_API_KEYS\n    required: false\n    description: Brave Search API keys (comma-separated for rotation)\n  - name: BRAVE_API_KEY\n    required: false\n    description: Brave Search API key (single key fallback)\n  - name: GITHUB_TOKEN\n    required: false\n    description: GitHub token for higher API rate limits (auto-generated from GitHub App if not set)\n  - name: GH_APP_ID\n    required: false\n    description: GitHub App ID for automatic installation token generation\n  - name: GH_APP_INSTALL_ID\n    required: false\n    description: GitHub App Installation ID for automatic token generation\n  - name: GH_APP_KEY_FILE\n    required: false\n    description: Path to GitHub App private key PEM file\ntools:\n  - python3: Required. Runs data collection and merge scripts.\n  - mail: Optional. msmtp-based mail command for email delivery (preferred).\n  - gog: Optional. Gmail CLI for email delivery (fallback if mail not available).\nfiles:\n  read:\n    - config\u002Fdefaults\u002F: Default source and topic configurations\n    - references\u002F: Prompt templates and output templates\n    - scripts\u002F: Python pipeline scripts\n    - \u003Cworkspace>\u002Farchive\u002Ftech-news-digest\u002F: Previous digests for dedup\n  write:\n    - \u002Ftmp\u002Ftd-*.json: Temporary pipeline intermediate outputs\n    - \u002Ftmp\u002Ftd-email.html: Temporary email HTML body\n    - \u002Ftmp\u002Ftd-digest.pdf: Generated PDF digest\n    - \u003Cworkspace>\u002Farchive\u002Ftech-news-digest\u002F: Saved digest archives\n---\n\n# Tech News Digest\n\nAutomated tech news digest system with unified data source model, quality scoring pipeline, and template-based output generation.\n\n## Quick Start\n\n1. **Configuration Setup**: Default configs are in `config\u002Fdefaults\u002F`. Copy to workspace for customization:\n   ```bash\n   mkdir -p workspace\u002Fconfig\n   cp config\u002Fdefaults\u002Fsources.json workspace\u002Fconfig\u002Ftech-news-digest-sources.json\n   cp config\u002Fdefaults\u002Ftopics.json workspace\u002Fconfig\u002Ftech-news-digest-topics.json\n   ```\n\n2. **Environment Variables**: \n   - `TWITTERAPI_IO_KEY` - twitterapi.io API key (optional, preferred)\n   - `X_BEARER_TOKEN` - Twitter\u002FX official API bearer token (optional, fallback)\n   - `TAVILY_API_KEY` - Tavily Search API key, alternative to Brave (optional)\n   - `WEB_SEARCH_BACKEND` - Web search backend: auto|brave|tavily (optional, default: auto)\n   - `BRAVE_API_KEYS` - Brave Search API keys, comma-separated for rotation (optional)\n   - `BRAVE_API_KEY` - Single Brave key fallback (optional)\n   - `GITHUB_TOKEN` - GitHub personal access token (optional, improves rate limits)\n\n3. **Generate Digest**:\n   ```bash\n   # Unified pipeline (recommended) — runs all 6 sources in parallel + merge\n   python3 scripts\u002Frun-pipeline.py \\\n     --defaults config\u002Fdefaults \\\n     --config workspace\u002Fconfig \\\n     --hours 48 --freshness pd \\\n     --archive-dir workspace\u002Farchive\u002Ftech-news-digest\u002F \\\n     --output \u002Ftmp\u002Ftd-merged.json --verbose --force\n   ```\n\n4. **Use Templates**: Apply Discord, email, or PDF templates to merged output\n\n## Configuration Files\n\n### `sources.json` - Unified Data Sources\n```json\n{\n  \"sources\": [\n    {\n      \"id\": \"openai-rss\",\n      \"type\": \"rss\",\n      \"name\": \"OpenAI Blog\",\n      \"url\": \"https:\u002F\u002Fopenai.com\u002Fblog\u002Frss.xml\",\n      \"enabled\": true,\n      \"priority\": true,\n      \"topics\": [\"llm\", \"ai-agent\"],\n      \"note\": \"Official OpenAI updates\"\n    },\n    {\n      \"id\": \"sama-twitter\",\n      \"type\": \"twitter\", \n      \"name\": \"Sam Altman\",\n      \"handle\": \"sama\",\n      \"enabled\": true,\n      \"priority\": true,\n      \"topics\": [\"llm\", \"frontier-tech\"],\n      \"note\": \"OpenAI CEO\"\n    }\n  ]\n}\n```\n\n### `topics.json` - Enhanced Topic Definitions\n```json\n{\n  \"topics\": [\n    {\n      \"id\": \"llm\",\n      \"emoji\": \"🧠\",\n      \"label\": \"LLM \u002F Large Models\",\n      \"description\": \"Large Language Models, foundation models, breakthroughs\",\n      \"search\": {\n        \"queries\": [\"LLM latest news\", \"large language model breakthroughs\"],\n        \"must_include\": [\"LLM\", \"large language model\", \"foundation model\"],\n        \"exclude\": [\"tutorial\", \"beginner guide\"]\n      },\n      \"display\": {\n        \"max_items\": 8,\n        \"style\": \"detailed\"\n      }\n    }\n  ]\n}\n```\n\n## Scripts Pipeline\n\n### `run-pipeline.py` - Unified Pipeline (Recommended)\n```bash\npython3 scripts\u002Frun-pipeline.py \\\n  --defaults config\u002Fdefaults [--config CONFIG_DIR] \\\n  --hours 48 --freshness pd \\\n  --archive-dir workspace\u002Farchive\u002Ftech-news-digest\u002F \\\n  --output \u002Ftmp\u002Ftd-merged.json --verbose --force\n```\n- **Features**: Runs all 6 fetch steps in parallel, then merges + deduplicates + scores\n- **Output**: Final merged JSON ready for report generation (~30s total)\n- **Metadata**: Saves per-step timing and counts to `*.meta.json`\n- **GitHub Auth**: Auto-generates GitHub App token if `$GITHUB_TOKEN` not set\n- **Fallback**: If this fails, run individual scripts below\n\n### Individual Scripts (Fallback)\n\n#### `fetch-rss.py` - RSS Feed Fetcher\n```bash\npython3 scripts\u002Ffetch-rss.py [--defaults DIR] [--config DIR] [--hours 48] [--output FILE] [--verbose]\n```\n- Parallel fetching (10 workers), retry with backoff, feedparser + regex fallback\n- Timeout: 30s per feed, ETag\u002FLast-Modified caching\n\n#### `fetch-twitter.py` - Twitter\u002FX KOL Monitor\n```bash\npython3 scripts\u002Ffetch-twitter.py [--defaults DIR] [--config DIR] [--hours 48] [--output FILE] [--backend auto|official|twitterapiio]\n```\n- Backend auto-detection: uses twitterapi.io if `TWITTERAPI_IO_KEY` set, else official X API v2 if `X_BEARER_TOKEN` set\n- Rate limit handling, engagement metrics, retry with backoff\n\n#### `fetch-web.py` - Web Search Engine\n```bash\npython3 scripts\u002Ffetch-web.py [--defaults DIR] [--config DIR] [--freshness pd] [--output FILE]\n```\n- Auto-detects Brave API rate limit: paid plans → parallel queries, free → sequential\n- Without API: generates search interface for agents\n\n#### `fetch-github.py` - GitHub Releases Monitor\n```bash\npython3 scripts\u002Ffetch-github.py [--defaults DIR] [--config DIR] [--hours 168] [--output FILE]\n```\n- Parallel fetching (10 workers), 30s timeout\n- Auth priority: `$GITHUB_TOKEN` → GitHub App auto-generate → `gh` CLI → unauthenticated (60 req\u002Fhr)\n\n\n#### `fetch-github.py --trending` - GitHub Trending Repos\n```bash\npython3 scripts\u002Ffetch-github.py --trending [--hours 48] [--output FILE] [--verbose]\n```\n- Searches GitHub API for trending repos across 4 topics (LLM, AI Agent, Crypto, Frontier Tech)\n- Quality scoring: base 5 + daily_stars_est \u002F 10, max 15\n\n#### `fetch-reddit.py` - Reddit Posts Fetcher\n```bash\npython3 scripts\u002Ffetch-reddit.py [--defaults DIR] [--config DIR] [--hours 48] [--output FILE]\n```\n- Parallel fetching (4 workers), public JSON API (no auth required)\n- 13 subreddits with score filtering\n\n\n#### `enrich-articles.py` - Article Full-Text Enrichment\n```bash\npython3 scripts\u002Fenrich-articles.py --input merged.json --output enriched.json [--min-score 10] [--max-articles 15] [--verbose]\n```\n- Fetches full article text for high-scoring articles\n- Cloudflare Markdown for Agents (preferred) → HTML extraction (fallback) → Skip (paywalled\u002Fsocial)\n- Blog domain whitelist with lower score threshold (≥3)\n- Parallel fetching (5 workers, 10s timeout)\n\n#### `merge-sources.py` - Quality Scoring & Deduplication\n```bash\npython3 scripts\u002Fmerge-sources.py --rss FILE --twitter FILE --web FILE --github FILE --reddit FILE\n```\n- Quality scoring, title similarity dedup (85%), previous digest penalty\n- Output: topic-grouped articles sorted by score\n\n#### `validate-config.py` - Configuration Validator\n```bash\npython3 scripts\u002Fvalidate-config.py [--defaults DIR] [--config DIR] [--verbose]\n```\n- JSON schema validation, topic reference checks, duplicate ID detection\n\n#### `generate-pdf.py` - PDF Report Generator\n```bash\npython3 scripts\u002Fgenerate-pdf.py --input report.md --output digest.pdf [--verbose]\n```\n- Converts markdown digest to styled A4 PDF with Chinese typography (Noto Sans CJK SC)\n- Emoji icons, page headers\u002Ffooters, blue accent theme. Requires `weasyprint`.\n\n#### `sanitize-html.py` - Safe HTML Email Converter\n```bash\npython3 scripts\u002Fsanitize-html.py --input report.md --output email.html [--verbose]\n```\n- Converts markdown to XSS-safe HTML email with inline CSS\n- URL whitelist (http\u002Fhttps only), HTML-escaped text content\n\n#### `source-health.py` - Source Health Monitor\n```bash\npython3 scripts\u002Fsource-health.py --rss FILE --twitter FILE --github FILE --reddit FILE --web FILE [--verbose]\n```\n- Tracks per-source success\u002Ffailure history over 7 days\n- Reports unhealthy sources (>50% failure rate)\n\n#### `summarize-merged.py` - Merged Data Summary\n```bash\npython3 scripts\u002Fsummarize-merged.py --input merged.json [--top N] [--topic TOPIC]\n```\n- Human-readable summary of merged data for LLM consumption\n- Shows top articles per topic with scores and metrics\n\n## User Customization\n\n### Workspace Configuration Override\nPlace custom configs in `workspace\u002Fconfig\u002F` to override defaults:\n\n- **Sources**: Append new sources, disable defaults with `\"enabled\": false`\n- **Topics**: Override topic definitions, search queries, display settings\n- **Merge Logic**: \n  - Sources with same `id` → user version takes precedence\n  - Sources with new `id` → appended to defaults\n  - Topics with same `id` → user version completely replaces default\n\n### Example Workspace Override\n```json\n\u002F\u002F workspace\u002Fconfig\u002Ftech-news-digest-sources.json\n{\n  \"sources\": [\n    {\n      \"id\": \"simonwillison-rss\",\n      \"enabled\": false,\n      \"note\": \"Disabled: too noisy for my use case\"\n    },\n    {\n      \"id\": \"my-custom-blog\", \n      \"type\": \"rss\",\n      \"name\": \"My Custom Tech Blog\",\n      \"url\": \"https:\u002F\u002Fmyblog.com\u002Frss\",\n      \"enabled\": true,\n      \"priority\": true,\n      \"topics\": [\"frontier-tech\"]\n    }\n  ]\n}\n```\n\n## Templates & Output\n\n### Discord Template (`references\u002Ftemplates\u002Fdiscord.md`)\n- Bullet list format with link suppression (`\u003Clink>`)\n- Mobile-optimized, emoji headers\n- 2000 character limit awareness\n\n### Email Template (`references\u002Ftemplates\u002Femail.md`) \n- Rich metadata, technical stats, archive links\n- Executive summary, top articles section\n- HTML-compatible formatting\n\n### PDF Template (`references\u002Ftemplates\u002Fpdf.md`)\n- A4 layout with Noto Sans CJK SC font for Chinese support\n- Emoji icons, page headers\u002Ffooters with page numbers\n- Generated via `scripts\u002Fgenerate-pdf.py` (requires `weasyprint`)\n\n## Default Sources (151 total)\n\n- **RSS Feeds (62)**: AI labs, tech blogs, crypto news, Chinese tech media\n- **Twitter\u002FX KOLs (48)**: AI researchers, crypto leaders, tech executives\n- **GitHub Repos (28)**: Major open-source projects (LangChain, vLLM, DeepSeek, Llama, etc.)\n- **Reddit (13)**: r\u002FMachineLearning, r\u002FLocalLLaMA, r\u002FCryptoCurrency, r\u002FChatGPT, r\u002FOpenAI, etc.\n- **Web Search (4 topics)**: LLM, AI Agent, Crypto, Frontier Tech\n\nAll sources pre-configured with appropriate topic tags and priority levels.\n\n## Dependencies\n\n```bash\npip install -r requirements.txt\n```\n\n**Optional but Recommended**:\n- `feedparser>=6.0.0` - Better RSS parsing (fallback to regex if unavailable)\n- `jsonschema>=4.0.0` - Configuration validation\n\n**All scripts work with Python 3.8+ standard library only.**\n\n## Monitoring & Operations\n\n### Health Checks\n```bash\n# Validate configuration\npython3 scripts\u002Fvalidate-config.py --verbose\n\n# Test RSS feeds\npython3 scripts\u002Ffetch-rss.py --hours 1 --verbose\n\n# Check Twitter API\npython3 scripts\u002Ffetch-twitter.py --hours 1 --verbose\n```\n\n### Archive Management\n- Digests automatically archived to `\u003Cworkspace>\u002Farchive\u002Ftech-news-digest\u002F`\n- Previous digest titles used for duplicate detection\n- Old archives cleaned automatically (90+ days)\n\n### Error Handling\n- **Network Failures**: Retry with exponential backoff\n- **Rate Limits**: Automatic retry with appropriate delays\n- **Invalid Content**: Graceful degradation, detailed logging\n- **Configuration Errors**: Schema validation with helpful messages\n\n## API Keys & Environment\n\nSet in `~\u002F.zshenv` or similar:\n```bash\n# Twitter (at least one required for Twitter source)\nexport TWITTERAPI_IO_KEY=\"your_key\"        # twitterapi.io key (preferred)\nexport X_BEARER_TOKEN=\"your_bearer_token\"  # Official X API v2 (fallback)\nexport TWITTER_API_BACKEND=\"auto\"          # auto|twitterapiio|official (default: auto)\n\n# Web Search (optional, enables web search layer)\nexport WEB_SEARCH_BACKEND=\"auto\"          # auto|brave|tavily (default: auto)\nexport TAVILY_API_KEY=\"tvly-xxx\"           # Tavily Search API (free 1000\u002Fmo)\n\n# Brave Search (alternative)\nexport BRAVE_API_KEYS=\"key1,key2,key3\"     # Multiple keys, comma-separated rotation\nexport BRAVE_API_KEY=\"key1\"                # Single key fallback\nexport BRAVE_PLAN=\"free\"                   # Override rate limit detection: free|pro\n\n# GitHub (optional, improves rate limits)\nexport GITHUB_TOKEN=\"ghp_xxx\"              # PAT (simplest)\nexport GH_APP_ID=\"12345\"                   # Or use GitHub App for auto-token\nexport GH_APP_INSTALL_ID=\"67890\"\nexport GH_APP_KEY_FILE=\"\u002Fpath\u002Fto\u002Fkey.pem\"\n```\n\n- **Twitter**: `TWITTERAPI_IO_KEY` preferred ($3-5\u002Fmo); `X_BEARER_TOKEN` as fallback; `auto` mode tries twitterapiio first\n- **Web Search**: Tavily (preferred in auto mode) or Brave; optional, fallback to agent web_search if unavailable\n- **GitHub**: Auto-generates token from GitHub App if PAT not set; unauthenticated fallback (60 req\u002Fhr)\n- **Reddit**: No API key needed (uses public JSON API)\n\n## Cron \u002F Scheduled Task Integration\n\n### OpenClaw Cron (Recommended)\n\nThe cron prompt should **NOT** hardcode the pipeline steps. Instead, reference `references\u002Fdigest-prompt.md` and only pass configuration parameters. This ensures the pipeline logic stays in the skill repo and is consistent across all installations.\n\n#### Daily Digest Cron Prompt\n```\nRead \u003CSKILL_DIR>\u002Freferences\u002Fdigest-prompt.md and follow the complete workflow to generate a daily digest.\n\nReplace placeholders with:\n- MODE = daily\n- TIME_WINDOW = past 1-2 days\n- FRESHNESS = pd\n- RSS_HOURS = 48\n- ITEMS_PER_SECTION = 3-5\n- ENRICH = true\n- BLOG_PICKS_COUNT = 3\n- EXTRA_SECTIONS = (none)\n- SUBJECT = Daily Tech Digest - YYYY-MM-DD\n- WORKSPACE = \u003Cyour workspace path>\n- SKILL_DIR = \u003Cyour skill install path>\n- DISCORD_CHANNEL_ID = \u003Cyour channel id>\n- EMAIL = (optional)\n- LANGUAGE = English\n- TEMPLATE = discord\n\nFollow every step in the prompt template strictly. Do not skip any steps.\n```\n\n#### Weekly Digest Cron Prompt\n```\nRead \u003CSKILL_DIR>\u002Freferences\u002Fdigest-prompt.md and follow the complete workflow to generate a weekly digest.\n\nReplace placeholders with:\n- MODE = weekly\n- TIME_WINDOW = past 7 days\n- FRESHNESS = pw\n- RSS_HOURS = 168\n- ITEMS_PER_SECTION = 10-15\n- ENRICH = true\n- BLOG_PICKS_COUNT = 3-5\n- EXTRA_SECTIONS = 📊 Weekly Trend Summary (2-3 sentences summarizing macro trends)\n- SUBJECT = Weekly Tech Digest - YYYY-MM-DD\n- WORKSPACE = \u003Cyour workspace path>\n- SKILL_DIR = \u003Cyour skill install path>\n- DISCORD_CHANNEL_ID = \u003Cyour channel id>\n- EMAIL = (optional)\n- LANGUAGE = English\n- TEMPLATE = discord\n\nFollow every step in the prompt template strictly. Do not skip any steps.\n```\n\n#### Why This Pattern?\n- **Single source of truth**: Pipeline logic lives in `digest-prompt.md`, not scattered across cron configs\n- **Portable**: Same skill on different OpenClaw instances, just change paths and channel IDs\n- **Maintainable**: Update the skill → all cron jobs pick up changes automatically\n- **Anti-pattern**: Do NOT copy pipeline steps into the cron prompt — it will drift out of sync\n\n#### Multi-Channel Delivery Limitation\nOpenClaw enforces **cross-provider isolation**: a single session can only send messages to one provider (e.g., Discord OR Telegram, not both). If you need to deliver digests to multiple platforms, create **separate cron jobs** for each provider:\n\n```\n# Job 1: Discord + Email\n- DISCORD_CHANNEL_ID = \u003Cyour-discord-channel-id>\n- EMAIL = user@example.com\n- TEMPLATE = discord\n\n# Job 2: Telegram DM\n- DISCORD_CHANNEL_ID = (none)\n- EMAIL = (none)\n- TEMPLATE = telegram\n```\nReplace `DISCORD_CHANNEL_ID` delivery with the target platform's delivery in the second job's prompt.\n\nThis is a security feature, not a bug — it prevents accidental cross-context data leakage.\n\n## Security Notes\n\n### Execution Model\nThis skill uses a **prompt template pattern**: the agent reads `digest-prompt.md` and follows its instructions. This is the standard OpenClaw skill execution model — the agent interprets structured instructions from skill-provided files. All instructions are shipped with the skill bundle and can be audited before installation.\n\n### Network Access\nThe Python scripts make outbound requests to:\n- RSS feed URLs (configured in `tech-news-digest-sources.json`)\n- Twitter\u002FX API (`api.x.com` or `api.twitterapi.io`)\n- Brave Search API (`api.search.brave.com`)\n- Tavily Search API (`api.tavily.com`)\n- GitHub API (`api.github.com`)\n- Reddit JSON API (`reddit.com`)\n\nNo data is sent to any other endpoints. All API keys are read from environment variables declared in the skill metadata.\n\n### Shell Safety\nEmail delivery uses `send-email.py` which constructs proper MIME multipart messages with HTML body + optional PDF attachment. Subject formats are hardcoded (`Daily Tech Digest - YYYY-MM-DD`). PDF generation uses `generate-pdf.py` via `weasyprint`. The prompt template explicitly prohibits interpolating untrusted content (article titles, tweet text, etc.) into shell arguments. Email addresses and subjects must be static placeholder values only.\n\n### File Access\nScripts read from `config\u002F` and write to `workspace\u002Farchive\u002F`. No files outside the workspace are accessed.\n\n## Support & Troubleshooting\n\n### Common Issues\n1. **RSS feeds failing**: Check network connectivity, use `--verbose` for details\n2. **Twitter rate limits**: Reduce sources or increase interval\n3. **Configuration errors**: Run `validate-config.py` for specific issues\n4. **No articles found**: Check time window (`--hours`) and source enablement\n\n### Debug Mode\nAll scripts support `--verbose` flag for detailed logging and troubleshooting.\n\n### Performance Tuning\n- **Parallel Workers**: Adjust `MAX_WORKERS` in scripts for your system\n- **Timeout Settings**: Increase `TIMEOUT` for slow networks\n- **Article Limits**: Adjust `MAX_ARTICLES_PER_FEED` based on needs\n## Security Considerations\n\n### Shell Execution\nThe digest prompt instructs agents to run Python scripts via shell commands. All script paths and arguments are skill-defined constants — no user input is interpolated into commands. Two scripts use `subprocess`:\n- `run-pipeline.py` orchestrates child fetch scripts (all within `scripts\u002F` directory)\n- `fetch-github.py` has two subprocess calls:\n  1. `openssl dgst -sha256 -sign` for JWT signing (only if `GH_APP_*` env vars are set — signs a self-constructed JWT payload, no user content involved)\n  2. `gh auth token` CLI fallback (only if `gh` is installed — reads from gh's own credential store)\n\nNo user-supplied or fetched content is ever interpolated into subprocess arguments. Email delivery uses `send-email.py` which builds MIME messages programmatically — no shell interpolation. PDF generation uses `generate-pdf.py` via `weasyprint`. Email subjects are static format strings only — never constructed from fetched data.\n\n### Credential & File Access\nScripts do **not** directly read `~\u002F.config\u002F`, `~\u002F.ssh\u002F`, or any credential files. All API tokens are read from environment variables declared in the skill metadata. The GitHub auth cascade is:\n1. `$GITHUB_TOKEN` env var (you control what to provide)\n2. GitHub App token generation (only if you set `GH_APP_ID`, `GH_APP_INSTALL_ID`, and `GH_APP_KEY_FILE` — uses inline JWT signing via `openssl` CLI, no external scripts involved)\n3. `gh auth token` CLI (delegates to gh's own secure credential store)\n4. Unauthenticated (60 req\u002Fhr, safe fallback)\n\nIf you prefer no automatic credential discovery, simply set `$GITHUB_TOKEN` and the script will use it directly without attempting steps 2-3.\n\n### Dependency Installation\nThis skill does **not** install any packages. `requirements.txt` lists optional dependencies (`feedparser`, `jsonschema`) for reference only. All scripts work with Python 3.8+ standard library. Users should install optional deps in a virtualenv if desired — the skill never runs `pip install`.\n\n### Input Sanitization\n- URL resolution rejects non-HTTP(S) schemes (javascript:, data:, etc.)\n- RSS fallback parsing uses simple, non-backtracking regex patterns (no ReDoS risk)\n- All fetched content is treated as untrusted data for display only\n\n### Network Access\nScripts make outbound HTTP requests to configured RSS feeds, Twitter API, GitHub API, Reddit JSON API, Brave Search API, and Tavily Search API. No inbound connections or listeners are created.\n","# Tech News Digest\n\nAutomated tech news digest system with unified data source model, quality scoring pipeline, and template-based output generation.\n\n## Quick Start\n\n1. **Configuration Setup**: Default configs are in `config\u002Fdefaults\u002F`. Copy to workspace for customization:\n   ```bash\n   mkdir -p workspace\u002Fconfig\n   cp config\u002Fdefaults\u002Fsources.json workspace\u002Fconfig\u002Ftech-news-digest-sources.json\n   cp config\u002Fdefaults\u002Ftopics.json workspace\u002Fconfig\u002Ftech-news-digest-topics.json\n   ```\n\n2. **Environment Variables**: \n   - `TWITTERAPI_IO_KEY` - twitterapi.io API key (optional, preferred)\n   - `X_BEARER_TOKEN` - Twitter\u002FX official API bearer token (optional, fallback)\n   - `TAVILY_API_KEY` - Tavily Search API key, alternative to Brave (optional)\n   - `WEB_SEARCH_BACKEND` - Web search backend: auto|brave|tavily (optional, default: auto)\n   - `BRAVE_API_KEYS` - Brave Search API keys, comma-separated for rotation (optional)\n   - `BRAVE_API_KEY` - Single Brave key fallback (optional)\n   - `GITHUB_TOKEN` - GitHub personal access token (optional, improves rate limits)\n\n3. **Generate Digest**:\n   ```bash\n   # Unified pipeline (recommended) — runs all 6 sources in parallel + merge\n   python3 scripts\u002Frun-pipeline.py \\\n     --defaults config\u002Fdefaults \\\n     --config workspace\u002Fconfig \\\n     --hours 48 --freshness pd \\\n     --archive-dir workspace\u002Farchive\u002Ftech-news-digest\u002F \\\n     --output \u002Ftmp\u002Ftd-merged.json --verbose --force\n   ```\n\n4. **Use Templates**: Apply Discord, email, or PDF templates to merged output\n\n## Configuration Files\n\n### `sources.json` - Unified Data Sources\n```json\n{\n  \"sources\": [\n    {\n      \"id\": \"openai-rss\",\n      \"type\": \"rss\",\n      \"name\": \"OpenAI Blog\",\n      \"url\": \"https:\u002F\u002Fopenai.com\u002Fblog\u002Frss.xml\",\n      \"enabled\": true,\n      \"priority\": true,\n      \"topics\": [\"llm\", \"ai-agent\"],\n      \"note\": \"Official OpenAI updates\"\n    },\n    {\n      \"id\": \"sama-twitter\",\n      \"type\": \"twitter\", \n      \"name\": \"Sam Altman\",\n      \"handle\": \"sama\",\n      \"enabled\": true,\n      \"priority\": true,\n      \"topics\": [\"llm\", \"frontier-tech\"],\n      \"note\": \"OpenAI CEO\"\n    }\n  ]\n}\n```\n\n### `topics.json` - Enhanced Topic Definitions\n```json\n{\n  \"topics\": [\n    {\n      \"id\": \"llm\",\n      \"emoji\": \"🧠\",\n      \"label\": \"LLM \u002F Large Models\",\n      \"description\": \"Large Language Models, foundation models, breakthroughs\",\n      \"search\": {\n        \"queries\": [\"LLM latest news\", \"large language model breakthroughs\"],\n        \"must_include\": [\"LLM\", \"large language model\", \"foundation model\"],\n        \"exclude\": [\"tutorial\", \"beginner guide\"]\n      },\n      \"display\": {\n        \"max_items\": 8,\n        \"style\": \"detailed\"\n      }\n    }\n  ]\n}\n```\n\n## Scripts Pipeline\n\n### `run-pipeline.py` - Unified Pipeline (Recommended)\n```bash\npython3 scripts\u002Frun-pipeline.py \\\n  --defaults config\u002Fdefaults [--config CONFIG_DIR] \\\n  --hours 48 --freshness pd \\\n  --archive-dir workspace\u002Farchive\u002Ftech-news-digest\u002F \\\n  --output \u002Ftmp\u002Ftd-merged.json --verbose --force\n```\n- **Features**: Runs all 6 fetch steps in parallel, then merges + deduplicates + scores\n- **Output**: Final merged JSON ready for report generation (~30s total)\n- **Metadata**: Saves per-step timing and counts to `*.meta.json`\n- **GitHub Auth**: Auto-generates GitHub App token if `$GITHUB_TOKEN` not set\n- **Fallback**: If this fails, run individual scripts below\n\n### Individual Scripts (Fallback)\n\n#### `fetch-rss.py` - RSS Feed Fetcher\n```bash\npython3 scripts\u002Ffetch-rss.py [--defaults DIR] [--config DIR] [--hours 48] [--output FILE] [--verbose]\n```\n- Parallel fetching (10 workers), retry with backoff, feedparser + regex fallback\n- Timeout: 30s per feed, ETag\u002FLast-Modified caching\n\n#### `fetch-twitter.py` - Twitter\u002FX KOL Monitor\n```bash\npython3 scripts\u002Ffetch-twitter.py [--defaults DIR] [--config DIR] [--hours 48] [--output FILE] [--backend auto|official|twitterapiio]\n```\n- Backend auto-detection: uses twitterapi.io if `TWITTERAPI_IO_KEY` set, else official X API v2 if `X_BEARER_TOKEN` set\n- Rate limit handling, engagement metrics, retry with backoff\n\n#### `fetch-web.py` - Web Search Engine\n```bash\npython3 scripts\u002Ffetch-web.py [--defaults DIR] [--config DIR] [--freshness pd] [--output FILE]\n```\n- Auto-detects Brave API rate limit: paid plans → parallel queries, free → sequential\n- Without API: generates search interface for agents\n\n#### `fetch-github.py` - GitHub Releases Monitor\n```bash\npython3 scripts\u002Ffetch-github.py [--defaults DIR] [--config DIR] [--hours 168] [--output FILE]\n```\n- Parallel fetching (10 workers), 30s timeout\n- Auth priority: `$GITHUB_TOKEN` → GitHub App auto-generate → `gh` CLI → unauthenticated (60 req\u002Fhr)\n\n\n#### `fetch-github.py --trending` - GitHub Trending Repos\n```bash\npython3 scripts\u002Ffetch-github.py --trending [--hours 48] [--output FILE] [--verbose]\n```\n- Searches GitHub API for trending repos across 4 topics (LLM, AI Agent, Crypto, Frontier Tech)\n- Quality scoring: base 5 + daily_stars_est \u002F 10, max 15\n\n#### `fetch-reddit.py` - Reddit Posts Fetcher\n```bash\npython3 scripts\u002Ffetch-reddit.py [--defaults DIR] [--config DIR] [--hours 48] [--output FILE]\n```\n- Parallel fetching (4 workers), public JSON API (no auth required)\n- 13 subreddits with score filtering\n\n\n#### `enrich-articles.py` - Article Full-Text Enrichment\n```bash\npython3 scripts\u002Fenrich-articles.py --input merged.json --output enriched.json [--min-score 10] [--max-articles 15] [--verbose]\n```\n- Fetches full article text for high-scoring articles\n- Cloudflare Markdown for Agents (preferred) → HTML extraction (fallback) → Skip (paywalled\u002Fsocial)\n- Blog domain whitelist with lower score threshold (≥3)\n- Parallel fetching (5 workers, 10s timeout)\n\n#### `merge-sources.py` - Quality Scoring & Deduplication\n```bash\npython3 scripts\u002Fmerge-sources.py --rss FILE --twitter FILE --web FILE --github FILE --reddit FILE\n```\n- Quality scoring, title similarity dedup (85%), previous digest penalty\n- Output: topic-grouped articles sorted by score\n\n#### `validate-config.py` - Configuration Validator\n```bash\npython3 scripts\u002Fvalidate-config.py [--defaults DIR] [--config DIR] [--verbose]\n```\n- JSON schema validation, topic reference checks, duplicate ID detection\n\n#### `generate-pdf.py` - PDF Report Generator\n```bash\npython3 scripts\u002Fgenerate-pdf.py --input report.md --output digest.pdf [--verbose]\n```\n- Converts markdown digest to styled A4 PDF with Chinese typography (Noto Sans CJK SC)\n- Emoji icons, page headers\u002Ffooters, blue accent theme. Requires `weasyprint`.\n\n#### `sanitize-html.py` - Safe HTML Email Converter\n```bash\npython3 scripts\u002Fsanitize-html.py --input report.md --output email.html [--verbose]\n```\n- Converts markdown to XSS-safe HTML email with inline CSS\n- URL whitelist (http\u002Fhttps only), HTML-escaped text content\n\n#### `source-health.py` - Source Health Monitor\n```bash\npython3 scripts\u002Fsource-health.py --rss FILE --twitter FILE --github FILE --reddit FILE --web FILE [--verbose]\n```\n- Tracks per-source success\u002Ffailure history over 7 days\n- Reports unhealthy sources (>50% failure rate)\n\n#### `summarize-merged.py` - Merged Data Summary\n```bash\npython3 scripts\u002Fsummarize-merged.py --input merged.json [--top N] [--topic TOPIC]\n```\n- Human-readable summary of merged data for LLM consumption\n- Shows top articles per topic with scores and metrics\n\n## User Customization\n\n### Workspace Configuration Override\nPlace custom configs in `workspace\u002Fconfig\u002F` to override defaults:\n\n- **Sources**: Append new sources, disable defaults with `\"enabled\": false`\n- **Topics**: Override topic definitions, search queries, display settings\n- **Merge Logic**: \n  - Sources with same `id` → user version takes precedence\n  - Sources with new `id` → appended to defaults\n  - Topics with same `id` → user version completely replaces default\n\n### Example Workspace Override\n```json\n\u002F\u002F workspace\u002Fconfig\u002Ftech-news-digest-sources.json\n{\n  \"sources\": [\n    {\n      \"id\": \"simonwillison-rss\",\n      \"enabled\": false,\n      \"note\": \"Disabled: too noisy for my use case\"\n    },\n    {\n      \"id\": \"my-custom-blog\", \n      \"type\": \"rss\",\n      \"name\": \"My Custom Tech Blog\",\n      \"url\": \"https:\u002F\u002Fmyblog.com\u002Frss\",\n      \"enabled\": true,\n      \"priority\": true,\n      \"topics\": [\"frontier-tech\"]\n    }\n  ]\n}\n```\n\n## Templates & Output\n\n### Discord Template (`references\u002Ftemplates\u002Fdiscord.md`)\n- Bullet list format with link suppression (`\u003Clink>`)\n- Mobile-optimized, emoji headers\n- 2000 character limit awareness\n\n### Email Template (`references\u002Ftemplates\u002Femail.md`) \n- Rich metadata, technical stats, archive links\n- Executive summary, top articles section\n- HTML-compatible formatting\n\n### PDF Template (`references\u002Ftemplates\u002Fpdf.md`)\n- A4 layout with Noto Sans CJK SC font for Chinese support\n- Emoji icons, page headers\u002Ffooters with page numbers\n- Generated via `scripts\u002Fgenerate-pdf.py` (requires `weasyprint`)\n\n## Default Sources (151 total)\n\n- **RSS Feeds (62)**: AI labs, tech blogs, crypto news, Chinese tech media\n- **Twitter\u002FX KOLs (48)**: AI researchers, crypto leaders, tech executives\n- **GitHub Repos (28)**: Major open-source projects (LangChain, vLLM, DeepSeek, Llama, etc.)\n- **Reddit (13)**: r\u002FMachineLearning, r\u002FLocalLLaMA, r\u002FCryptoCurrency, r\u002FChatGPT, r\u002FOpenAI, etc.\n- **Web Search (4 topics)**: LLM, AI Agent, Crypto, Frontier Tech\n\nAll sources pre-configured with appropriate topic tags and priority levels.\n\n## Dependencies\n\n```bash\npip install -r requirements.txt\n```\n\n**Optional but Recommended**:\n- `feedparser>=6.0.0` - Better RSS parsing (fallback to regex if unavailable)\n- `jsonschema>=4.0.0` - Configuration validation\n\n**All scripts work with Python 3.8+ standard library only.**\n\n## Monitoring & Operations\n\n### Health Checks\n```bash\n# Validate configuration\npython3 scripts\u002Fvalidate-config.py --verbose\n\n# Test RSS feeds\npython3 scripts\u002Ffetch-rss.py --hours 1 --verbose\n\n# Check Twitter API\npython3 scripts\u002Ffetch-twitter.py --hours 1 --verbose\n```\n\n### Archive Management\n- Digests automatically archived to `\u003Cworkspace>\u002Farchive\u002Ftech-news-digest\u002F`\n- Previous digest titles used for duplicate detection\n- Old archives cleaned automatically (90+ days)\n\n### Error Handling\n- **Network Failures**: Retry with exponential backoff\n- **Rate Limits**: Automatic retry with appropriate delays\n- **Invalid Content**: Graceful degradation, detailed logging\n- **Configuration Errors**: Schema validation with helpful messages\n\n## API Keys & Environment\n\nSet in `~\u002F.zshenv` or similar:\n```bash\n# Twitter (at least one required for Twitter source)\nexport TWITTERAPI_IO_KEY=\"your_key\"        # twitterapi.io key (preferred)\nexport X_BEARER_TOKEN=\"your_bearer_token\"  # Official X API v2 (fallback)\nexport TWITTER_API_BACKEND=\"auto\"          # auto|twitterapiio|official (default: auto)\n\n# Web Search (optional, enables web search layer)\nexport WEB_SEARCH_BACKEND=\"auto\"          # auto|brave|tavily (default: auto)\nexport TAVILY_API_KEY=\"tvly-xxx\"           # Tavily Search API (free 1000\u002Fmo)\n\n# Brave Search (alternative)\nexport BRAVE_API_KEYS=\"key1,key2,key3\"     # Multiple keys, comma-separated rotation\nexport BRAVE_API_KEY=\"key1\"                # Single key fallback\nexport BRAVE_PLAN=\"free\"                   # Override rate limit detection: free|pro\n\n# GitHub (optional, improves rate limits)\nexport GITHUB_TOKEN=\"ghp_xxx\"              # PAT (simplest)\nexport GH_APP_ID=\"12345\"                   # Or use GitHub App for auto-token\nexport GH_APP_INSTALL_ID=\"67890\"\nexport GH_APP_KEY_FILE=\"\u002Fpath\u002Fto\u002Fkey.pem\"\n```\n\n- **Twitter**: `TWITTERAPI_IO_KEY` preferred ($3-5\u002Fmo); `X_BEARER_TOKEN` as fallback; `auto` mode tries twitterapiio first\n- **Web Search**: Tavily (preferred in auto mode) or Brave; optional, fallback to agent web_search if unavailable\n- **GitHub**: Auto-generates token from GitHub App if PAT not set; unauthenticated fallback (60 req\u002Fhr)\n- **Reddit**: No API key needed (uses public JSON API)\n\n## Cron \u002F Scheduled Task Integration\n\n### OpenClaw Cron (Recommended)\n\nThe cron prompt should **NOT** hardcode the pipeline steps. Instead, reference `references\u002Fdigest-prompt.md` and only pass configuration parameters. This ensures the pipeline logic stays in the skill repo and is consistent across all installations.\n\n#### Daily Digest Cron Prompt\n```\nRead \u003CSKILL_DIR>\u002Freferences\u002Fdigest-prompt.md and follow the complete workflow to generate a daily digest.\n\nReplace placeholders with:\n- MODE = daily\n- TIME_WINDOW = past 1-2 days\n- FRESHNESS = pd\n- RSS_HOURS = 48\n- ITEMS_PER_SECTION = 3-5\n- ENRICH = true\n- BLOG_PICKS_COUNT = 3\n- EXTRA_SECTIONS = (none)\n- SUBJECT = Daily Tech Digest - YYYY-MM-DD\n- WORKSPACE = \u003Cyour workspace path>\n- SKILL_DIR = \u003Cyour skill install path>\n- DISCORD_CHANNEL_ID = \u003Cyour channel id>\n- EMAIL = (optional)\n- LANGUAGE = English\n- TEMPLATE = discord\n\nFollow every step in the prompt template strictly. Do not skip any steps.\n```\n\n#### Weekly Digest Cron Prompt\n```\nRead \u003CSKILL_DIR>\u002Freferences\u002Fdigest-prompt.md and follow the complete workflow to generate a weekly digest.\n\nReplace placeholders with:\n- MODE = weekly\n- TIME_WINDOW = past 7 days\n- FRESHNESS = pw\n- RSS_HOURS = 168\n- ITEMS_PER_SECTION = 10-15\n- ENRICH = true\n- BLOG_PICKS_COUNT = 3-5\n- EXTRA_SECTIONS = 📊 Weekly Trend Summary (2-3 sentences summarizing macro trends)\n- SUBJECT = Weekly Tech Digest - YYYY-MM-DD\n- WORKSPACE = \u003Cyour workspace path>\n- SKILL_DIR = \u003Cyour skill install path>\n- DISCORD_CHANNEL_ID = \u003Cyour channel id>\n- EMAIL = (optional)\n- LANGUAGE = English\n- TEMPLATE = discord\n\nFollow every step in the prompt template strictly. Do not skip any steps.\n```\n\n#### Why This Pattern?\n- **Single source of truth**: Pipeline logic lives in `digest-prompt.md`, not scattered across cron configs\n- **Portable**: Same skill on different OpenClaw instances, just change paths and channel IDs\n- **Maintainable**: Update the skill → all cron jobs pick up changes automatically\n- **Anti-pattern**: Do NOT copy pipeline steps into the cron prompt — it will drift out of sync\n\n#### Multi-Channel Delivery Limitation\nOpenClaw enforces **cross-provider isolation**: a single session can only send messages to one provider (e.g., Discord OR Telegram, not both). If you need to deliver digests to multiple platforms, create **separate cron jobs** for each provider:\n\n```\n# Job 1: Discord + Email\n- DISCORD_CHANNEL_ID = \u003Cyour-discord-channel-id>\n- EMAIL = user@example.com\n- TEMPLATE = discord\n\n# Job 2: Telegram DM\n- DISCORD_CHANNEL_ID = (none)\n- EMAIL = (none)\n- TEMPLATE = telegram\n```\nReplace `DISCORD_CHANNEL_ID` delivery with the target platform's delivery in the second job's prompt.\n\nThis is a security feature, not a bug — it prevents accidental cross-context data leakage.\n\n## Security Notes\n\n### Execution Model\nThis skill uses a **prompt template pattern**: the agent reads `digest-prompt.md` and follows its instructions. This is the standard OpenClaw skill execution model — the agent interprets structured instructions from skill-provided files. All instructions are shipped with the skill bundle and can be audited before installation.\n\n### Network Access\nThe Python scripts make outbound requests to:\n- RSS feed URLs (configured in `tech-news-digest-sources.json`)\n- Twitter\u002FX API (`api.x.com` or `api.twitterapi.io`)\n- Brave Search API (`api.search.brave.com`)\n- Tavily Search API (`api.tavily.com`)\n- GitHub API (`api.github.com`)\n- Reddit JSON API (`reddit.com`)\n\nNo data is sent to any other endpoints. All API keys are read from environment variables declared in the skill metadata.\n\n### Shell Safety\nEmail delivery uses `send-email.py` which constructs proper MIME multipart messages with HTML body + optional PDF attachment. Subject formats are hardcoded (`Daily Tech Digest - YYYY-MM-DD`). PDF generation uses `generate-pdf.py` via `weasyprint`. The prompt template explicitly prohibits interpolating untrusted content (article titles, tweet text, etc.) into shell arguments. Email addresses and subjects must be static placeholder values only.\n\n### File Access\nScripts read from `config\u002F` and write to `workspace\u002Farchive\u002F`. No files outside the workspace are accessed.\n\n## Support & Troubleshooting\n\n### Common Issues\n1. **RSS feeds failing**: Check network connectivity, use `--verbose` for details\n2. **Twitter rate limits**: Reduce sources or increase interval\n3. **Configuration errors**: Run `validate-config.py` for specific issues\n4. **No articles found**: Check time window (`--hours`) and source enablement\n\n### Debug Mode\nAll scripts support `--verbose` flag for detailed logging and troubleshooting.\n\n### Performance Tuning\n- **Parallel Workers**: Adjust `MAX_WORKERS` in scripts for your system\n- **Timeout Settings**: Increase `TIMEOUT` for slow networks\n- **Article Limits**: Adjust `MAX_ARTICLES_PER_FEED` based on needs\n## Security Considerations\n\n### Shell Execution\nThe digest prompt instructs agents to run Python scripts via shell commands. All script paths and arguments are skill-defined constants — no user input is interpolated into commands. Two scripts use `subprocess`:\n- `run-pipeline.py` orchestrates child fetch scripts (all within `scripts\u002F` directory)\n- `fetch-github.py` has two subprocess calls:\n  1. `openssl dgst -sha256 -sign` for JWT signing (only if `GH_APP_*` env vars are set — signs a self-constructed JWT payload, no user content involved)\n  2. `gh auth token` CLI fallback (only if `gh` is installed — reads from gh's own credential store)\n\nNo user-supplied or fetched content is ever interpolated into subprocess arguments. Email delivery uses `send-email.py` which builds MIME messages programmatically — no shell interpolation. PDF generation uses `generate-pdf.py` via `weasyprint`. Email subjects are static format strings only — never constructed from fetched data.\n\n### Credential & File Access\nScripts do **not** directly read `~\u002F.config\u002F`, `~\u002F.ssh\u002F`, or any credential files. All API tokens are read from environment variables declared in the skill metadata. The GitHub auth cascade is:\n1. `$GITHUB_TOKEN` env var (you control what to provide)\n2. GitHub App token generation (only if you set `GH_APP_ID`, `GH_APP_INSTALL_ID`, and `GH_APP_KEY_FILE` — uses inline JWT signing via `openssl` CLI, no external scripts involved)\n3. `gh auth token` CLI (delegates to gh's own secure credential store)\n4. Unauthenticated (60 req\u002Fhr, safe fallback)\n\nIf you prefer no automatic credential discovery, simply set `$GITHUB_TOKEN` and the script will use it directly without attempting steps 2-3.\n\n### Dependency Installation\nThis skill does **not** install any packages. `requirements.txt` lists optional dependencies (`feedparser`, `jsonschema`) for reference only. All scripts work with Python 3.8+ standard library. Users should install optional deps in a virtualenv if desired — the skill never runs `pip install`.\n\n### Input Sanitization\n- URL resolution rejects non-HTTP(S) schemes (javascript:, data:, etc.)\n- RSS fallback parsing uses simple, non-backtracking regex patterns (no ReDoS risk)\n- All fetched content is treated as untrusted data for display only\n\n### Network Access\nScripts make outbound HTTP requests to configured RSS feeds, Twitter API, GitHub API, Reddit JSON API, Brave Search API, and Tavily Search API. No inbound connections or listeners are created.\n",{"env":24,"name":5,"files":58,"tools":77,"source":84,"version":85,"homepage":84,"metadata":86,"description":7},[25,28,31,34,37,40,43,46,49,52,55],{"name":26,"required":20,"description":27},"TWITTER_API_BACKEND","Twitter API backend: 'official', 'twitterapiio', or 'auto' (default: auto)",{"name":29,"required":20,"description":30},"X_BEARER_TOKEN","Twitter\u002FX API bearer token for KOL monitoring (official backend)",{"name":32,"required":20,"description":33},"TWITTERAPI_IO_KEY","twitterapi.io API key for KOL monitoring (twitterapiio backend)",{"name":35,"required":20,"description":36},"TAVILY_API_KEY","Tavily Search API key (alternative to Brave)",{"name":38,"required":20,"description":39},"WEB_SEARCH_BACKEND","Web search backend: auto (default), brave, or tavily",{"name":41,"required":20,"description":42},"BRAVE_API_KEYS","Brave Search API keys (comma-separated for rotation)",{"name":44,"required":20,"description":45},"BRAVE_API_KEY","Brave Search API key (single key fallback)",{"name":47,"required":20,"description":48},"GITHUB_TOKEN","GitHub token for higher API rate limits (auto-generated from GitHub App if not set)",{"name":50,"required":20,"description":51},"GH_APP_ID","GitHub App ID for automatic installation token generation",{"name":53,"required":20,"description":54},"GH_APP_INSTALL_ID","GitHub App Installation ID for automatic token generation",{"name":56,"required":20,"description":57},"GH_APP_KEY_FILE","Path to GitHub App private key PEM file",{"read":59,"write":68},[60,62,64,66],{"config\u002Fdefaults\u002F":61},"Default source and topic configurations",{"references\u002F":63},"Prompt templates and output templates",{"scripts\u002F":65},"Python pipeline scripts",{"\u003Cworkspace>\u002Farchive\u002Ftech-news-digest\u002F":67},"Previous digests for dedup",[69,71,73,75],{"\u002Ftmp\u002Ftd-*.json":70},"Temporary pipeline intermediate outputs",{"\u002Ftmp\u002Ftd-email.html":72},"Temporary email HTML body",{"\u002Ftmp\u002Ftd-digest.pdf":74},"Generated PDF digest",{"\u003Cworkspace>\u002Farchive\u002Ftech-news-digest\u002F":76},"Saved digest archives",[78,80,82],{"python3":79},"Required. Runs data collection and merge scripts.",{"mail":81},"Optional. msmtp-based mail command for email delivery (preferred).",{"gog":83},"Optional. Gmail CLI for email delivery (fallback if mail not available).","https:\u002F\u002Fgithub.com\u002Fdraco-agent\u002Ftech-news-digest","3.15.0",{"openclaw":87},{"requires":88,"optionalBins":91},{"bins":89},[90],"python3",[92,93,94,95,96,97],"mail","msmtp","gog","gh","openssl","weasyprint","main","f9d3fe7cf9ac8f1ea63a0d96e98e1f510a3814db","skills\u002Fdinstein\u002Ftech-news-digest",1,"https:\u002F\u002Fgithub.com\u002Fjavimosch\u002Fopen-claw-skills","https:\u002F\u002Fgithub.com\u002Fjavimosch","intrane.fr","Building robust, open-source infrastructure for the commons. AI-leveraged, self-hosted, built to last.","2026-06-07 03:34:58",{"source":8,"skillName":5,"commands":108,"prompt":118,"zipAvailable":119},[109,112,115],{"tool":110,"command":111},"npx","npx skills add javimosch\u002Fopen-claw-skills --skill tech-news-digest",{"tool":113,"command":114},"bunx","bunx skills add javimosch\u002Fopen-claw-skills --skill tech-news-digest",{"tool":116,"command":117},"pnpm","pnpm dlx skills add javimosch\u002Fopen-claw-skills --skill tech-news-digest","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fjavimosch\u002Fopen-claw-skills\u002Fblob\u002Fmain\u002Fskills\u002Fdinstein\u002Ftech-news-digest\u002FSKILL.md",true,[],[122,130,137,144,151,158],{"skillNo":123,"name":124,"nameZh":6,"description":125,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":126,"categories":127,"keywords":128,"publishedAt":129},"01M778GGXG2VQ0YF31W2MKGMQZ","crowd-prompting","A marketplace where AI agents improve prompts, system instructions, tool descriptions, and other text-based content with domain expertise from real-world operations — and earn tokens for valuable contributions.","https:\u002F\u002Fgithub.com\u002Fjavimosch\u002Fopen-claw-skills\u002Fblob\u002Fmain\u002Fskills\u002Fzzadrian\u002Fcrowd-prompting\u002FSKILL.md",[],[],"2026-11-15 14:19:17",{"skillNo":131,"name":132,"nameZh":6,"description":133,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":134,"categories":135,"keywords":136,"publishedAt":129},"01M778G7BH8SBJ9FJ6C3G7CB1K","ceaser","Interact with the Ceaser privacy protocol on Base L2 using the ceaser-mcp MCP tools. This skill uses the ceaser-mcp npm package for ALL operations -- shield, unshield, note management, and protocol queries. All ceaser tool calls use CLI subcommands (npx -y ceaser-mcp \u003Csubcommand>). Ceaser is a privacy-preserving ETH wrapper using Noir\u002FUltraHonk zero-knowledge proofs on Base L2 (chain ID 8453).","https:\u002F\u002Fgithub.com\u002Fjavimosch\u002Fopen-claw-skills\u002Fblob\u002Fmain\u002Fskills\u002Fzyra-v21\u002Fceaser\u002FSKILL.md",[],[],{"skillNo":138,"name":139,"nameZh":6,"description":140,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":141,"categories":142,"keywords":143,"publishedAt":129},"01M778FYCJQZWFKKX5FYMK3S47","ceaser-send","Fully automated private ETH transfer via Ceaser Protocol on Base L2 using the ceaser-mcp MCP tools. This skill uses the ceaser-mcp npm package for ALL operations -- all ceaser tool calls use CLI subcommands (npx -y ceaser-mcp \u003Csubcommand>). WARNING -- creates observable on-chain links between user wallet and hot wallet (see Privacy Warning). Generates an ephemeral hot wallet with BIP-39 mnemonic recovery, user funds it, agent signs and broadcasts the Shield TX automatically. Exactly one manual step required (funding the hot wallet with ETH). Uses Noir\u002FUltraHonk zero-knowledge proofs.","https:\u002F\u002Fgithub.com\u002Fjavimosch\u002Fopen-claw-skills\u002Fblob\u002Fmain\u002Fskills\u002Fzyra-v21\u002Fceaser-send\u002FSKILL.md",[],[],{"skillNo":145,"name":146,"nameZh":6,"description":147,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":148,"categories":149,"keywords":150,"publishedAt":129},"01M778FQQNSEYA3HJKZBPQ4M9Z","dilemm-ai","Compete in DilemmAI, the prisoner's dilemma AI arena at dilemm.ai. Use when an OpenClaw agent wants to create an account, design and submit strategy prompts for their bot, enter matchmaking, analyze historical matches and leaderboards, and iterate on bot strategy. Requires headless browser automation (no API available yet).","https:\u002F\u002Fgithub.com\u002Fjavimosch\u002Fopen-claw-skills\u002Fblob\u002Fmain\u002Fskills\u002Fzyori\u002Fdilemm-ai\u002FSKILL.md",[],[],{"skillNo":152,"name":153,"nameZh":6,"description":154,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":155,"categories":156,"keywords":157,"publishedAt":129},"01M778FGVZX7QA2TF9BFMM37FY","moldium","Post and manage content on the Moldium blog platform. Triggered by \"post to Moldium\", \"write a blog post\", \"publish an article\", etc.","https:\u002F\u002Fgithub.com\u002Fjavimosch\u002Fopen-claw-skills\u002Fblob\u002Fmain\u002Fskills\u002Fzyom45\u002Fmoldium\u002FSKILL.md",[],[],{"skillNo":159,"name":160,"nameZh":6,"description":161,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":162,"categories":163,"keywords":164,"publishedAt":129},"01M778F88D8PQ9MQ0KNW2TJ8ZH","arxiv-paper-reviews","Interact with arXiv Crawler API to fetch papers, read reviews, submit comments, search papers, and import papers. Use when working with arXiv papers, fetching paper lists by date\u002Fcategory\u002Finterest, viewing paper details with comments, submitting paper reviews, searching papers by title, or importing papers from arXiv URLs via API at http:\u002F\u002Fweakaccept.top:8000\u002F.","https:\u002F\u002Fgithub.com\u002Fjavimosch\u002Fopen-claw-skills\u002Fblob\u002Fmain\u002Fskills\u002Fzxrys\u002Farxiv-paper-reviews\u002FSKILL.md",[],[]]