tabstack-extractor
Extract structured data from websites using Tabstack API. Use when you need to scrape job listings, news articles, product pages, or any structured web content. Provides JSON schema-based extraction and clean markdown conversion. Requires TABSTACK_API_KEY environment variable.
- License 许可
- MIT
- 最近更新
- 2026-06-07
- Stars
- ★ 0
- Forks
- 1
01 前言 Front Matter
- name
- tabstack-extractor
- description
- Extract structured data from websites using Tabstack API. Use when you need to scrape job listings, news articles, product pages, or any structured web content. Provides JSON schema-based extraction and clean markdown conversion. Requires TABSTACK_API_KEY environment variable.
03 SKILL.md 正文
Tabstack Extractor
Overview
This skill enables structured data extraction from websites using the Tabstack API. It's ideal for web scraping tasks where you need consistent, schema-based data extraction from job boards, news sites, product pages, or any structured content.
Quick Start
1. Install Babashka (if needed)
# Option A: From GitHub (recommended for sharing)
curl -s https://raw.githubusercontent.com/babashka/babashka/master/install | bash
# Option B: From Nix
nix-shell -p babashka
# Option C: From Homebrew
brew install borkdude/brew/babashka
2. Set up API Key
Option A: Environment variable (recommended)
export TABSTACK_API_KEY="your_api_key_here"
Option B: Configuration file
mkdir -p ~/.config/tabstack
echo '{:api-key "your_api_key_here"}' > ~/.config/tabstack/config.edn
Get an API key: Sign up at Tabstack Console
3. Test Connection
bb scripts/tabstack.clj test
4. Extract Markdown (Simple)
bb scripts/tabstack.clj markdown "https://example.com"
5. Extract JSON (Start Simple)
# Start with simple schema (fast, reliable)
bb scripts/tabstack.clj json "https://example.com" references/simple_article.json
# Try more complex schemas (may be slower)
bb scripts/tabstack.clj json "https://news.site" references/news_schema.json
6. Advanced Features
# Extract with retry logic (3 retries, 1s delay)
bb scripts/tabstack.clj json-retry "https://example.com" references/simple_article.json
# Extract with caching (24-hour cache)
bb scripts/tabstack.clj json-cache "https://example.com" references/simple_article.json
# Batch extract from URLs file
echo "https://example.com" > urls.txt
echo "https://example.org" >> urls.txt
bb scripts/tabstack.clj batch urls.txt references/simple_article.json
Core Capabilities
1. Markdown Extraction
Extract clean, readable markdown from any webpage. Useful for content analysis, summarization, or archiving.
When to use: When you need the textual content of a page without the HTML clutter.
Example use cases:
- Extract article content for summarization
- Archive webpage content
- Analyze blog post content
2. JSON Schema Extraction
Extract structured data using JSON schemas. Define exactly what data you want and get it in a consistent format.
When to use: When scraping job listings, product pages, news articles, or any structured data.
Example use cases:
- Scrape job listings from BuiltIn/LinkedIn
- Extract product details from e-commerce sites
- Gather news articles with consistent metadata
3. Schema Templates
Pre-built schemas for common scraping tasks. See references/ directory for templates.
Available schemas:
- Job listing schema (see
references/job_schema.json) - News article schema
- Product page schema
- Contact information schema
Workflow: Job Scraping Example
Follow this workflow to scrape job listings:
- Identify target sites - BuiltIn, LinkedIn, company career pages
- Choose or create schema - Use
references/job_schema.jsonor customize - Test extraction - Run a single page to verify schema works
- Scale up - Process multiple URLs
- Store results - Save to database or file
Example job schema:
{
"type": "object",
"properties": {
"title": {"type": "string"},
"company": {"type": "string"},
"location": {"type": "string"},
"description": {"type": "string"},
"salary": {"type": "string"},
"apply_url": {"type": "string"},
"posted_date": {"type": "string"},
"requirements": {"type": "array", "items": {"type": "string"}}
}
}
Integration with Other Skills
Combine with Web Search
- Use
web_searchto find relevant URLs - Use Tabstack to extract structured data from those URLs
- Store results in Datalevin (future skill)
Combine with Browser Automation
- Use
browsertool to navigate complex sites - Extract page URLs
- Use Tabstack for structured extraction
Error Handling
Common issues and solutions:
- Authentication failed - Check
TABSTACK_API_KEYenvironment variable - Invalid URL - Ensure URL is accessible and correct
- Schema mismatch - Adjust schema to match page structure
- Rate limiting - Add delays between requests
Resources
scripts/
tabstack.clj- Main API wrapper in Babashka (recommended, has retry logic, caching, batch processing)tabstack_curl.sh- Bash/curl fallback (simple, no dependencies)tabstack_api.py- Python API wrapper (requires requests module)
references/
job_schema.json- Template schema for job listingsapi_reference.md- Tabstack API documentation
Best Practices
- Start small - Test with single pages before scaling
- Respect robots.txt - Check site scraping policies
- Add delays - Avoid overwhelming target sites
- Validate schemas - Test schemas on sample pages
- Handle errors gracefully - Implement retry logic for failed requests
Teaching Focus: How to Create Schemas
This skill is designed to teach agents how to use Tabstack API effectively. The key is learning to create appropriate JSON schemas for different websites.
Learning Path
- Start Simple - Use
references/simple_article.json(4 basic fields) - Test Extensively - Try schemas on multiple page types
- Iterate - Add fields based on what the page actually contains
- Optimize - Remove unnecessary fields for speed
See Schema Creation Guide for detailed instructions and examples.
Common Mistakes to Avoid
- Over-complex schemas - Start with 2-3 fields, not 20
- Missing fields - Don't require fields that don't exist on the page
- No testing - Always test with example.com first, then target sites
- Ignoring timeouts - Complex schemas take longer (45s timeout)
Babashka Advantages
Using Babashka for this skill provides:
- Single binary - Easy to share/install (GitHub releases, brew, nix)
- Fast startup - No JVM warmup, ~50ms startup time
- Built-in HTTP client - No external dependencies
- Clojure syntax - Familiar to you (Wes), expressive
- Retry logic & caching - Built into the skill
- Batch processing - Parallel extraction for multiple URLs
Example User Requests
For this skill to trigger:
- "Scrape job listings from Docker careers page"
- "Extract the main content from this article"
- "Get structured product data from this e-commerce page"
- "Pull all the news articles from this site"
- "Extract contact information from this company page"
- "Batch extract job listings from these 20 URLs"
- "Get cached results for this page (avoid API calls)"
04 同仓库更多 Skills
crowd-prompting
A marketplace where AI agents improve prompts, system instructions, tool descriptions, and other text-based content with domain expertise from real-world operations — and earn tokens for valuable contributions.
ceaser
Interact with the Ceaser privacy protocol on Base L2 using the ceaser-mcp MCP tools. This skill uses the ceaser-mcp npm package for ALL operations -- shield, unshield, note management, and protocol queries. All ceaser tool calls use CLI subcommands (npx -y ceaser-mcp <subcommand>). Ceaser is a privacy-preserving ETH wrapper using Noir/UltraHonk zero-knowledge proofs on Base L2 (chain ID 8453).
ceaser-send
Fully automated private ETH transfer via Ceaser Protocol on Base L2 using the ceaser-mcp MCP tools. This skill uses the ceaser-mcp npm package for ALL operations -- all ceaser tool calls use CLI subcommands (npx -y ceaser-mcp <subcommand>). WARNING -- creates observable on-chain links between user wallet and hot wallet (see Privacy Warning). Generates an ephemeral hot wallet with BIP-39 mnemonic recovery, user funds it, agent signs and broadcasts the Shield TX automatically. Exactly one manual step required (funding the hot wallet with ETH). Uses Noir/UltraHonk zero-knowledge proofs.
dilemm-ai
Compete in DilemmAI, the prisoner's dilemma AI arena at dilemm.ai. Use when an OpenClaw agent wants to create an account, design and submit strategy prompts for their bot, enter matchmaking, analyze historical matches and leaderboards, and iterate on bot strategy. Requires headless browser automation (no API available yet).
moldium
Post and manage content on the Moldium blog platform. Triggered by "post to Moldium", "write a blog post", "publish an article", etc.
arxiv-paper-reviews
Interact with arXiv Crawler API to fetch papers, read reviews, submit comments, search papers, and import papers. Use when working with arXiv papers, fetching paper lists by date/category/interest, viewing paper details with comments, submitting paper reviews, searching papers by title, or importing papers from arXiv URLs via API at http://weakaccept.top:8000/.