[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M6FVMCBJ6S1MVBQN67F7T4YY":3,"skill-same:01M6FVMCBJ6S1MVBQN67F7T4YY":74},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":15,"categories":16,"keywords":17,"publishedAt":38,"linkOnly":39,"markdownContent":40,"markdownBody":41,"frontMatter":42,"refName":43,"commitSha":44,"skillDirectory":45,"forksCount":46,"repositoryHtmlUrl":47,"repositoryHomepageUrl":6,"ownerHtmlUrl":48,"ownerBlogUrl":6,"ownerDescription":6,"updatedAt":49,"install":50,"resources":63},"01M6FVMCBJ6S1MVBQN67F7T4YY","firecrawl-cli",null,"Firecrawl CLI for web scraping, crawling, and search. Scrape single pages or entire websites, map site URLs, and search the web with full content extraction. Returns clean markdown optimized for LLM context. Use for research, documentation extraction, competitive intelligence, and content monitoring.","kbarbel640-del\u002Fskills","kbarbel640-del","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F255315490?v=4","01M6CJPPQGCCESXMG3K7BBGQ5J","01M6CJPPX2PB2BCZERFVM2C2B3",1,"MIT","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fleonardogrig\u002Ffirecrawl-skills\u002FSKILL.md",[],[18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37],"firecrawl cli","firecrawl","cli","web scraping","with","competitive","pages","map","intelligence","clean","use","scraping","site","markdown","scrape","monitoring","search","documentation","web","research","2026-11-10 10:12:30",false,"---\nname: firecrawl-cli\ndescription: |\n  Firecrawl CLI for web scraping, crawling, and search. Scrape single pages or entire websites, map site URLs, and search the web with full content extraction. Returns clean markdown optimized for LLM context. Use for research, documentation extraction, competitive intelligence, and content monitoring.\n---\n\n# Firecrawl CLI\n\nUse the `firecrawl` CLI to fetch and search the web. Firecrawl returns clean markdown optimized for LLM context windows, handles JavaScript rendering, bypasses common blocks, and provides structured data.\n\n## Installation\n\nCheck status, auth, and rate limits:\n\n```bash\nfirecrawl --status\n```\n\nOutput when ready:\n\n```\n  ? firecrawl cli v1.0.2\n\n  ● Authenticated via FIRECRAWL_API_KEY\n  Concurrency: 0\u002F100 jobs (parallel scrape limit)\n  Credits: 500,000 remaining\n```\n\n- **Concurrency**: Max parallel jobs. Run parallel operations close to this limit but not above.\n- **Credits**: Remaining API credits. Each scrape\u002Fcrawl consumes credits.\n\nIf not installed: `npm install -g firecrawl-cli`\n\nAlways refer to the installation rules in [rules\u002Finstall.md](rules\u002Finstall.md) for more information if the user is not logged in.\n\n## Authentication\n\nIf not authenticated, run:\n\n```bash\nfirecrawl login --browser\n```\n\nThe `--browser` flag automatically opens the browser for authentication without prompting.\n\n## Organization\n\nCreate a `.firecrawl\u002F` folder in the working directory unless it already exists to store results. Add `.firecrawl\u002F` to the `.gitignore` file if not already there. Always use `-o` to write directly to file (avoids flooding context):\n\n```bash\n# Search the web (most common operation)\nfirecrawl search \"your query\" -o .firecrawl\u002Fsearch-{query}.json\n\n# Search with scraping enabled\nfirecrawl search \"your query\" --scrape -o .firecrawl\u002Fsearch-{query}-scraped.json\n\n# Scrape a page\nfirecrawl scrape https:\u002F\u002Fexample.com -o .firecrawl\u002F{site}-{path}.md\n```\n\nExamples:\n\n```\n.firecrawl\u002Fsearch-react_server_components.json\n.firecrawl\u002Fsearch-ai_news-scraped.json\n.firecrawl\u002Fdocs.github.com-actions-overview.md\n.firecrawl\u002Ffirecrawl.dev.md\n```\n\n## Commands\n\n### Search - Web search with optional scraping\n\n```bash\n# Basic search (human-readable output)\nfirecrawl search \"your query\" -o .firecrawl\u002Fsearch-query.txt\n\n# JSON output (recommended for parsing)\nfirecrawl search \"your query\" -o .firecrawl\u002Fsearch-query.json --json\n\n# Limit results\nfirecrawl search \"AI news\" --limit 10 -o .firecrawl\u002Fsearch-ai-news.json --json\n\n# Search specific sources\nfirecrawl search \"tech startups\" --sources news -o .firecrawl\u002Fsearch-news.json --json\nfirecrawl search \"landscapes\" --sources images -o .firecrawl\u002Fsearch-images.json --json\nfirecrawl search \"machine learning\" --sources web,news,images -o .firecrawl\u002Fsearch-ml.json --json\n\n# Filter by category (GitHub repos, research papers, PDFs)\nfirecrawl search \"web scraping python\" --categories github -o .firecrawl\u002Fsearch-github.json --json\nfirecrawl search \"transformer architecture\" --categories research -o .firecrawl\u002Fsearch-research.json --json\n\n# Time-based search\nfirecrawl search \"AI announcements\" --tbs qdr:d -o .firecrawl\u002Fsearch-today.json --json  # Past day\nfirecrawl search \"tech news\" --tbs qdr:w -o .firecrawl\u002Fsearch-week.json --json          # Past week\n\n# Location-based search\nfirecrawl search \"restaurants\" --location \"San Francisco,California,United States\" -o .firecrawl\u002Fsearch-sf.json --json\nfirecrawl search \"local news\" --country DE -o .firecrawl\u002Fsearch-germany.json --json\n\n# Search AND scrape content from results\nfirecrawl search \"firecrawl tutorials\" --scrape -o .firecrawl\u002Fsearch-scraped.json --json\nfirecrawl search \"API docs\" --scrape --scrape-formats markdown,links -o .firecrawl\u002Fsearch-docs.json --json\n```\n\n**Search Options:**\n\n| Option | Description |\n|--------|-------------|\n| `--limit \u003Cn>` | Maximum results (default: 5, max: 100) |\n| `--sources \u003Csources>` | Comma-separated: web, images, news (default: web) |\n| `--categories \u003Ccategories>` | Comma-separated: github, research, pdf |\n| `--tbs \u003Cvalue>` | Time filter: qdr:h (hour), qdr:d (day), qdr:w (week), qdr:m (month), qdr:y (year) |\n| `--location \u003Clocation>` | Geo-targeting (e.g., \"Germany\") |\n| `--country \u003Ccode>` | ISO country code (default: US) |\n| `--scrape` | Enable scraping of search results |\n| `--scrape-formats \u003Cformats>` | Scrape formats when --scrape enabled (default: markdown) |\n| `-o, --output \u003Cpath>` | Save to file |\n\n### Scrape - Single page content extraction\n\n```bash\n# Basic scrape (markdown output)\nfirecrawl scrape https:\u002F\u002Fexample.com -o .firecrawl\u002Fexample.md\n\n# Get raw HTML\nfirecrawl scrape https:\u002F\u002Fexample.com --html -o .firecrawl\u002Fexample.html\n\n# Multiple formats (JSON output)\nfirecrawl scrape https:\u002F\u002Fexample.com --format markdown,links -o .firecrawl\u002Fexample.json\n\n# Main content only (removes nav, footer, ads)\nfirecrawl scrape https:\u002F\u002Fexample.com --only-main-content -o .firecrawl\u002Fexample.md\n\n# Wait for JS to render\nfirecrawl scrape https:\u002F\u002Fspa-app.com --wait-for 3000 -o .firecrawl\u002Fspa.md\n\n# Extract links only\nfirecrawl scrape https:\u002F\u002Fexample.com --format links -o .firecrawl\u002Flinks.json\n\n# Include\u002Fexclude specific HTML tags\nfirecrawl scrape https:\u002F\u002Fexample.com --include-tags article,main -o .firecrawl\u002Farticle.md\nfirecrawl scrape https:\u002F\u002Fexample.com --exclude-tags nav,aside,.ad -o .firecrawl\u002Fclean.md\n```\n\n**Scrape Options:**\n\n| Option | Description |\n|--------|-------------|\n| `-f, --format \u003Cformats>` | Output format(s): markdown, html, rawHtml, links, screenshot, json |\n| `-H, --html` | Shortcut for `--format html` |\n| `--only-main-content` | Extract main content only |\n| `--wait-for \u003Cms>` | Wait before scraping (for JS content) |\n| `--include-tags \u003Ctags>` | Only include specific HTML tags |\n| `--exclude-tags \u003Ctags>` | Exclude specific HTML tags |\n| `-o, --output \u003Cpath>` | Save to file |\n\n### Crawl - Crawl an entire website\n\n```bash\n# Start a crawl (returns job ID)\nfirecrawl crawl https:\u002F\u002Fexample.com\n\n# Wait for crawl to complete\nfirecrawl crawl https:\u002F\u002Fexample.com --wait\n\n# With progress indicator\nfirecrawl crawl https:\u002F\u002Fexample.com --wait --progress\n\n# Check crawl status\nfirecrawl crawl \u003Cjob-id>\n\n# Limit pages\nfirecrawl crawl https:\u002F\u002Fexample.com --limit 100 --max-depth 3\n\n# Crawl blog section only\nfirecrawl crawl https:\u002F\u002Fexample.com --include-paths \u002Fblog,\u002Fposts\n\n# Exclude admin pages\nfirecrawl crawl https:\u002F\u002Fexample.com --exclude-paths \u002Fadmin,\u002Flogin\n\n# Crawl with rate limiting\nfirecrawl crawl https:\u002F\u002Fexample.com --delay 1000 --max-concurrency 2\n\n# Save results\nfirecrawl crawl https:\u002F\u002Fexample.com --wait -o crawl-results.json --pretty\n```\n\n**Crawl Options:**\n\n| Option | Description |\n|--------|-------------|\n| `--wait` | Wait for crawl to complete |\n| `--progress` | Show progress while waiting |\n| `--limit \u003Cn>` | Maximum pages to crawl |\n| `--max-depth \u003Cn>` | Maximum crawl depth |\n| `--include-paths \u003Cpaths>` | Only crawl matching paths |\n| `--exclude-paths \u003Cpaths>` | Skip matching paths |\n| `--delay \u003Cms>` | Delay between requests |\n| `--max-concurrency \u003Cn>` | Max concurrent requests |\n\n### Map - Discover all URLs on a site\n\n```bash\n# List all URLs (one per line)\nfirecrawl map https:\u002F\u002Fexample.com -o .firecrawl\u002Furls.txt\n\n# Output as JSON\nfirecrawl map https:\u002F\u002Fexample.com --json -o .firecrawl\u002Furls.json\n\n# Search for specific URLs\nfirecrawl map https:\u002F\u002Fexample.com --search \"blog\" -o .firecrawl\u002Fblog-urls.txt\n\n# Limit results\nfirecrawl map https:\u002F\u002Fexample.com --limit 500 -o .firecrawl\u002Furls.txt\n\n# Include subdomains\nfirecrawl map https:\u002F\u002Fexample.com --include-subdomains -o .firecrawl\u002Fall-urls.txt\n```\n\n**Map Options:**\n\n| Option | Description |\n|--------|-------------|\n| `--limit \u003Cn>` | Maximum URLs to discover |\n| `--search \u003Cquery>` | Filter URLs by search query |\n| `--sitemap \u003Cmode>` | include, skip, or only |\n| `--include-subdomains` | Include subdomains |\n| `--json` | Output as JSON |\n| `-o, --output \u003Cpath>` | Save to file |\n\n### Credit Usage\n\n```bash\n# Show credit usage\nfirecrawl credit-usage\n\n# Output as JSON\nfirecrawl credit-usage --json --pretty\n```\n\n## Reading Scraped Files\n\nNEVER read entire firecrawl output files at once unless explicitly asked - they can be 1000+ lines. Instead, use grep, head, or incremental reads:\n\n```bash\n# Check file size and preview structure\nwc -l .firecrawl\u002Ffile.md && head -50 .firecrawl\u002Ffile.md\n\n# Use grep to find specific content\ngrep -n \"keyword\" .firecrawl\u002Ffile.md\ngrep -A 10 \"## Section\" .firecrawl\u002Ffile.md\n```\n\n## Parallelization\n\nRun multiple scrapes in parallel using `&` and `wait`:\n\n```bash\n# Parallel scraping (fast)\nfirecrawl scrape https:\u002F\u002Fsite1.com -o .firecrawl\u002F1.md &\nfirecrawl scrape https:\u002F\u002Fsite2.com -o .firecrawl\u002F2.md &\nfirecrawl scrape https:\u002F\u002Fsite3.com -o .firecrawl\u002F3.md &\nwait\n```\n\nFor many URLs, use xargs with `-P` for parallel execution:\n\n```bash\ncat urls.txt | xargs -P 10 -I {} sh -c 'firecrawl scrape \"{}\" -o \".firecrawl\u002F$(echo {} | md5).md\"'\n```\n\n## Combining with Other Tools\n\n```bash\n# Extract URLs from search results\njq -r '.data.web[].url' .firecrawl\u002Fsearch-query.json\n\n# Get titles from search results\njq -r '.data.web[] | \"\\(.title): \\(.url)\"' .firecrawl\u002Fsearch-query.json\n\n# Count URLs from map\nfirecrawl map https:\u002F\u002Fexample.com | wc -l\n```\n","# Firecrawl CLI\n\nUse the `firecrawl` CLI to fetch and search the web. Firecrawl returns clean markdown optimized for LLM context windows, handles JavaScript rendering, bypasses common blocks, and provides structured data.\n\n## Installation\n\nCheck status, auth, and rate limits:\n\n```bash\nfirecrawl --status\n```\n\nOutput when ready:\n\n```\n  ? firecrawl cli v1.0.2\n\n  ● Authenticated via FIRECRAWL_API_KEY\n  Concurrency: 0\u002F100 jobs (parallel scrape limit)\n  Credits: 500,000 remaining\n```\n\n- **Concurrency**: Max parallel jobs. Run parallel operations close to this limit but not above.\n- **Credits**: Remaining API credits. Each scrape\u002Fcrawl consumes credits.\n\nIf not installed: `npm install -g firecrawl-cli`\n\nAlways refer to the installation rules in [rules\u002Finstall.md](rules\u002Finstall.md) for more information if the user is not logged in.\n\n## Authentication\n\nIf not authenticated, run:\n\n```bash\nfirecrawl login --browser\n```\n\nThe `--browser` flag automatically opens the browser for authentication without prompting.\n\n## Organization\n\nCreate a `.firecrawl\u002F` folder in the working directory unless it already exists to store results. Add `.firecrawl\u002F` to the `.gitignore` file if not already there. Always use `-o` to write directly to file (avoids flooding context):\n\n```bash\n# Search the web (most common operation)\nfirecrawl search \"your query\" -o .firecrawl\u002Fsearch-{query}.json\n\n# Search with scraping enabled\nfirecrawl search \"your query\" --scrape -o .firecrawl\u002Fsearch-{query}-scraped.json\n\n# Scrape a page\nfirecrawl scrape https:\u002F\u002Fexample.com -o .firecrawl\u002F{site}-{path}.md\n```\n\nExamples:\n\n```\n.firecrawl\u002Fsearch-react_server_components.json\n.firecrawl\u002Fsearch-ai_news-scraped.json\n.firecrawl\u002Fdocs.github.com-actions-overview.md\n.firecrawl\u002Ffirecrawl.dev.md\n```\n\n## Commands\n\n### Search - Web search with optional scraping\n\n```bash\n# Basic search (human-readable output)\nfirecrawl search \"your query\" -o .firecrawl\u002Fsearch-query.txt\n\n# JSON output (recommended for parsing)\nfirecrawl search \"your query\" -o .firecrawl\u002Fsearch-query.json --json\n\n# Limit results\nfirecrawl search \"AI news\" --limit 10 -o .firecrawl\u002Fsearch-ai-news.json --json\n\n# Search specific sources\nfirecrawl search \"tech startups\" --sources news -o .firecrawl\u002Fsearch-news.json --json\nfirecrawl search \"landscapes\" --sources images -o .firecrawl\u002Fsearch-images.json --json\nfirecrawl search \"machine learning\" --sources web,news,images -o .firecrawl\u002Fsearch-ml.json --json\n\n# Filter by category (GitHub repos, research papers, PDFs)\nfirecrawl search \"web scraping python\" --categories github -o .firecrawl\u002Fsearch-github.json --json\nfirecrawl search \"transformer architecture\" --categories research -o .firecrawl\u002Fsearch-research.json --json\n\n# Time-based search\nfirecrawl search \"AI announcements\" --tbs qdr:d -o .firecrawl\u002Fsearch-today.json --json  # Past day\nfirecrawl search \"tech news\" --tbs qdr:w -o .firecrawl\u002Fsearch-week.json --json          # Past week\n\n# Location-based search\nfirecrawl search \"restaurants\" --location \"San Francisco,California,United States\" -o .firecrawl\u002Fsearch-sf.json --json\nfirecrawl search \"local news\" --country DE -o .firecrawl\u002Fsearch-germany.json --json\n\n# Search AND scrape content from results\nfirecrawl search \"firecrawl tutorials\" --scrape -o .firecrawl\u002Fsearch-scraped.json --json\nfirecrawl search \"API docs\" --scrape --scrape-formats markdown,links -o .firecrawl\u002Fsearch-docs.json --json\n```\n\n**Search Options:**\n\n| Option | Description |\n|--------|-------------|\n| `--limit \u003Cn>` | Maximum results (default: 5, max: 100) |\n| `--sources \u003Csources>` | Comma-separated: web, images, news (default: web) |\n| `--categories \u003Ccategories>` | Comma-separated: github, research, pdf |\n| `--tbs \u003Cvalue>` | Time filter: qdr:h (hour), qdr:d (day), qdr:w (week), qdr:m (month), qdr:y (year) |\n| `--location \u003Clocation>` | Geo-targeting (e.g., \"Germany\") |\n| `--country \u003Ccode>` | ISO country code (default: US) |\n| `--scrape` | Enable scraping of search results |\n| `--scrape-formats \u003Cformats>` | Scrape formats when --scrape enabled (default: markdown) |\n| `-o, --output \u003Cpath>` | Save to file |\n\n### Scrape - Single page content extraction\n\n```bash\n# Basic scrape (markdown output)\nfirecrawl scrape https:\u002F\u002Fexample.com -o .firecrawl\u002Fexample.md\n\n# Get raw HTML\nfirecrawl scrape https:\u002F\u002Fexample.com --html -o .firecrawl\u002Fexample.html\n\n# Multiple formats (JSON output)\nfirecrawl scrape https:\u002F\u002Fexample.com --format markdown,links -o .firecrawl\u002Fexample.json\n\n# Main content only (removes nav, footer, ads)\nfirecrawl scrape https:\u002F\u002Fexample.com --only-main-content -o .firecrawl\u002Fexample.md\n\n# Wait for JS to render\nfirecrawl scrape https:\u002F\u002Fspa-app.com --wait-for 3000 -o .firecrawl\u002Fspa.md\n\n# Extract links only\nfirecrawl scrape https:\u002F\u002Fexample.com --format links -o .firecrawl\u002Flinks.json\n\n# Include\u002Fexclude specific HTML tags\nfirecrawl scrape https:\u002F\u002Fexample.com --include-tags article,main -o .firecrawl\u002Farticle.md\nfirecrawl scrape https:\u002F\u002Fexample.com --exclude-tags nav,aside,.ad -o .firecrawl\u002Fclean.md\n```\n\n**Scrape Options:**\n\n| Option | Description |\n|--------|-------------|\n| `-f, --format \u003Cformats>` | Output format(s): markdown, html, rawHtml, links, screenshot, json |\n| `-H, --html` | Shortcut for `--format html` |\n| `--only-main-content` | Extract main content only |\n| `--wait-for \u003Cms>` | Wait before scraping (for JS content) |\n| `--include-tags \u003Ctags>` | Only include specific HTML tags |\n| `--exclude-tags \u003Ctags>` | Exclude specific HTML tags |\n| `-o, --output \u003Cpath>` | Save to file |\n\n### Crawl - Crawl an entire website\n\n```bash\n# Start a crawl (returns job ID)\nfirecrawl crawl https:\u002F\u002Fexample.com\n\n# Wait for crawl to complete\nfirecrawl crawl https:\u002F\u002Fexample.com --wait\n\n# With progress indicator\nfirecrawl crawl https:\u002F\u002Fexample.com --wait --progress\n\n# Check crawl status\nfirecrawl crawl \u003Cjob-id>\n\n# Limit pages\nfirecrawl crawl https:\u002F\u002Fexample.com --limit 100 --max-depth 3\n\n# Crawl blog section only\nfirecrawl crawl https:\u002F\u002Fexample.com --include-paths \u002Fblog,\u002Fposts\n\n# Exclude admin pages\nfirecrawl crawl https:\u002F\u002Fexample.com --exclude-paths \u002Fadmin,\u002Flogin\n\n# Crawl with rate limiting\nfirecrawl crawl https:\u002F\u002Fexample.com --delay 1000 --max-concurrency 2\n\n# Save results\nfirecrawl crawl https:\u002F\u002Fexample.com --wait -o crawl-results.json --pretty\n```\n\n**Crawl Options:**\n\n| Option | Description |\n|--------|-------------|\n| `--wait` | Wait for crawl to complete |\n| `--progress` | Show progress while waiting |\n| `--limit \u003Cn>` | Maximum pages to crawl |\n| `--max-depth \u003Cn>` | Maximum crawl depth |\n| `--include-paths \u003Cpaths>` | Only crawl matching paths |\n| `--exclude-paths \u003Cpaths>` | Skip matching paths |\n| `--delay \u003Cms>` | Delay between requests |\n| `--max-concurrency \u003Cn>` | Max concurrent requests |\n\n### Map - Discover all URLs on a site\n\n```bash\n# List all URLs (one per line)\nfirecrawl map https:\u002F\u002Fexample.com -o .firecrawl\u002Furls.txt\n\n# Output as JSON\nfirecrawl map https:\u002F\u002Fexample.com --json -o .firecrawl\u002Furls.json\n\n# Search for specific URLs\nfirecrawl map https:\u002F\u002Fexample.com --search \"blog\" -o .firecrawl\u002Fblog-urls.txt\n\n# Limit results\nfirecrawl map https:\u002F\u002Fexample.com --limit 500 -o .firecrawl\u002Furls.txt\n\n# Include subdomains\nfirecrawl map https:\u002F\u002Fexample.com --include-subdomains -o .firecrawl\u002Fall-urls.txt\n```\n\n**Map Options:**\n\n| Option | Description |\n|--------|-------------|\n| `--limit \u003Cn>` | Maximum URLs to discover |\n| `--search \u003Cquery>` | Filter URLs by search query |\n| `--sitemap \u003Cmode>` | include, skip, or only |\n| `--include-subdomains` | Include subdomains |\n| `--json` | Output as JSON |\n| `-o, --output \u003Cpath>` | Save to file |\n\n### Credit Usage\n\n```bash\n# Show credit usage\nfirecrawl credit-usage\n\n# Output as JSON\nfirecrawl credit-usage --json --pretty\n```\n\n## Reading Scraped Files\n\nNEVER read entire firecrawl output files at once unless explicitly asked - they can be 1000+ lines. Instead, use grep, head, or incremental reads:\n\n```bash\n# Check file size and preview structure\nwc -l .firecrawl\u002Ffile.md && head -50 .firecrawl\u002Ffile.md\n\n# Use grep to find specific content\ngrep -n \"keyword\" .firecrawl\u002Ffile.md\ngrep -A 10 \"## Section\" .firecrawl\u002Ffile.md\n```\n\n## Parallelization\n\nRun multiple scrapes in parallel using `&` and `wait`:\n\n```bash\n# Parallel scraping (fast)\nfirecrawl scrape https:\u002F\u002Fsite1.com -o .firecrawl\u002F1.md &\nfirecrawl scrape https:\u002F\u002Fsite2.com -o .firecrawl\u002F2.md &\nfirecrawl scrape https:\u002F\u002Fsite3.com -o .firecrawl\u002F3.md &\nwait\n```\n\nFor many URLs, use xargs with `-P` for parallel execution:\n\n```bash\ncat urls.txt | xargs -P 10 -I {} sh -c 'firecrawl scrape \"{}\" -o \".firecrawl\u002F$(echo {} | md5).md\"'\n```\n\n## Combining with Other Tools\n\n```bash\n# Extract URLs from search results\njq -r '.data.web[].url' .firecrawl\u002Fsearch-query.json\n\n# Get titles from search results\njq -r '.data.web[] | \"\\(.title): \\(.url)\"' .firecrawl\u002Fsearch-query.json\n\n# Count URLs from map\nfirecrawl map https:\u002F\u002Fexample.com | wc -l\n```\n",{"name":5,"description":7},"main","e7e336ac628c3e3bd771aff1aaa469c93778f94a","skills\u002Fleonardogrig\u002Ffirecrawl-skills",0,"https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del","2026-08-23 22:39:37",{"source":8,"skillName":5,"commands":51,"prompt":61,"zipAvailable":62},[52,55,58],{"tool":53,"command":54},"npx","npx skills add kbarbel640-del\u002Fskills --skill firecrawl-cli",{"tool":56,"command":57},"bunx","bunx skills add kbarbel640-del\u002Fskills --skill firecrawl-cli",{"tool":59,"command":60},"pnpm","pnpm dlx skills add kbarbel640-del\u002Fskills --skill firecrawl-cli","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fleonardogrig\u002Ffirecrawl-skills\u002FSKILL.md",true,[64,70],{"path":65,"resourceType":66,"resourceTypeDesc":67,"sizeBytes":68,"sourceHtmlUrl":69},"_meta.json","REFERENCE","参考文档",283,"https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fleonardogrig\u002Ffirecrawl-skills\u002F_meta.json",{"path":71,"resourceType":66,"resourceTypeDesc":67,"sizeBytes":72,"sourceHtmlUrl":73},"rules\u002Finstall.md",2164,"https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fleonardogrig\u002Ffirecrawl-skills\u002Frules\u002Finstall.md",[75,105,133,154,160,180],{"skillNo":76,"name":77,"nameZh":6,"description":78,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":79,"categories":80,"keywords":86,"publishedAt":38},"01M6G8J55967D6281ACMKAKTEQ","crowd-prompting","A marketplace where AI agents improve prompts, system instructions, tool descriptions, and other text-based content with domain expertise from real-world operations — and earn tokens for valuable contributions.","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fzzadrian\u002Fcrowd-prompting\u002FSKILL.md",[81],{"categoryNo":82,"categoryName":83,"taxonomyType":84,"taxonomyTypeDesc":85},"01JBSEEDCAT000000000000036","内容创作者","PROFESSION","适用职业",[87,88,89,22,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104],"crowd prompting","prompting","api","tokens","domain","world","prompts","operations","instructions","text","tool","system","improve","productivity","marketplace","https","content","ai agents",{"skillNo":106,"name":107,"nameZh":6,"description":108,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":109,"categories":110,"keywords":116,"publishedAt":38},"01M6G8J0PKPAYVET6BWE8W4C26","dilemm-ai","Compete in DilemmAI, the prisoner's dilemma AI arena at dilemm.ai. Use when an OpenClaw agent wants to create an account, design and submit strategy prompts for their bot, enter matchmaking, analyze historical matches and leaderboards, and iterate on bot strategy. Requires headless browser automation (no API available yet).","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fzyori\u002Fdilemm-ai\u002FSKILL.md",[111],{"categoryNo":112,"categoryName":113,"taxonomyType":114,"taxonomyTypeDesc":115},"01JBSEEDCAT000000000000023","Skill与智能体开发","SCENARIO","使用场景",[117,89,118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,93,28],"dilemm ai","arena","analyze","browser","openclaw agent","create","automation","browser automation","bot","openclaw","design","strategy","headless","compete","submit","matchmaking",{"skillNo":134,"name":135,"nameZh":6,"description":136,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":137,"categories":138,"keywords":142,"publishedAt":38},"01M6G8HWAF3K9SW7NP3Z83CPJ6","arxiv-paper-reviews","Interact with arXiv Crawler API to fetch papers, read reviews, and submit comments. Use when working with arXiv papers, fetching paper lists by date\u002Fcategory\u002Finterest, viewing paper details with comments, or submitting paper reviews via API at http:\u002F\u002F150.158.152.82:8000.","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fzxrys\u002Fweak-accept\u002FSKILL.md",[139],{"categoryNo":140,"categoryName":141,"taxonomyType":114,"taxonomyTypeDesc":115},"01JBSEEDCAT000000000000021","资料检索与研究",[143,144,145,146,147,148,149,22,150,131,28,151,89,152,153],"arxiv paper reviews","reviews","arxiv","paper","crawler","papers","comments","fetch","read","http","via",{"skillNo":155,"name":135,"nameZh":6,"description":136,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":156,"categories":157,"keywords":159,"publishedAt":38},"01M6G8HQJ7N7WMY6YV7D7SSJ16","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fzxrys\u002Farxiv-paper-reviews\u002FSKILL.md",[158],{"categoryNo":140,"categoryName":141,"taxonomyType":114,"taxonomyTypeDesc":115},[146,145,144,143,153,148,149,22,147,131,28,150,151,89,152],{"skillNo":161,"name":162,"nameZh":6,"description":163,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":164,"categories":165,"keywords":166,"publishedAt":38},"01M6G8HM95Y64JNVFC2HN4E2BG","git-summary","Get a quick summary of the current Git repository including status, recent commits, branches, and contributors.","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fzweack\u002Fgit-summary\u002FSKILL.md",[],[167,168,169,170,171,172,173,174,175,176,177,178,179],"git","summary","git summary","commits","repository","win32","status","linux","contributors","true","quick","get","branches",{"skillNo":181,"name":182,"nameZh":6,"description":183,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":6,"repositoryNo":12,"starsCount":13,"licenseSpdxId":14,"licenseFileUrl":6,"sourceHtmlUrl":184,"categories":185,"keywords":190,"publishedAt":38},"01M6G8HGEGF05CNEJCGVYFSC4R","agent-constitution","Interact with AgentConstitution governance contracts on Base Sepolia. Check compliance, read rules, log actions, query governance state.","https:\u002F\u002Fgithub.com\u002Fkbarbel640-del\u002Fskills\u002Fblob\u002Fmain\u002Fskills\u002Fztsalexey\u002Fagent-constitution\u002FSKILL.md",[186,187],{"categoryNo":112,"categoryName":113,"taxonomyType":114,"taxonomyTypeDesc":115},{"categoryNo":188,"categoryName":189,"taxonomyType":84,"taxonomyTypeDesc":85},"01JBSEEDCAT000000000000037","律师与法务",[191,192,193,194,22,195,196,43,197,151,198,199,200,201,202,102,203,204,205],"agent constitution","constitution","contracts","tree","query","base","log","check","Rules","projects","compliance","actions","state","governance","github"]