AGENT SKILL

tavily-crawl

Collect content from many pages on the same site. Use when the user wants to crawl, download docs, extract a whole section such as /docs, bulk-extract pages, or says "get all the pages" or "extract everything under".

License 许可
MIT
最近更新
2026-11-13
Stars
★ 29
Forks
156

01 前言 Front Matter

name
tavily-crawl
description
Collect content from many pages on the same site. Use when the user wants to crawl, download docs, extract a whole section such as /docs, bulk-extract pages, or says "get all the pages" or "extract everything under".

03 SKILL.md 正文

Tavily Crawl

Gather content from a site section, not from the open web.

When

  • You need many pages under one site (docs, API reference, a path prefix)
  • Step 4: search → extract → map → crawl → research

Do not use this skill for a single known URL (extract), for URL discovery only (map), or for a cited multi-source report across the web (research).

How

  • Map first when the target section is unclear.
  • Stay narrow: limit depth and page count; constrain to the paths you need.
  • For answering a question, prefer instruction-guided, chunked crawls over dumping every page into context.
  • For saving a docs tree onto disk, do that only in a terminal with a real filesystem. On a connector host, return the crawled content instead.
  • Cite the pages you used. Always cap the crawl so it cannot run away.

Execute

If tavily_crawl is callable (the name may be prefixed), call it. Do not install the CLI and do not run tvly for this. In a coding-agent terminal that is already using tvly, pass --client-name "cursor plugin" and take flags from tvly crawl --help. Never ask for an API key in chat.

04 同仓库更多 Skills

CognitionAI
CognitionAI/devin-marketplace

business-data

暂无简介

★ 29
CognitionAI
CognitionAI/devin-marketplace

workflow

Creates durable, resumable workflows using Vercel's Workflow SDK. Use when building workflows that need to survive restarts, pause for external events, retry on failure, or coordinate multi-step operations over time. Triggers on mentions of "workflow", "durable functions", "resumable", "workflow sdk", "queue", "event", "push", "subscribe", or step-based orchestration.

★ 29
CognitionAI
CognitionAI/devin-marketplace

workflow

Vercel Workflow SDK expert guidance. Use when building durable workflows, long-running tasks, API routes or agents that need pause/resume, retries, step-based execution, or crash-safe orchestration with Vercel Workflow.

★ 29
CognitionAI
CognitionAI/devin-marketplace

verification

Full-story verification — infers what the user is building, then verifies the complete flow end-to-end: browser → API → data → response. Triggers on dev server start and 'why isn't this working' signals.

★ 29
CognitionAI
CognitionAI/devin-marketplace

vercel-storage

Vercel storage expert guidance — Blob, Global Config (formerly Edge Config), and Marketplace storage (Neon Postgres, Upstash Redis). Use when choosing, configuring, or using data storage with Vercel applications.

★ 29
CognitionAI
CognitionAI/devin-marketplace

vercel-services

Configure and troubleshoot Vercel Services for multiple frontends and backends in one project. Use when composing a polyglot or multi-service application on one Vercel deployment; defining the `services` key, service-targeted rewrites, or service bindings in `vercel.json`; or running all services with `vercel dev`.

★ 29