[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7ARCJM7R2JM1CNE3EDVP2YV":3,"skill-same:01M7ARCJM7R2JM1CNE3EDVP2YV":63},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":24,"commitSha":25,"skillDirectory":26,"forksCount":14,"repositoryHtmlUrl":27,"repositoryHomepageUrl":6,"ownerHtmlUrl":28,"ownerBlogUrl":6,"ownerDescription":29,"updatedAt":30,"install":31,"resources":44},"01M7ARCJM7R2JM1CNE3EDVP2YV","bright-data-best-practices",null,"Build production-ready Bright Data integrations with best practices baked in. Reference documentation for developers using coding assistants (Claude Code, Cursor, etc.) to implement web scraping, search, browser automation, and structured data extraction. Covers Web Unlocker API, SERP API, Web Scraper API, and Browser API (Scraping Browser).","GongYuanCaiJi\u002Fdsh-claude-code-templates","GongYuanCaiJi","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F129952120?v=4","01M7AK39Q4W3VPF7C1K8M58BFX","劉昱廷 Yu-Ting Liu","01M7AK39QPS2RAJKRQY0EPQJPZ",0,"MIT","https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fweb-data\u002Fbright-data-best-practices\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: bright-data-best-practices\ndescription: \"Build production-ready Bright Data integrations with best practices baked in. Reference documentation for developers using coding assistants (Claude Code, Cursor, etc.) to implement web scraping, search, browser automation, and structured data extraction. Covers Web Unlocker API, SERP API, Web Scraper API, and Browser API (Scraping Browser).\"\nuser-invocable: false\n---\n\n# Bright Data APIs\n\nBright Data provides infrastructure for web data extraction at scale. Four primary APIs cover different use cases — always pick the most specific tool for the job.\n\n## Choosing the Right API\n\n| Use Case | API | Why |\n|----------|-----|-----|\n| Scrape any webpage by URL (no interaction) | Web Unlocker | HTTP-based, auto-bypasses bot detection, cheapest |\n| Google \u002F Bing \u002F Yandex search results | SERP API | Specialized for SERP extraction, returns structured data |\n| Structured data from Amazon, LinkedIn, Instagram, TikTok, etc. | Web Scraper API | Pre-built scrapers, no parsing needed |\n| Click, scroll, fill forms, run JS, intercept XHR | Browser API | Full browser automation |\n| Puppeteer \u002F Playwright \u002F Selenium automation | Browser API | Connects via CDP\u002FWebDriver |\n\n## Authentication Pattern (All APIs)\n\nAll APIs share the same authentication model:\n\n```bash\nexport BRIGHTDATA_API_KEY=\"your-api-key\"         # From Control Panel > Account Settings\nexport BRIGHTDATA_UNLOCKER_ZONE=\"zone-name\"       # Web Unlocker zone name\nexport BRIGHTDATA_SERP_ZONE=\"serp-zone-name\"      # SERP API zone name\nexport BROWSER_AUTH=\"brd-customer-ID-zone-NAME:PASSWORD\"  # Browser API credentials\n```\n\nREST API authentication header for Web Unlocker and SERP API:\n```\nAuthorization: Bearer YOUR_API_KEY\n```\n\n---\n\n## Web Unlocker API\n\nHTTP-based scraping proxy. Best for simple page fetches without browser interaction.\n\n**Endpoint:** `POST https:\u002F\u002Fapi.brightdata.com\u002Frequest`\n\n```python\nimport requests\n\nresponse = requests.post(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Frequest\",\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"},\n    json={\n        \"zone\": \"YOUR_ZONE_NAME\",\n        \"url\": \"https:\u002F\u002Fexample.com\u002Fproduct\u002F123\",\n        \"format\": \"raw\"\n    }\n)\nhtml = response.text\n```\n\n### Key Parameters\n\n| Parameter | Type | Description |\n|-----------|------|-------------|\n| `zone` | string | Zone name (required) |\n| `url` | string | Target URL with `http:\u002F\u002F` or `https:\u002F\u002F` (required) |\n| `format` | string | `\"raw\"` (HTML) or `\"json\"` (structured wrapper) (required) |\n| `method` | string | HTTP verb, default `\"GET\"` |\n| `country` | string | 2-letter ISO for geo-targeting (e.g., `\"us\"`, `\"de\"`) |\n| `data_format` | string | Transform: `\"markdown\"` or `\"screenshot\"` |\n| `async` | boolean | `true` for async mode |\n\n### Quick Patterns\n\n```python\n# Get markdown (best for LLM input)\nresponse = requests.post(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Frequest\",\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"},\n    json={\"zone\": ZONE, \"url\": url, \"format\": \"raw\", \"data_format\": \"markdown\"}\n)\n\n# Geo-targeted request\njson={\"zone\": ZONE, \"url\": url, \"format\": \"raw\", \"country\": \"de\"}\n\n# Screenshot for debugging\njson={\"zone\": ZONE, \"url\": url, \"format\": \"raw\", \"data_format\": \"screenshot\"}\n\n# Async for bulk processing\njson={\"zone\": ZONE, \"url\": url, \"format\": \"raw\", \"async\": True}\n```\n\n**Critical rule:** Never use Web Unlocker with Puppeteer, Playwright, Selenium, or anti-detect browsers. Use Browser API instead.\n\nSee **[references\u002Fweb-unlocker.md](references\u002Fweb-unlocker.md)** for complete reference including proxy interface, special headers, async flow, features, and billing.\n\n---\n\n## SERP API\n\nStructured search engine result extraction for Google, Bing, Yandex, DuckDuckGo.\n\n**Endpoint:** `POST https:\u002F\u002Fapi.brightdata.com\u002Frequest` (same as Web Unlocker)\n\n```python\nresponse = requests.post(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Frequest\",\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"},\n    json={\n        \"zone\": \"YOUR_SERP_ZONE\",\n        \"url\": \"https:\u002F\u002Fwww.google.com\u002Fsearch?q=python+web+scraping&brd_json=1&gl=us&hl=en\",\n        \"format\": \"raw\"\n    }\n)\ndata = response.json()\nfor result in data.get(\"organic\", []):\n    print(result[\"rank\"], result[\"title\"], result[\"link\"])\n```\n\n### Essential Google URL Parameters\n\n| Parameter | Description | Example |\n|-----------|-------------|---------|\n| `q` | Search query | `q=python+web+scraping` |\n| `brd_json` | Parsed JSON output | `brd_json=1` (always use for data pipelines) |\n| `gl` | Country for search | `gl=us` |\n| `hl` | Language | `hl=en` |\n| `start` | Pagination offset | `start=10` (page 2), `start=20` (page 3) |\n| `tbm` | Search type | `tbm=nws` (news), `tbm=isch` (images), `tbm=vid` (videos) |\n| `brd_mobile` | Device | `brd_mobile=1` (mobile), `brd_mobile=ios` |\n| `brd_browser` | Browser | `brd_browser=chrome` |\n| `brd_ai_overview` | Trigger AI Overview | `brd_ai_overview=2` |\n| `uule` | Encoded geo location | for precise location targeting |\n\n**Note:** `num` parameter is **deprecated** as of September 2025. Use `start` for pagination.\n\n### Parsed JSON Response Structure\n\n```json\n{\n  \"organic\": [{\"rank\": 1, \"global_rank\": 1, \"title\": \"...\", \"link\": \"...\", \"description\": \"...\"}],\n  \"paid\": [],\n  \"people_also_ask\": [],\n  \"knowledge_graph\": {},\n  \"related_searches\": [],\n  \"general\": {\"results_cnt\": 1240000000, \"query\": \"...\"}\n}\n```\n\n### Bing Key Parameters\n\n| Parameter | Description |\n|-----------|-------------|\n| `q` | Search query |\n| `setLang` | Language (prefer 4-letter: `en-US`) |\n| `cc` | Country code |\n| `first` | Pagination (increment by 10: 1, 11, 21...) |\n| `safesearch` | `off`, `moderate`, `strict` |\n| `brd_mobile` | Device type |\n\n### Async for Bulk SERP\n\n```python\n# Submit\nresponse = requests.post(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Frequest\",\n    params={\"async\": \"1\"},\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"},\n    json={\"zone\": SERP_ZONE, \"url\": \"https:\u002F\u002Fwww.google.com\u002Fsearch?q=test&brd_json=1\", \"format\": \"raw\"}\n)\nresponse_id = response.headers.get(\"x-response-id\")\n\n# Retrieve (retrieve calls are NOT billed)\nresult = requests.get(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Fserp\u002Fget_result\",\n    params={\"response_id\": response_id},\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"}\n)\n```\n\n**Billing:** Pay per 1,000 successful requests only. Async retrieve calls are not billed.\n\nSee **[references\u002Fserp-api.md](references\u002Fserp-api.md)** for complete reference including Maps, Trends, Reviews, Lens, Hotels, Flights parameters.\n\n---\n\n## Web Scraper API\n\nPre-built scrapers for structured data extraction from 100+ platforms. No parsing logic needed.\n\n**Sync Endpoint:** `POST https:\u002F\u002Fapi.brightdata.com\u002Fdatasets\u002Fv3\u002Fscrape`\n**Async Endpoint:** `POST https:\u002F\u002Fapi.brightdata.com\u002Fdatasets\u002Fv3\u002Ftrigger`\n\n```python\n# Sync (up to 20 URLs, returns immediately)\nresponse = requests.post(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Fdatasets\u002Fv3\u002Fscrape\",\n    params={\"dataset_id\": \"YOUR_DATASET_ID\", \"format\": \"json\"},\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"},\n    json={\"input\": [{\"url\": \"https:\u002F\u002Fwww.amazon.com\u002Fdp\u002FB09X7M8TBQ\"}]}\n)\n\nif response.status_code == 200:\n    data = response.json()  # Results ready\nelif response.status_code == 202:\n    snapshot_id = response.json()[\"snapshot_id\"]  # Poll for completion\n```\n\n### Parameters\n\n| Parameter | Type | Description |\n|-----------|------|-------------|\n| `dataset_id` | string | Scraper identifier from the Scraper Library (required) |\n| `format` | string | `json` (default), `ndjson`, `jsonl`, `csv` |\n| `custom_output_fields` | string | Pipe-separated fields: `url\\|title\\|price` |\n| `include_errors` | boolean | Include error info in results |\n\n### Request Body\n\n```json\n{\n  \"input\": [\n    { \"url\": \"https:\u002F\u002Fwww.amazon.com\u002Fdp\u002FB09X7M8TBQ\" },\n    { \"url\": \"https:\u002F\u002Fwww.amazon.com\u002Fdp\u002FB0B7CTCPKN\" }\n  ]\n}\n```\n\n### Poll for Async Results\n\n```python\nimport time\n\n# Trigger\nsnapshot_id = requests.post(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Fdatasets\u002Fv3\u002Ftrigger\",\n    params={\"dataset_id\": DATASET_ID, \"format\": \"json\"},\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"},\n    json={\"input\": [{\"url\": u} for u in urls]}\n).json()[\"snapshot_id\"]\n\n# Poll\nwhile True:\n    status = requests.get(\n        f\"https:\u002F\u002Fapi.brightdata.com\u002Fdatasets\u002Fv3\u002Fprogress\u002F{snapshot_id}\",\n        headers={\"Authorization\": f\"Bearer {API_KEY}\"}\n    ).json()[\"status\"]\n\n    if status == \"ready\": break\n    if status == \"failed\": raise Exception(\"Job failed\")\n    time.sleep(10)\n\n# Download\ndata = requests.get(\n    f\"https:\u002F\u002Fapi.brightdata.com\u002Fdatasets\u002Fv3\u002Fsnapshot\u002F{snapshot_id}\",\n    params={\"format\": \"json\"},\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"}\n).json()\n```\n\n**Progress status values:** `starting` → `running` → `ready` | `failed`\n**Data retention:** 30 days.\n**Billing:** Per delivered record. Invalid input URLs that fail are still billable.\n\nSee **[references\u002Fweb-scraper-api.md](references\u002Fweb-scraper-api.md)** for complete reference including scraper types, output formats, delivery options, and billing details.\n\n---\n\n## Browser API (Scraping Browser)\n\nFull browser automation via CDP\u002FWebDriver. Handles CAPTCHA, fingerprinting, and anti-bot detection automatically.\n\n**Connection:**\n- Playwright\u002FPuppeteer: `wss:\u002F\u002F${AUTH}@brd.superproxy.io:9222`\n- Selenium: `https:\u002F\u002F${AUTH}@brd.superproxy.io:9515`\n\n```javascript\nconst { chromium } = require(\"playwright-core\");\n\nconst AUTH = process.env.BROWSER_AUTH;\nconst browser = await chromium.connectOverCDP(`wss:\u002F\u002F${AUTH}@brd.superproxy.io:9222`);\nconst page = await browser.newPage();\npage.setDefaultNavigationTimeout(120000); \u002F\u002F Always set to 2 minutes\n\nawait page.goto(\"https:\u002F\u002Fexample.com\", { waitUntil: \"domcontentloaded\" });\nconst html = await page.content();\nawait browser.close();\n```\n\n```python\nfrom playwright.async_api import async_playwright\n\nasync with async_playwright() as p:\n    browser = await p.chromium.connect_over_cdp(f\"wss:\u002F\u002F{AUTH}@brd.superproxy.io:9222\")\n    page = await browser.new_page()\n    page.set_default_navigation_timeout(120000)\n    await page.goto(\"https:\u002F\u002Fexample.com\", wait_until=\"domcontentloaded\")\n    html = await page.content()\n    await browser.close()\n```\n\n### Custom CDP Functions\n\n| Function | Purpose |\n|----------|---------|\n| `Captcha.solve` | Manually trigger CAPTCHA solving |\n| `Captcha.setAutoSolve` | Enable\u002Fdisable auto CAPTCHA solving |\n| `Proxy.setLocation` | Set precise geo location (call BEFORE goto) |\n| `Proxy.useSession` | Maintain same IP across sessions |\n| `Emulation.setDevice` | Apply device profile (iPhone 14, etc.) |\n| `Emulation.getSupportedDevices` | List available device profiles |\n| `Unblocker.enableAdBlock` | Block ads to save bandwidth |\n| `Unblocker.disableAdBlock` | Re-enable ads |\n| `Input.type` | Fast text input for bulk form filling |\n| `Browser.addCertificate` | Install client SSL cert for session |\n| `Page.inspect` | Get DevTools debug URL for live session |\n\n```javascript\n\u002F\u002F CDP session pattern for custom functions\nconst client = await page.target().createCDPSession();\n\n\u002F\u002F CAPTCHA solve with timeout\nconst result = await client.send(\"Captcha.solve\", { timeout: 30000 });\n\n\u002F\u002F Precise geo location (must be before goto)\nawait client.send(\"Proxy.setLocation\", {\n  latitude: 37.7749,\n  longitude: -122.4194,\n  distance: 10,\n  strict: true\n});\n\n\u002F\u002F Block unnecessary resources\nawait client.send(\"Network.setBlockedURLs\", { urls: [\"*google-analytics*\", \"*.ads.*\"] });\n\n\u002F\u002F Device emulation\nawait client.send(\"Emulation.setDevice\", { deviceName: \"iPhone 14\" });\n```\n\n### Session Rules\n- **One initial navigation per session** — new URL = new session\n- **Idle timeout:** 5 minutes\n- **Max duration:** 30 minutes\n\n### Geolocation\n- Country-level: append `-country-us` to credentials username\n- EU-wide: append `-country-eu` (routes through 29+ European countries)\n- Precise: use `Proxy.setLocation` CDP command (before navigation)\n\n### Error Codes\n\n| Code | Issue | Fix |\n|------|-------|-----|\n| `407` | Wrong port | Playwright\u002FPuppeteer → `9222`, Selenium → `9515` |\n| `403` | Bad auth | Check credentials format and zone type |\n| `503` | Service scaling | Wait 1 minute, reconnect |\n\n**Billing:** Traffic-based only. Block images\u002FCSS\u002Ffonts to reduce costs.\n\nSee **[references\u002Fbrowser-api.md](references\u002Fbrowser-api.md)** for complete reference including all CDP functions, bandwidth optimization, CAPTCHA patterns, and debugging.\n\n---\n\n## Detailed References\n\n- **[references\u002Fweb-unlocker.md](references\u002Fweb-unlocker.md)** — Web Unlocker: full parameter list, proxy interface, special headers, async flow, features, billing, anti-patterns\n- **[references\u002Fserp-api.md](references\u002Fserp-api.md)** — SERP API: all Google params (Maps, Trends, Reviews, Lens, Hotels, Flights), Bing params, parsed JSON structure, async, billing\n- **[references\u002Fweb-scraper-api.md](references\u002Fweb-scraper-api.md)** — Web Scraper API: sync vs async, all parameters, polling, scraper types, output formats, billing\n- **[references\u002Fbrowser-api.md](references\u002Fbrowser-api.md)** — Browser API: connection strings, session rules, all CDP functions, geo-targeting, bandwidth optimization, CAPTCHA, debugging, error codes\n","# Bright Data APIs\n\nBright Data provides infrastructure for web data extraction at scale. Four primary APIs cover different use cases — always pick the most specific tool for the job.\n\n## Choosing the Right API\n\n| Use Case | API | Why |\n|----------|-----|-----|\n| Scrape any webpage by URL (no interaction) | Web Unlocker | HTTP-based, auto-bypasses bot detection, cheapest |\n| Google \u002F Bing \u002F Yandex search results | SERP API | Specialized for SERP extraction, returns structured data |\n| Structured data from Amazon, LinkedIn, Instagram, TikTok, etc. | Web Scraper API | Pre-built scrapers, no parsing needed |\n| Click, scroll, fill forms, run JS, intercept XHR | Browser API | Full browser automation |\n| Puppeteer \u002F Playwright \u002F Selenium automation | Browser API | Connects via CDP\u002FWebDriver |\n\n## Authentication Pattern (All APIs)\n\nAll APIs share the same authentication model:\n\n```bash\nexport BRIGHTDATA_API_KEY=\"your-api-key\"         # From Control Panel > Account Settings\nexport BRIGHTDATA_UNLOCKER_ZONE=\"zone-name\"       # Web Unlocker zone name\nexport BRIGHTDATA_SERP_ZONE=\"serp-zone-name\"      # SERP API zone name\nexport BROWSER_AUTH=\"brd-customer-ID-zone-NAME:PASSWORD\"  # Browser API credentials\n```\n\nREST API authentication header for Web Unlocker and SERP API:\n```\nAuthorization: Bearer YOUR_API_KEY\n```\n\n---\n\n## Web Unlocker API\n\nHTTP-based scraping proxy. Best for simple page fetches without browser interaction.\n\n**Endpoint:** `POST https:\u002F\u002Fapi.brightdata.com\u002Frequest`\n\n```python\nimport requests\n\nresponse = requests.post(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Frequest\",\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"},\n    json={\n        \"zone\": \"YOUR_ZONE_NAME\",\n        \"url\": \"https:\u002F\u002Fexample.com\u002Fproduct\u002F123\",\n        \"format\": \"raw\"\n    }\n)\nhtml = response.text\n```\n\n### Key Parameters\n\n| Parameter | Type | Description |\n|-----------|------|-------------|\n| `zone` | string | Zone name (required) |\n| `url` | string | Target URL with `http:\u002F\u002F` or `https:\u002F\u002F` (required) |\n| `format` | string | `\"raw\"` (HTML) or `\"json\"` (structured wrapper) (required) |\n| `method` | string | HTTP verb, default `\"GET\"` |\n| `country` | string | 2-letter ISO for geo-targeting (e.g., `\"us\"`, `\"de\"`) |\n| `data_format` | string | Transform: `\"markdown\"` or `\"screenshot\"` |\n| `async` | boolean | `true` for async mode |\n\n### Quick Patterns\n\n```python\n# Get markdown (best for LLM input)\nresponse = requests.post(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Frequest\",\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"},\n    json={\"zone\": ZONE, \"url\": url, \"format\": \"raw\", \"data_format\": \"markdown\"}\n)\n\n# Geo-targeted request\njson={\"zone\": ZONE, \"url\": url, \"format\": \"raw\", \"country\": \"de\"}\n\n# Screenshot for debugging\njson={\"zone\": ZONE, \"url\": url, \"format\": \"raw\", \"data_format\": \"screenshot\"}\n\n# Async for bulk processing\njson={\"zone\": ZONE, \"url\": url, \"format\": \"raw\", \"async\": True}\n```\n\n**Critical rule:** Never use Web Unlocker with Puppeteer, Playwright, Selenium, or anti-detect browsers. Use Browser API instead.\n\nSee **[references\u002Fweb-unlocker.md](references\u002Fweb-unlocker.md)** for complete reference including proxy interface, special headers, async flow, features, and billing.\n\n---\n\n## SERP API\n\nStructured search engine result extraction for Google, Bing, Yandex, DuckDuckGo.\n\n**Endpoint:** `POST https:\u002F\u002Fapi.brightdata.com\u002Frequest` (same as Web Unlocker)\n\n```python\nresponse = requests.post(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Frequest\",\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"},\n    json={\n        \"zone\": \"YOUR_SERP_ZONE\",\n        \"url\": \"https:\u002F\u002Fwww.google.com\u002Fsearch?q=python+web+scraping&brd_json=1&gl=us&hl=en\",\n        \"format\": \"raw\"\n    }\n)\ndata = response.json()\nfor result in data.get(\"organic\", []):\n    print(result[\"rank\"], result[\"title\"], result[\"link\"])\n```\n\n### Essential Google URL Parameters\n\n| Parameter | Description | Example |\n|-----------|-------------|---------|\n| `q` | Search query | `q=python+web+scraping` |\n| `brd_json` | Parsed JSON output | `brd_json=1` (always use for data pipelines) |\n| `gl` | Country for search | `gl=us` |\n| `hl` | Language | `hl=en` |\n| `start` | Pagination offset | `start=10` (page 2), `start=20` (page 3) |\n| `tbm` | Search type | `tbm=nws` (news), `tbm=isch` (images), `tbm=vid` (videos) |\n| `brd_mobile` | Device | `brd_mobile=1` (mobile), `brd_mobile=ios` |\n| `brd_browser` | Browser | `brd_browser=chrome` |\n| `brd_ai_overview` | Trigger AI Overview | `brd_ai_overview=2` |\n| `uule` | Encoded geo location | for precise location targeting |\n\n**Note:** `num` parameter is **deprecated** as of September 2025. Use `start` for pagination.\n\n### Parsed JSON Response Structure\n\n```json\n{\n  \"organic\": [{\"rank\": 1, \"global_rank\": 1, \"title\": \"...\", \"link\": \"...\", \"description\": \"...\"}],\n  \"paid\": [],\n  \"people_also_ask\": [],\n  \"knowledge_graph\": {},\n  \"related_searches\": [],\n  \"general\": {\"results_cnt\": 1240000000, \"query\": \"...\"}\n}\n```\n\n### Bing Key Parameters\n\n| Parameter | Description |\n|-----------|-------------|\n| `q` | Search query |\n| `setLang` | Language (prefer 4-letter: `en-US`) |\n| `cc` | Country code |\n| `first` | Pagination (increment by 10: 1, 11, 21...) |\n| `safesearch` | `off`, `moderate`, `strict` |\n| `brd_mobile` | Device type |\n\n### Async for Bulk SERP\n\n```python\n# Submit\nresponse = requests.post(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Frequest\",\n    params={\"async\": \"1\"},\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"},\n    json={\"zone\": SERP_ZONE, \"url\": \"https:\u002F\u002Fwww.google.com\u002Fsearch?q=test&brd_json=1\", \"format\": \"raw\"}\n)\nresponse_id = response.headers.get(\"x-response-id\")\n\n# Retrieve (retrieve calls are NOT billed)\nresult = requests.get(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Fserp\u002Fget_result\",\n    params={\"response_id\": response_id},\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"}\n)\n```\n\n**Billing:** Pay per 1,000 successful requests only. Async retrieve calls are not billed.\n\nSee **[references\u002Fserp-api.md](references\u002Fserp-api.md)** for complete reference including Maps, Trends, Reviews, Lens, Hotels, Flights parameters.\n\n---\n\n## Web Scraper API\n\nPre-built scrapers for structured data extraction from 100+ platforms. No parsing logic needed.\n\n**Sync Endpoint:** `POST https:\u002F\u002Fapi.brightdata.com\u002Fdatasets\u002Fv3\u002Fscrape`\n**Async Endpoint:** `POST https:\u002F\u002Fapi.brightdata.com\u002Fdatasets\u002Fv3\u002Ftrigger`\n\n```python\n# Sync (up to 20 URLs, returns immediately)\nresponse = requests.post(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Fdatasets\u002Fv3\u002Fscrape\",\n    params={\"dataset_id\": \"YOUR_DATASET_ID\", \"format\": \"json\"},\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"},\n    json={\"input\": [{\"url\": \"https:\u002F\u002Fwww.amazon.com\u002Fdp\u002FB09X7M8TBQ\"}]}\n)\n\nif response.status_code == 200:\n    data = response.json()  # Results ready\nelif response.status_code == 202:\n    snapshot_id = response.json()[\"snapshot_id\"]  # Poll for completion\n```\n\n### Parameters\n\n| Parameter | Type | Description |\n|-----------|------|-------------|\n| `dataset_id` | string | Scraper identifier from the Scraper Library (required) |\n| `format` | string | `json` (default), `ndjson`, `jsonl`, `csv` |\n| `custom_output_fields` | string | Pipe-separated fields: `url\\|title\\|price` |\n| `include_errors` | boolean | Include error info in results |\n\n### Request Body\n\n```json\n{\n  \"input\": [\n    { \"url\": \"https:\u002F\u002Fwww.amazon.com\u002Fdp\u002FB09X7M8TBQ\" },\n    { \"url\": \"https:\u002F\u002Fwww.amazon.com\u002Fdp\u002FB0B7CTCPKN\" }\n  ]\n}\n```\n\n### Poll for Async Results\n\n```python\nimport time\n\n# Trigger\nsnapshot_id = requests.post(\n    \"https:\u002F\u002Fapi.brightdata.com\u002Fdatasets\u002Fv3\u002Ftrigger\",\n    params={\"dataset_id\": DATASET_ID, \"format\": \"json\"},\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"},\n    json={\"input\": [{\"url\": u} for u in urls]}\n).json()[\"snapshot_id\"]\n\n# Poll\nwhile True:\n    status = requests.get(\n        f\"https:\u002F\u002Fapi.brightdata.com\u002Fdatasets\u002Fv3\u002Fprogress\u002F{snapshot_id}\",\n        headers={\"Authorization\": f\"Bearer {API_KEY}\"}\n    ).json()[\"status\"]\n\n    if status == \"ready\": break\n    if status == \"failed\": raise Exception(\"Job failed\")\n    time.sleep(10)\n\n# Download\ndata = requests.get(\n    f\"https:\u002F\u002Fapi.brightdata.com\u002Fdatasets\u002Fv3\u002Fsnapshot\u002F{snapshot_id}\",\n    params={\"format\": \"json\"},\n    headers={\"Authorization\": f\"Bearer {API_KEY}\"}\n).json()\n```\n\n**Progress status values:** `starting` → `running` → `ready` | `failed`\n**Data retention:** 30 days.\n**Billing:** Per delivered record. Invalid input URLs that fail are still billable.\n\nSee **[references\u002Fweb-scraper-api.md](references\u002Fweb-scraper-api.md)** for complete reference including scraper types, output formats, delivery options, and billing details.\n\n---\n\n## Browser API (Scraping Browser)\n\nFull browser automation via CDP\u002FWebDriver. Handles CAPTCHA, fingerprinting, and anti-bot detection automatically.\n\n**Connection:**\n- Playwright\u002FPuppeteer: `wss:\u002F\u002F${AUTH}@brd.superproxy.io:9222`\n- Selenium: `https:\u002F\u002F${AUTH}@brd.superproxy.io:9515`\n\n```javascript\nconst { chromium } = require(\"playwright-core\");\n\nconst AUTH = process.env.BROWSER_AUTH;\nconst browser = await chromium.connectOverCDP(`wss:\u002F\u002F${AUTH}@brd.superproxy.io:9222`);\nconst page = await browser.newPage();\npage.setDefaultNavigationTimeout(120000); \u002F\u002F Always set to 2 minutes\n\nawait page.goto(\"https:\u002F\u002Fexample.com\", { waitUntil: \"domcontentloaded\" });\nconst html = await page.content();\nawait browser.close();\n```\n\n```python\nfrom playwright.async_api import async_playwright\n\nasync with async_playwright() as p:\n    browser = await p.chromium.connect_over_cdp(f\"wss:\u002F\u002F{AUTH}@brd.superproxy.io:9222\")\n    page = await browser.new_page()\n    page.set_default_navigation_timeout(120000)\n    await page.goto(\"https:\u002F\u002Fexample.com\", wait_until=\"domcontentloaded\")\n    html = await page.content()\n    await browser.close()\n```\n\n### Custom CDP Functions\n\n| Function | Purpose |\n|----------|---------|\n| `Captcha.solve` | Manually trigger CAPTCHA solving |\n| `Captcha.setAutoSolve` | Enable\u002Fdisable auto CAPTCHA solving |\n| `Proxy.setLocation` | Set precise geo location (call BEFORE goto) |\n| `Proxy.useSession` | Maintain same IP across sessions |\n| `Emulation.setDevice` | Apply device profile (iPhone 14, etc.) |\n| `Emulation.getSupportedDevices` | List available device profiles |\n| `Unblocker.enableAdBlock` | Block ads to save bandwidth |\n| `Unblocker.disableAdBlock` | Re-enable ads |\n| `Input.type` | Fast text input for bulk form filling |\n| `Browser.addCertificate` | Install client SSL cert for session |\n| `Page.inspect` | Get DevTools debug URL for live session |\n\n```javascript\n\u002F\u002F CDP session pattern for custom functions\nconst client = await page.target().createCDPSession();\n\n\u002F\u002F CAPTCHA solve with timeout\nconst result = await client.send(\"Captcha.solve\", { timeout: 30000 });\n\n\u002F\u002F Precise geo location (must be before goto)\nawait client.send(\"Proxy.setLocation\", {\n  latitude: 37.7749,\n  longitude: -122.4194,\n  distance: 10,\n  strict: true\n});\n\n\u002F\u002F Block unnecessary resources\nawait client.send(\"Network.setBlockedURLs\", { urls: [\"*google-analytics*\", \"*.ads.*\"] });\n\n\u002F\u002F Device emulation\nawait client.send(\"Emulation.setDevice\", { deviceName: \"iPhone 14\" });\n```\n\n### Session Rules\n- **One initial navigation per session** — new URL = new session\n- **Idle timeout:** 5 minutes\n- **Max duration:** 30 minutes\n\n### Geolocation\n- Country-level: append `-country-us` to credentials username\n- EU-wide: append `-country-eu` (routes through 29+ European countries)\n- Precise: use `Proxy.setLocation` CDP command (before navigation)\n\n### Error Codes\n\n| Code | Issue | Fix |\n|------|-------|-----|\n| `407` | Wrong port | Playwright\u002FPuppeteer → `9222`, Selenium → `9515` |\n| `403` | Bad auth | Check credentials format and zone type |\n| `503` | Service scaling | Wait 1 minute, reconnect |\n\n**Billing:** Traffic-based only. Block images\u002FCSS\u002Ffonts to reduce costs.\n\nSee **[references\u002Fbrowser-api.md](references\u002Fbrowser-api.md)** for complete reference including all CDP functions, bandwidth optimization, CAPTCHA patterns, and debugging.\n\n---\n\n## Detailed References\n\n- **[references\u002Fweb-unlocker.md](references\u002Fweb-unlocker.md)** — Web Unlocker: full parameter list, proxy interface, special headers, async flow, features, billing, anti-patterns\n- **[references\u002Fserp-api.md](references\u002Fserp-api.md)** — SERP API: all Google params (Maps, Trends, Reviews, Lens, Hotels, Flights), Bing params, parsed JSON structure, async, billing\n- **[references\u002Fweb-scraper-api.md](references\u002Fweb-scraper-api.md)** — Web Scraper API: sync vs async, all parameters, polling, scraper types, output formats, billing\n- **[references\u002Fbrowser-api.md](references\u002Fbrowser-api.md)** — Browser API: connection strings, session rules, all CDP functions, geo-targeting, bandwidth optimization, CAPTCHA, debugging, error codes\n",{"name":5,"description":7,"user-invocable":20},"main","51493f354fd03e3f941d4df7fd64c0b8c7a2632d","skills\u002Fweb-data\u002Fbright-data-best-practices","https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates","https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi","漏洞研究、根因分析、黑箱測試｜做 AI agent 工具｜Vulnerability research, root-cause analysis, AI agent tooling","2026-08-16 02:24:07",{"source":8,"skillName":5,"commands":32,"prompt":42,"zipAvailable":43},[33,36,39],{"tool":34,"command":35},"npx","npx skills add GongYuanCaiJi\u002Fdsh-claude-code-templates --skill bright-data-best-practices",{"tool":37,"command":38},"bunx","bunx skills add GongYuanCaiJi\u002Fdsh-claude-code-templates --skill bright-data-best-practices",{"tool":40,"command":41},"pnpm","pnpm dlx skills add GongYuanCaiJi\u002Fdsh-claude-code-templates --skill bright-data-best-practices","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fweb-data\u002Fbright-data-best-practices\u002FSKILL.md",true,[45,51,55,59],{"path":46,"resourceType":47,"resourceTypeDesc":48,"sizeBytes":49,"sourceHtmlUrl":50},"references\u002Fbrowser-api.md","REFERENCE","参考文档",17732,"https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fweb-data\u002Fbright-data-best-practices\u002Freferences\u002Fbrowser-api.md",{"path":52,"resourceType":47,"resourceTypeDesc":48,"sizeBytes":53,"sourceHtmlUrl":54},"references\u002Fserp-api.md",13848,"https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fweb-data\u002Fbright-data-best-practices\u002Freferences\u002Fserp-api.md",{"path":56,"resourceType":47,"resourceTypeDesc":48,"sizeBytes":57,"sourceHtmlUrl":58},"references\u002Fweb-scraper-api.md",11092,"https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fweb-data\u002Fbright-data-best-practices\u002Freferences\u002Fweb-scraper-api.md",{"path":60,"resourceType":47,"resourceTypeDesc":48,"sizeBytes":61,"sourceHtmlUrl":62},"references\u002Fweb-unlocker.md",12523,"https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fweb-data\u002Fbright-data-best-practices\u002Freferences\u002Fweb-unlocker.md",[64,71,80,87,94,101],{"skillNo":65,"name":66,"nameZh":6,"description":67,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":68,"categories":69,"keywords":70,"publishedAt":19},"01M7ARMYTZ5D4B7N5SKFXV345V","zapier-make-patterns","No-code automation democratizes workflow building. Zapier and Make (formerly Integromat) let non-developers automate business processes without writing code. But no-code doesn't mean no-complexity - these platforms have their own patterns, pitfalls, and breaking points.  This skill covers when to use which platform, how to build reliable automations, and when to graduate to code-based solutions. Key insight: Zapier optimizes for simplicity and integrations (7000+ apps), Make optimizes for power","https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fworkflow-automation\u002Fzapier-make-patterns\u002FSKILL.md",[],[],{"skillNo":72,"name":73,"nameZh":6,"description":74,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":75,"licenseFileUrl":76,"sourceHtmlUrl":77,"categories":78,"keywords":79,"publishedAt":19},"01M7ARMX1BVNEAR98SBANMDF2V","yeet","Use only when the user explicitly asks to stage, commit, push, and open a GitHub pull request in one flow using the GitHub CLI (`gh`).","Apache-2.0","https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fworkflow-automation\u002Fyeet\u002FLICENSE.txt","https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fworkflow-automation\u002Fyeet\u002FSKILL.md",[],[],{"skillNo":81,"name":82,"nameZh":6,"description":83,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":84,"categories":85,"keywords":86,"publishedAt":19},"01M7ARMPR4RQ417MG1HMPGNQHH","workflow-automation","Workflow automation is the infrastructure that makes AI agents reliable. Without durable execution, a network hiccup during a 10-step payment flow means lost money and angry customers. With it, workflows resume exactly where they left off.  This skill covers the platforms (n8n, Temporal, Inngest) and patterns (sequential, parallel, orchestrator-worker) that turn brittle scripts into production-grade automation.  Key insight: The platforms make different tradeoffs. n8n optimizes for accessibility","https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fworkflow-automation\u002Fworkflow-automation\u002FSKILL.md",[],[],{"skillNo":88,"name":89,"nameZh":6,"description":90,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":91,"categories":92,"keywords":93,"publishedAt":19},"01M7ARMHBERDMKGDMV7K6MQ6YP","trigger-dev","Trigger.dev expert for background jobs, AI workflows, and reliable async execution with excellent developer experience and TypeScript-first design. Use when: trigger.dev, trigger dev, background task, ai background job, long running task.","https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fworkflow-automation\u002Ftrigger-dev\u002FSKILL.md",[],[],{"skillNo":95,"name":96,"nameZh":6,"description":97,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":98,"categories":99,"keywords":100,"publishedAt":19},"01M7ARME0A7KFT330Q2H25HE2B","slack-automation","Automate Slack workspace operations including messaging, search, channel management, and reaction workflows through Composio's Slack toolkit.","https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fworkflow-automation\u002Fslack-automation\u002FSKILL.md",[],[],{"skillNo":102,"name":103,"nameZh":6,"description":104,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":105,"categories":106,"keywords":107,"publishedAt":19},"01M7ARM8D87V18WDG0GEZS11ZT","planning-with-files","Transforms workflow to use Manus-style persistent markdown files for planning, progress tracking, and knowledge storage. Use when starting complex tasks, multi-step projects, research tasks, or when the user mentions planning, organizing work, tracking progress, or wants structured output.","https:\u002F\u002Fgithub.com\u002FGongYuanCaiJi\u002Fdsh-claude-code-templates\u002Fblob\u002Fmain\u002Fskills\u002Fworkflow-automation\u002Fplanning-with-files\u002FSKILL.md",[],[]]