local-web-search
Free, private, real-time web search for OpenClaw — zero API keys required. Powered by self-hosted SearXNG + Scrapling anti-bot engine. Multi-engine parallel search (Bing/DuckDuckGo/Google/Startpage/Qwant), intent-aware Agent Reach query expansion, three-tier Browse/Viewing (Fetcher → StealthyFetcher → DynamicFetcher for Cloudflare/JS sites), cross-engine anti-hallucination validation, and automatic public fallback.
- License 许可
- MIT
- 最近更新
- 2026-06-07
- Stars
- ★ 0
- Forks
- 1
01 前言 Front Matter
- name
- local-web-search
- homepage
- https://github.com/wd041216-bit/openclaw-free-web-search
- metadata
- { "clawdbot": { "emoji": "🔍", "files": [ "scripts/*" ], "requires": { "env": [] } } }
- description
- Free, private, real-time web search for OpenClaw — zero API keys required. Powered by self-hosted SearXNG + Scrapling anti-bot engine. Multi-engine parallel search (Bing/DuckDuckGo/Google/Startpage/Qwant), intent-aware Agent Reach query expansion, three-tier Browse/Viewing (Fetcher → StealthyFetcher → DynamicFetcher for Cloudflare/JS sites), cross-engine anti-hallucination validation, and automatic public fallback.
03 SKILL.md 正文
Local Free Web Search v3.0
Use this skill when the user needs current or real-time web information. Powered by Scrapling (anti-bot) + SearXNG (self-hosted search). Zero API keys. Zero cost. Runs entirely locally.
External Endpoints
| Endpoint | Data Sent | Purpose |
|---|---|---|
http://127.0.0.1:18080 (local) |
Search query string only | Local SearXNG instance |
https://searx.be (fallback only) |
Search query string only | Public fallback when local SearXNG is down |
Any URL passed to browse_page.py |
HTTP GET request only | Fetch page content for reading |
No personal data, no credentials, no conversation history is ever sent to any endpoint.
Security & Privacy
- All search queries go to your local SearXNG instance by default — no third-party tracking
- Public fallback (
searx.be) is only used when local service is unavailable, and only receives the raw query string browse_page.pymakes standard HTTP GET requests to URLs you explicitly pass — no data is posted- Scrapling runs entirely locally — no cloud API calls, no telemetry
- No API keys required or stored
- No conversation history or personal data leaves your machine
Trust Statement: This skill sends search queries to your local SearXNG instance (default) or searx.be (fallback). Page content is fetched via standard HTTP GET. No personal data is transmitted. Only install if you trust the public SearXNG instance at searx.be as a fallback.
Model Invocation Note
This skill is invoked autonomously by the agent when a query requires live web information. You can disable autonomous invocation by removing this skill from your workspace. The agent will only use this skill when it determines real-time information is needed.
Tool 1 — Web Search
python3 ~/.openclaw/workspace/skills/local-web-search/scripts/search_local_web.py \
--query "YOUR QUERY" \
--intent general \
--limit 5
Intent options (controls engine selection + query expansion):
| Intent | Best for |
|---|---|
general |
Default, mixed queries |
factual |
Facts, definitions, official docs |
news |
Latest events, breaking news |
research |
Papers, GitHub, technical depth |
tutorial |
How-to guides, code examples |
comparison |
A vs B, pros/cons |
privacy |
Sensitive queries (ddg/startpage/qwant only) |
Additional flags:
| Flag | Description |
|---|---|
--engines bing,duckduckgo,... |
Override engine selection |
--freshness hour|day|week|month|year |
Filter by recency |
--max-age-days N |
Downrank results older than N days |
--browse |
Auto-fetch top result with browse_page.py |
--no-expand |
Disable Agent Reach query expansion |
--json |
Machine-readable JSON output |
Tool 2 — Browse/Viewing (read full page)
python3 ~/.openclaw/workspace/skills/local-web-search/scripts/browse_page.py \
--url "https://example.com/article" \
--max-words 600
Fetcher modes (use --mode flag):
| Mode | Fetcher | Use case |
|---|---|---|
auto |
Tier 1 → 2 → 3 | Default — tries fast first |
fast |
Fetcher |
Normal sites |
stealth |
StealthyFetcher |
Cloudflare / anti-bot sites |
dynamic |
DynamicFetcher |
Heavy JS / SPA sites |
Returns: title, published date, word count, confidence (HIGH/MEDIUM/LOW), full extracted text, and anti-hallucination advisory.
Recommended Workflow
- Run
search_local_web.py— review results by Score and[cross-validated]tag - Run
browse_page.pyon the top URL — check Confidence level - If Confidence is LOW (paywall/blocked) — retry with
--mode stealthor try next URL - Answer only after reading HIGH-confidence page content
- Never state facts from snippets alone
Rules
- Always use
--intentto match the query type for best results. - When local SearXNG is unavailable, both scripts automatically fall back to
searx.be. - If the fallback also fails, tell the user to start local SearXNG:
cd "$(cat ~/.openclaw/workspace/skills/local-web-search/.project_root)" && ./start_local_search.sh
- Do NOT invent search results if all sources fail.
search_local_web.pyandbrowse_page.pyare complementary: search first, browse second.- Prefer
[cross-validated]results (appeared in multiple engines) for factual claims. - For sites behind Cloudflare or requiring JS, use
browse_page.py --mode stealth.
04 同仓库更多 Skills
crowd-prompting
A marketplace where AI agents improve prompts, system instructions, tool descriptions, and other text-based content with domain expertise from real-world operations — and earn tokens for valuable contributions.
ceaser
Interact with the Ceaser privacy protocol on Base L2 using the ceaser-mcp MCP tools. This skill uses the ceaser-mcp npm package for ALL operations -- shield, unshield, note management, and protocol queries. All ceaser tool calls use CLI subcommands (npx -y ceaser-mcp <subcommand>). Ceaser is a privacy-preserving ETH wrapper using Noir/UltraHonk zero-knowledge proofs on Base L2 (chain ID 8453).
ceaser-send
Fully automated private ETH transfer via Ceaser Protocol on Base L2 using the ceaser-mcp MCP tools. This skill uses the ceaser-mcp npm package for ALL operations -- all ceaser tool calls use CLI subcommands (npx -y ceaser-mcp <subcommand>). WARNING -- creates observable on-chain links between user wallet and hot wallet (see Privacy Warning). Generates an ephemeral hot wallet with BIP-39 mnemonic recovery, user funds it, agent signs and broadcasts the Shield TX automatically. Exactly one manual step required (funding the hot wallet with ETH). Uses Noir/UltraHonk zero-knowledge proofs.
dilemm-ai
Compete in DilemmAI, the prisoner's dilemma AI arena at dilemm.ai. Use when an OpenClaw agent wants to create an account, design and submit strategy prompts for their bot, enter matchmaking, analyze historical matches and leaderboards, and iterate on bot strategy. Requires headless browser automation (no API available yet).
moldium
Post and manage content on the Moldium blog platform. Triggered by "post to Moldium", "write a blog post", "publish an article", etc.
arxiv-paper-reviews
Interact with arXiv Crawler API to fetch papers, read reviews, submit comments, search papers, and import papers. Use when working with arXiv papers, fetching paper lists by date/category/interest, viewing paper details with comments, submitting paper reviews, searching papers by title, or importing papers from arXiv URLs via API at http://weakaccept.top:8000/.