ferret

ferret Plugin

Declarative web scraping tool. Extract data from websites using a query language. Supports scraping, crawling, and data extraction from web pages.

Commands

Web Scraping

• ferret web scrape — Scrape data from websites

Utility

• ferret _ _ — Passthrough to ferret CLI

Usage Examples

• "Scrape this website"
• "Extract data from web page"
• "Crawl and scrape multiple pages"
• "Query web page data"

Installation

brew install ferret

Or via Go:

go install github.com/MontFerret/ferret/cmd/ferret@latest

Examples

# Scrape with FQL script
ferret web scrape script.fql

# Output to file
ferret web scrape script.fql --output results.json

# CSV output format
ferret web scrape script.fql --format csv

# Headless mode
ferret web scrape script.fql --headless

# Set timeout
ferret web scrape script.fql --timeout 30

# Any ferret command with passthrough
ferret _ _ script.fql --output data.json
ferret _ _ --headless script.fql

Key Features

• Declarative - FQL query language
• Dynamic content - Headless Chrome support
• Crawling - Multi-page crawling
• Data extraction - Structured data output
• JSON/CSV - Multiple output formats
• JavaScript - Execute JavaScript on pages
• Cross-platform - Linux, macOS, Windows
• Fast - Efficient scraping
• Flexible - Custom queries
• Extensible - Plugin system

Notes

• Uses FQL (Ferret Query Language)
• Supports JavaScript execution
• Can handle dynamic content
• Perfect for data extraction
• Works with single pages and crawling