AGENT SKILL
server_log_analyzer
Analyzes Nginx/Apache server logs to identify Googlebot crawl patterns, errors, and performance bottlenecks.
- License 许可
- MIT
- 最近更新
- 2026-10-09
- Stars
- ★ 2
- Forks
- 1
01 前言 Front Matter
- name
- server_log_analyzer
- tags
- [ "server-logs", "crawl-analysis", "googlebot", "technical-seo", "performance" ]
- version
- 1.0.0
- connector
- scripts/connectors/log_analyzer.py
- description
- Analyzes Nginx/Apache server logs to identify Googlebot crawl patterns, errors, and performance bottlenecks.
03 SKILL.md 正文
Skill: Server Log Analyzer
Execution Steps
- Accept server log file (Nginx access.log or Apache combined format).
- Parse: Extract IP, timestamp, request URL, status code, user agent, response size.
- Filter Googlebot: Isolate Google crawler requests by user agent.
- Analyze:
- Crawl frequency per page (which pages Google visits most/least)
- Crawl budget waste (4xx/5xx pages being crawled)
- Response time distribution (slow pages that delay crawling)
- Crawl depth patterns (how deep does Googlebot go)
- Report: Crawl efficiency score + optimization recommendations.
Key Metrics
- Crawl budget utilization (% of crawls on indexable pages)
- Average response time for bot requests
- Error rate (4xx + 5xx as % of total bot requests)
- New page discovery rate
Quality Validation
- [ ] Log file correctly parsed (no malformed entries silently dropped)
- [ ] Googlebot correctly identified (verified by reverse DNS if possible)
- [ ] Recommendations are specific and actionable
04 同仓库更多 Skills
web_crawler_katana
High-speed web crawling using Katana patterns for deep site mapping, URL discovery, and content extraction.
★ 2
schema_markup_generator
Auto-generates JSON-LD structured data for any page type (Article, Product, FAQ, LocalBusiness, etc.).
★ 2
internal_linking_optimizer
Analyzes and optimizes the internal link graph of a website for SEO authority distribution.
★ 2
google_trends_analyzer
Detects trending topics and seasonal patterns using Google Trends data for content planning and keyword strategy.
★ 2
brand_context_analyzer
Tracks brand mentions, sentiment, and online reputation across web sources.
★ 2
aeo_search_optimizer
Analyzes AI-generated search results (Google AI Overview, Bing Chat, Perplexity) to optimize content for Answer Engine Optimization.
★ 2