Bot Logger

Bot Logger is a plugin for your site that records and validates HTTP requests from search engine bots. It brings access log data into the admin panel, making crawl behavior visible even to non-technical users. Regular observation helps you understand how search engines navigate your content.

• Default bot logging: Captures requests from Googlebot (including alternate user agents) and Bingbot without any setup.
• Import existing access logs: Reads standard access log paths for Nginx, Apache, and Litespeed. Supports custom paths if files are elsewhere.
• IP validation: Automatically and manually verifies that logged IPs match official Google and Bing ranges, reducing noise from fake bots.
• Custom user agents: Track up to 3 additional agents for other search engines, social media scrapers, or crawlers.
• Cloudflare integration: Creates a cache rule to ensure custom user agents reach the origin server for logging.
• Retention & management: Set log retention period, validation frequency, and manually clear logs from the settings page.