Free AI Crawler Log Analyzer

AI crawlers identify themselves in the User-Agent header of every request — for example GPTBot, OAI-SearchBot, ClaudeBot, and PerplexityBot. Your web server records every request (with its User-Agent and IP) in an access log. This tool reads that log and surfaces exactly which AI bots hit your site, how many times, and which pages they fetched.

AI crawlers don’t execute JavaScript, so a client-side analytics tag like Google Analytics never fires for them — they’re invisible to it. The only reliable way to detect bot visits is server-side: your access logs (or your CDN/Cloudflare logs), which is exactly what this tool analyzes.

Anyone can send a fake User-Agent claiming to be GPTBot. To catch impostors, this tool checks each request’s IP address against the operator’s official published IP ranges (OpenAI and Perplexity publish theirs). A hit is “verified” when the IP is inside the real range and “spoofed” when it isn’t. Bots whose operators don’t publish ranges (e.g. ClaudeBot, Googlebot) are shown as “unverified” — Google, for instance, verifies via reverse DNS instead.

No. The entire analysis runs in your browser using JavaScript — your log file (which may contain visitor IPs) never leaves your device and is never sent to any server.

Most hosts expose it in cPanel/Plesk under “Raw Access Logs,” or at a path like /var/log/nginx/access.log on a VPS. If you’re on Cloudflare, you can export request logs (Logpush or the dashboard). Paste the lines in, or upload the file.

If an answer engine like PerplexityBot or OAI-SearchBot never crawls you, you can’t be cited in its results. The usual cause is an accidental block in robots.txt or a CDN/WAF rule. Confirm access with our AI Bot Access Checker, then make sure your content is crawlable and worth citing.