See which AI bots are crawling your website
ChatGPT, Claude, Perplexity, Google and other platforms crawl the web around the clock. Traditional analytics tells you almost nothing about this activity. Log Hero makes it visible.
Every request your server answers becomes a data point: bot name, requested path, status code and response time. You read it in the Bot Activity report in your Keyword Hero account, and the same data lands in your own Google Analytics property.
Free.
No plan to choose, no card to enter.
Bot Activity
Jul 21 until Aug 19, 2026
Your analytics cannot see a single bot
Normal web tracking runs on JavaScript in the browser. Google Analytics, Matomo and every tag manager work the same way: a script loads, it fires, a session is counted. AI bots do not execute that script. Crawler research across hundreds of millions of requests found no evidence of JavaScript execution at all. They read your JavaScript files as text and never run them.
So every AI bot visit is missing from your reports. Not sampled, not delayed, absent. Your server wrote all of it down anyway, in the access log, one line per request.
A second audience arrived, and it does not show up in any report
Make AI bot traffic visible
AI platforms are becoming a new audience for your content. Their crawlers access websites to discover, retrieve and process information, often without ever creating a traditional website session. Log Hero gives you visibility into this activity.
Bot Activity
Performance from Jul 21, 2026 until Aug 19, 2026
Log Hero is receiving bot traffic for this domain.
Every AI bot, by name
GPTBot, ClaudeBot, PerplexityBot, ChatGPT-User and every other agent that reaches your server, counted per day.
The content they take
Which pages, files and feeds each crawler pulls most often, so you can see what actually ends up in AI answers.
Who is gaining ground
Which bots are getting more active from week to week, and how AI crawlers compare with Googlebot and bingbot.
AI bots and search engine crawlers. One view.
AI crawlers are only part of the picture. Log Hero also shows you how search engines like Google and Bing crawl your website, in the same report, over the same period.
Search crawlers
Googlebot, bingbot, Applebot. They crawl for the index that still sends you most of your organic traffic. This is the bucket you almost never want to restrict.
Training crawlers
GPTBot, ClaudeBot, meta-externalagent. They collect content for foundation models. Per OpenAI, disallowing GPTBot signals that your content should not be used in training, which makes blocking a data rights decision rather than a visibility one.
Retrieval bots
ChatGPT-User, OAI-SearchBot, PerplexityBot. They fetch pages in real time to answer a question inside an AI assistant. Blocking them removes you from AI search results.
Log Hero separates all three in your log, so you can decide per bucket instead of per guess.
Every request, not just every session
A log line carries what standard web tracking never records: the status code the server returned, how long it took and which agent asked for it. That is where crawl problems become visible. Redirect chains that burn crawl budget, missing URLs that bots keep requesting, server errors during peak crawl windows and pages that answer crawlers slowly.
Professional log file analysis, without ever opening a log file
Bot detection
Which bots visit your website. Every request is matched against a maintained list of AI crawlers, search engine bots and other agents, verified by IP address.
Status codes
The status code of every hit. Which pages answer 404 to a crawler that keeps coming back, and which redirect chains eat into the crawl.
Response time
How long your server took to answer, per bot and per path. Slow pages during a peak crawl window stop being a guess.
Requested paths
Which URLs actually get the attention. Pages, images, PDFs, robots.txt and sitemaps, all of it counted.
User agents
The full agent string behind each hit, so a training crawler is never confused with a live fetch on behalf of a person.
Human traffic stays anonymous
Log Hero reports bot activity. Requests from people are anonymised, so no personal data ends up in your reports and nothing has to be added to your pages.
Four steps to your first bot report
Log Hero reads standard access logs. No tracking script, no change to your pages.
Free.
No plan to choose, no card to enter.
Open your account
Sign in with your Google account and select the domain you want to track. Your bot data arrives in the Keyword Hero app, and Log Hero also creates a separate Google Analytics property for it as a raw source, ready for your own dashboards and analyses.
Connect your log source
Install the integration for your stack. It reads requests as your server answers them, so nothing has to be exported, parsed or stored on your side. Hits arrive within minutes.
Install an integration →Requests get classified
Status code, response time and requested path are already in the log line. Log Hero matches every request against a maintained list of AI crawlers, search engine bots and other agents, verified by their IP addresses.
Read it in the app or in GA
Every bot visit shows up in the Bot Activity report in your Keyword Hero account, in real time. The same data lands in your Google Analytics property, so segments, filters and explorations work the way you already know them.
What the pros say about log analysis
Log files are so underrated, so much good information in them.
Yes, that's still the case. Sometimes discouraging crawling is also helpful. Check your log files, they explain crawling of your site best.
Know who is consuming your content
Your visitors are not the only audience for your website. Search engines crawl it. AI platforms consume it. Log Hero makes it visible and turns bot activity into data you can analyze.
Free. Your account is ready in a minute.