LOG HERO

MONITOR BOTS.
LIKE PEOPLE.
IN GA.
IN REAL TIME.

TRY HIM NOW
LEARN MORE
Image

Resources

See all crawled / requested resources from bots and humans. Whetherthey've requested an image, robots.txt files, or simply an URL, you'll see it in Google Analytics.

Botnames

See exactly which bots are crawling your site. You'll see all 10 different Google bots, Bing bots, etc. We even make sure that it is the bot that it claims it is by verifying their IP address against our list.

Pageviews

See how often bots are visiting your ULRs and resources and make sure to funnel them to your most valuable pages.

Google Analytics

GA is by far the best UI to monitor bots. You'll see how bots flow through your site as sessions in GA. Its powerful reporting and alert systems make it extremely handy.

Custom Dimensions

Log Hero gives you nine custom dimensions from Request Method to Botname to Hostname, so you can make sense of your logs. In GA you can correlate them with all relevant metrics.

GOOGLE ANALYTICS

TO MONITOR YOUR BOT BEHAVIOUR

After a quick sign up and the integration of one of our SDKs in your source code, Log Hero will capture any hit – whether it came from a human or a bot – and will upload it as a page view to Google Analytics. This way you can follow bots (and users that block trackers) around as if they were humans. Also, check out our powerful dashboards that help you visualize bots even better.

How does he

get your log data in GA?

1. Bot visit

Google and Bing regularly send their bots and spiders to crawl and index your website. Usually, you don’t see them in GA.

2. Add Integration

Log Hero has integrations for many servers and frameworks, such as Apache and WordPress. They catch all hits from bots.

3. Data in GA

Log Hero then uploads the hits as page views to a new GA property. This allows you to analyze Googlebots like never before.

WANT TO START WITH LOGFILE ANALYSIS BUT DON’T KNOW HOW? CHECK OUT OUR BEGINNERS’ GUIDE!

WHY YOU

SHOULD LOOK AT BOTS

GOOGLE AND BING INDEX YOUR SITE BY CRAWLING IT WITH BOTS.

UNDERSTANDING HOW THOSE BOTS BEHAVE ON YOUR SITE AND ADJUSTING  IT ACCORDINGLY IS THE KEY TO WINNING SEO.

GETTING AND ANALYZING THOSE LOG FILES IS A HUGE PAIN AND MOSTLY DONE BY ENTERPRISES. 

LOG HERO MAKES BOTS VISIBLE IN GOOGLE ANALYTICS AS IF THEY WERE PEOPLE AND TAKES THE PAIN OUT OF LOG ANALYSIS.

MONITOR HOW BOTS CRAWL YOUR SITE AND ADJUST YOUR INTERNAL LINKS, SITEMAPS AND META ROBOTS TO HAVE A MASSIVE HEADSTART OVER YOUR COMPETITION.

Win with the Keyword-Hero

LOG HERO’S

AWESOME FEATURES

Bot detection

Analyse which bots are indexing your website. Log Hero validates each search engine bot in real time to prevent fake user agents from distorting results.

Bot Origin

Find out the country of origin for each bot and which data centers Google, Bing et al. are using to crawl your website.

Device Category

Which devices are used by each bot to access your site? Mobile vs desktop vs tablet? Find out exactly how search engines are rendering your website.

Status Codes

Analyse the status codes of each website. Where are redirects hidden? Which sites are down permanently? When was your site unresponsive?

User Agents

Analyse the user agents that each bot is using. Are you crawled by competitors using crawlers such as Screaming frog, Rryte, etc?

Crawl Duration

How long does each bot need to download data from your website? Is your site performant enough for bots to visit you frequently?

WHAT THE PROS

SAY ABOUT LOG ANALYSIS

What are logs for?

Log file analyses help you understand how and how often search engines crawl your website and whether Google’s bots (or others) are finding and indexing all the URLs that are relevant to you. Find out whether crawling resources are wasted and whether your site is too slow to be indexed correctly!

What bots crawl my site?

Google alone maintains 10 different bots that may crawl your website! This includes the ‘standard’ Google Desktop Bot, but also the Google Mobile Bot and the Google Image Search Bot. Understand which content is crawled by each bot to achieve the optimal results for your budget.

What else can I do with it?

Apart from the ability to analyze your logs, Log Hero allows you to constantly monitor the status codes of your website in real time. Were your servers always up and running or temporarily unavailable?  How many bots or users see 404-errors? How do redirects affect my site?

4 Minutes

To SEE BOTS in GA

bots-in-google-analytics

Finish!!

See all bots in your GA account.

ALL OF HERO’S

AWESOME FEATURES

Bot Sources

Which links do the bots follow so they land your site? Identify strong and powerful links that generate bot traffic for your website.

Request Method

Which request method are bots using on your site? Do some bots execute PUT requests in addition to only GET requests?

User Detection

See users that have turned off Google Analytics or are blocking JavaScript entirely.

Sessions and User Assessment

Which sites are bots checking in one session? Is your site indexed by different bots and different data centers?

Real Time

Monitor in real time which bots are checking your website and which status codes it replies with. No more outdated logs!

Data Processing

Use Google Analytics’ features to analyze your data. For example, filter by segments, export CSV file and use GA’s APIs.

LOG HERO’S

MONTHLY PLANS

SIGN UP NOW AND KEEP YOUR BETA PRICES FOREVER

4 Minutes to see your Logs

Your subscription will be governed by Log Hero’s Terms and Conditions!

GET YOUR HERO NOW!

That dude is gonna give you a significant competitive advantage.