SEO Log File Analyser

295 votes

SEO Log File Analyser allows you to upload your log files, verify search engine bots, identify crawled URLs and analyse search bot data and behaviour for invaluable SEO insight.

Under consideration Suggested by: Lukasz (16 Oct, '17) • Upvoted: 14 Mar • Comments: 19

Comments: 19

14 Dec, '17
Kieran
If you implement this, would be nice if you could input a SSH or SFTP details, specify log file path location(s), specify type (nginx/Apache) and pull that data in rather than manually uploading a file...
21 Dec, '17
Pawel Merged
Something like this: https://www.screamingfrog.co.uk/log-file-analyser/
13 Jan, '18
Gary
I agree this would help a lot in the technical SEO analysis of a sites pages. Id love to see the data on single url analysis that can pull in the info from the log files to also show me when Googlebot desktop/mobile last visited the url or how many times etc... Could use this info to compare to number of inbound links to the page to see if could be improved, if the page is reporting too many 5xx,404 errors from the log files too etc...
06 Apr, '18
Gael de Kerdanet
This is the only thing IMO that would make you the BEST tool on the market! Everything else I have seen you doing is already AWESOME, pushing you to the top tier of the tools out there (and trust me, I have tried and tested almost every one of them!) - but to be able to actually able to check sitemap vs crawl vs robots crawl vs ga... with a tool as pleasant to use as yours? THAT would make it a cut above the rest...
11 Jun, '18
Claude
I agree with other comments, this would give you a serious advantage over the competition, if you could have the capability to interact with the crawler like OnCrawl, it would be perfect!
26 Jun, '18
Kyle
Looking at how to integrate pulling logs from CDN would be amazing as well, if possible (e.g. cloudflare). Typically w/ CDN in place, server logs don't contain accurate data, so you need to go to the intermediary.
09 Jul, '18
Admin
"Apache/Nginx log file analyzer" (suggested by Pawel on 2017-12-21), including upvotes (2) and comments (0), was merged into this suggestion.
19 Jul, '18
Lukasz Merged
https://www.screamingfrog.co.uk/log-file-analyser/
23 Jul, '18
Admin
"Log analiser" (suggested by Lukasz on 2018-07-19), including upvotes (1) and comments (0), was merged into this suggestion.
18 Oct, '18
Francesco Merged
It would be a perfect tool!
23 Oct, '18
Admin
"SEO Logfile Analyse" (suggested by Francesco on 2018-10-18), including upvotes (1) and comments (0), was merged into this suggestion.
27 Jun, '19
Lloyd Silver
We'd really like this. With another tool we used in the past, we could just import data from Screaming Frog Log File Analyzer into the tool for further analysis. So when combined with google search console, google analytics, inlink, etc. it could extra different hints like indexed pages that weren't crawled or pages with traffic that weren't crawled, noindexed pages that were crawled, etc. Would be super helpful.
24 Jul, '19
Anna
I agree with comments above. SEO log file analyzer would be very useful.
23 Dec, '19
Rajiv Singha
Seriously! A log analyzer paired with Sitebulb would be so awesome. Please bring this to life :)
12 May, '20
Amir
It'd be awesome to have this feature.
17 May, '20
Suganthan Mohanadasan
Do it (In Arnould's voice)

Make sure we can integrate it with Cloudflare :D
23 Aug, '20
Chris Smith
Another vote for adding logfile analysis to Sitebulb. 👍🏽
08 Dec, '21
Mark H
Please do this. It would bring a lot of value to the tool and reduce the competitive advantage other tools have, like DeepCrawl, OnCrawl, and Screaming Frog.
17 Aug, '23
Anthony Lavall
Perhaps server log file integration becomes more viable in Sitebulb's new world of cloud-based crawling? We'd all still love to see it as I'm sure you know. Will buy you both a Chomp bar from the vending machine if it becomes a feature.