SEO Log File Analyser
SEO Log File Analyser allows you to upload your log files, verify search engine bots, identify crawled URLs and analyse search bot data and behaviour for invaluable SEO insight.
Under consideration Suggested by: Lukasz • Upvoted: 11 Mar • Comments: 18
If you implement this, would be nice if you could input a SSH or SFTP details, specify log file path location(s), specify type (nginx/Apache) and pull that data in rather than manually uploading a file...
Something like this: https://www.screamingfrog.co.uk/log-file-analyser/
I agree this would help a lot in the technical SEO analysis of a sites pages. Id love to see the data on single url analysis that can pull in the info from the log files to also show me when Googlebot desktop/mobile last visited the url or how many times etc... Could use this info to compare to number of inbound links to the page to see if could be improved, if the page is reporting too many 5xx,404 errors from the log files too etc...
Gael de Kerdanet
This is the only thing IMO that would make you the BEST tool on the market! Everything else I have seen you doing is already AWESOME, pushing you to the top tier of the tools out there (and trust me, I have tried and tested almost every one of them!) - but to be able to actually able to check sitemap vs crawl vs robots crawl vs ga... with a tool as pleasant to use as yours? THAT would make it a cut above the rest...
I agree with other comments, this would give you a serious advantage over the competition, if you could have the capability to interact with the crawler like OnCrawl, it would be perfect!
Looking at how to integrate pulling logs from CDN would be amazing as well, if possible (e.g. cloudflare). Typically w/ CDN in place, server logs don't contain accurate data, so you need to go to the intermediary.
"Apache/Nginx log file analyzer" (suggested by Pawel on 2017-12-21), including upvotes (2) and comments (0), was merged into this suggestion.
"Log analiser" (suggested by Lukasz on 2018-07-19), including upvotes (1) and comments (0), was merged into this suggestion.
It would be a perfect tool!
"SEO Logfile Analyse" (suggested by Francesco on 2018-10-18), including upvotes (1) and comments (0), was merged into this suggestion.
We'd really like this. With another tool we used in the past, we could just import data from Screaming Frog Log File Analyzer into the tool for further analysis. So when combined with google search console, google analytics, inlink, etc. it could extra different hints like indexed pages that weren't crawled or pages with traffic that weren't crawled, noindexed pages that were crawled, etc. Would be super helpful.
I agree with comments above. SEO log file analyzer would be very useful.
Seriously! A log analyzer paired with Sitebulb would be so awesome. Please bring this to life :)
It'd be awesome to have this feature.
Do it (In Arnould's voice)
Make sure we can integrate it with Cloudflare :D
Another vote for adding logfile analysis to Sitebulb. 👍🏽
Please do this. It would bring a lot of value to the tool and reduce the competitive advantage other tools have, like DeepCrawl, OnCrawl, and Screaming Frog.