Irresponsible crawling speed

5 votes

When crawling one's own site (as verified by GA/search console), allow higher crawl limits. The 25/sec limit should be lifted.

Done Suggested by: Kevin Upvoted: 11 Nov, '19 Comments: 0

Comments: 0