URL crawl limit by folder option

URL crawl limit by url first path, where you can specify the maximum number of crawled URLs per folder.
This would allow crawling of larger complex sites, getting a sample form all page types.

Under consideration Suggested by: Longhand Upvoted: 03 Mar Comments: 0

Add a comment

0 / 1,000

* Your name will be publicly visible

* Your email will be visible only to moderators