Bot Information for Botify Verified

SiteCrawler, part of the Botify Analytics suite, gives enterprise SEO teams the power to evaluate the structure and content of their websites just like a search engine

Category
Operator
Botify
AccessIndicates who drives the bot's activity. Bots with "direct" access are controlled directly by their operator, while bots with "intermediary" access can be controlled by end users.
Direct

User agent

Copy link
HTTP requests
Desktop: Mozilla/5.0 (compatible; botify; http://botify.com)
Desktop: Mozilla/5.0 (compatible; botify; http://botify.com)
robots.txtLearn more...
User-Agent: botify
Disallow: /

HTTP traffic from Botify

Copy link

HTTP requests from the specified bot over the selected time period

Learn more...