Bot Information for OnCrawl Verified

About

Copy link

Enterprise SEO platform powered by the industry-leading SEO Crawler and Log Analyzer

Category
Operator
Oncrawl
AccessIndicates who drives the bot's activity. Bots with "direct" access are controlled directly by their operator, while bots with "intermediary" access can be controlled by end users.
Direct
Documentation
https://www.oncrawl.com/

User agent

Copy link
HTTP requests
Mozilla/5.0 (compatible; OnCrawl Mobile/1.0; +http://www.oncrawl.com/)
Mozilla/5.0 (iPhone; CPU iPhone OS 8_3 like Mac OS X) AppleWebKit/600.1.4 (KHTML, like Gecko) Version/8.0 Mobile/12F70 Safari/600.1.4 (compatible; OnCrawl Mobile/1.0; +http://www.oncrawl.com/)
robots.txtLearn more...
User-Agent: www.oncrawl.com
Disallow: /

HTTP traffic from OnCrawl

Copy link

HTTP requests from the specified bot over the selected time period

Learn more...