Bot Information for NostoCrawlerBot Verified

User agent

Copy link
HTTP requests
Mozilla/5.0 (compatible; NostoCrawlerBot/1.0; +http://my.nosto.com/tagging)
robots.txtLearn more...
User-Agent: NostoCrawlerBot
Disallow: /

HTTP traffic from NostoCrawlerBot

Copy link

HTTP requests from the specified bot over the selected time period

Learn more...