Bot Information for MirrorWebCrawler Verified

User agent

Copy link
HTTP requests
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.97 Safari/537.36 +https://www.mirrorweb.com
robots.txtLearn more...
User-Agent: mirrorweb
Disallow: /

HTTP traffic from MirrorWebCrawler

Copy link

HTTP requests from the specified bot over the selected time period

Learn more...