Bot Information for MirrorWebCrawler Verified

We are a commercial web archiving supplier providing archival solutions for the financial and public sector.

AccessIndicates who drives the bot's activity. Bots with "direct" access are controlled directly by their operator, while bots with "intermediary" access can be controlled by end users.
Direct

User agent

Copy link
HTTP requests
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.97 Safari/537.36 +https://www.mirrorweb.com
robots.txtLearn more...
User-Agent: mirrorweb
Disallow: /

HTTP traffic from MirrorWebCrawler

Copy link

HTTP requests from the specified bot over the selected time period

Learn more...