Bot Information for Cloudflare Custom Error Page Crawler Verified

Cloulflare internal service that crawls customer error pages in order to serve them directly from our edge network.

Category
Operator
Cloudflare
AccessIndicates who drives the bot's activity. Bots with "direct" access are controlled directly by their operator, while bots with "intermediary" access can be controlled by end users.
Direct

User agent

Copy link
HTTP requests
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10; rv:60.0) Gecko/20100101 Firefox/60.0 Collapsify/0.6.0 node/v10.16.0
robots.txtLearn more...
User-Agent: Collapsify/
Disallow: /

HTTP traffic from Cloudflare Custom Error Page Crawler

Copy link

HTTP requests from the specified bot over the selected time period

Learn more...