Bot Information for Cloudflare Custom Error Page Crawler Verified

About

Cloulflare internal service that crawls customer error pages in order to serve them directly from our edge network.

Category
Operator
Cloudflare
AccessIndicates who drives the bot's activity. Bots with "direct" access are controlled directly by their operator, while bots with "intermediary" access can be controlled by end users.
Direct

User agent

HTTP requests
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10; rv:60.0) Gecko/20100101 Firefox/60.0 Collapsify/0.6.0 node/v10.16.0
robots.txtLearn more...
User-Agent: Collapsify/
Disallow: /

HTTP traffic from Cloudflare Custom Error Page Crawler

HTTP requests from the specified bot over the selected time period

Learn more...