Bot Information for Netcraft Verified

About

Copy link

The Netcraft Survey Agent is a bot that analyzes web server technology stacks for their Web Server Survey.

Category
Operator
Netcraft
AccessIndicates who drives the bot's activity. Bots with "direct" access are controlled directly by their operator, while bots with "intermediary" access can be controlled by end users.
Direct
Documentation
https://www.netcraft.com/

User agent

Copy link
HTTP requests
Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com)
Mozilla/4.0 (compatible; Netcraft Web Server Survey)
robots.txtLearn more...
User-Agent: Netcraft
Disallow: /

HTTP traffic from Netcraft

Copy link

HTTP requests from the specified bot over the selected time period

Learn more...