Bot Information for Parse.ly Verified

User agent

Copy link
HTTP requests
Mozilla/5.0 (compatible; parse.ly scraper/0.16; +http://parsely.com)
robots.txtLearn more...
User-Agent: parsely.com
Disallow: /

HTTP traffic from Parse.ly

Copy link

HTTP requests from the specified bot over the selected time period

Learn more...