CognitiveSEO is an SEO toolset that crawls the web and analyzes links.
- Category
- Search Engine Optimization
- Documentation
- cognitiveseo.com
- HTTP requests
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3809.87 Safari/537.36 - James BOT - WebCrawler http://cognitiveseo.com/bot.html
- robots.txtLearn more...
User-Agent: James BOT Disallow: /