Data collected by SEMrushBot is used for the SEO Writing Assistant tool to check if URL is accessible
- Category
- AI Crawler
- Operator
- Semrush
- Documentation
- https://www.semrush.com/swa/
- HTTP requests
Mozilla/5.0 (compatible; SemrushBot-SWA/0.1; +http://www.semrush.com/bot.html)
- robots.txtLearn more...
User-Agent: SemrushBot-SWA/ Disallow: /