Semrushbot crawls your website to analyze it for different SEO and technical issues.
- Category
- Search Engine Optimization
- Operator
- Semrush
- Documentation
- https://www.semrush.com/bot/
- HTTP requests
Mozilla/5.0 (compatible; SemrushBot-SA/0.97; +http://www.semrush.com/bot.html)
- robots.txtLearn more...
User-Agent: SemrushBot-SA Disallow: /