The DeepCrawl bot crawls the websites of its customers to collect performance analytics and suggest SEO optimizations.
- Category
- Monitoring & Analytics
- Operator
- Lumar
- Documentation
- https://www.deepcrawl.com
- HTTP requests
lumar
- robots.txtLearn more...
User-Agent: lumar Disallow: /