AhrefsBot is a Web Crawler that powers the 12 trillion link database for Ahrefs online marketing toolset. It constantly crawls web to fill our database with new links and check the status of the previously found ones to provide the most comprehensive and up-to-the-minute data to our users.
- Category
- Search Engine Optimization
- Operator
- Ahrefs
- Documentation
- http://ahrefs.com/robot/