Chathive Crawler enables our customers to crawl their own websites, which is used to power their AI assistants.
- Category
- AI Assistant
- Operator
- Inteso Group BV
- Documentation
- https://developers.chathive.app/crawler/overview
- HTTP requests
ChathiveCrawler/1.0
- robots.txtLearn more...
User-Agent: ChathiveCrawler Disallow: /