Criteo Crawler is a software that visits web pages and analyzes its content to serve relevant ads on them.
- Category
- Advertising & Marketing
- Operator
- Criteo
- Documentation
- https://www.criteo.com/criteo-crawler/
- HTTP requests
CriteoBot/0.1 (+https://www.criteo.com/criteo-crawler/)
- robots.txtLearn more...
User-Agent: CriteoBot/ Disallow: /