CoostiBot crawls merchant websites for Coosti.dk, a Danish price comparison platform. Respects robots.txt
- Category
- Aggregator
- Operator
- Coosti ApS
- Documentation
- https://coosti.dk
- HTTP requests
Mozilla/5.0 (compatible; CoostiBot/1.0; +https://coosti.dk/bot-info)
- robots.txtLearn more...
User-Agent: CoostiBot Disallow: /