Kagi Bot is the web crawler for the Kagi search engine. It crawls the web to build its own search index, which supports its ad-free search product.
- Kategorie
- Suchmaschinen-Crawler
- Operator
- Kagi
- Dokumentation
- https://kagi.com
- HTTP-Anfragen
Mozilla/5.0 (compatible; Kagibot/1.0; +https://kagi.com/bot)
- robots.txtMehr erfahren ...
User-Agent: Kagibot/ Disallow: /