Kagi Bot is the web crawler for the Kagi search engine. It crawls the web to build its own search index, which supports its ad-free search product.
- Категория
- Поисковый робот
- Оператор
- Kagi
- Документация
- https://kagi.com
- HTTP-запросы
Mozilla/5.0 (compatible; Kagibot/1.0; +https://kagi.com/bot)
- robots.txtУзнать больше...
User-Agent: Kagibot/ Disallow: /