Kagi Bot is the web crawler for the Kagi search engine. It crawls the web to build its own search index, which supports its ad-free search product.
- Categoria
- Crawler de motor de busca
- Operador
- Kagi
- Documentação
- https://kagi.com
- Pedidos HTTP
Mozilla/5.0 (compatible; Kagibot/1.0; +https://kagi.com/bot)
- robots.txtMais informações...
User-Agent: Kagibot/ Disallow: /