Kagi Bot is the web crawler for the Kagi search engine. It crawls the web to build its own search index, which supports its ad-free search product.
- HTTP 요청
Mozilla/5.0 (compatible; Kagibot/1.0; +https://kagi.com/bot)
- robots.txt자세히 알아보기
User-Agent: Kagibot/ Disallow: /