ICC Crawler

NICT · ucri.nict.go.jp (opens in new tab)

ICC-Crawler automatically crawls the Internet and collects web pages. ICC-Crawler is operated by the Universal Communication Research Institute at the National Institute of Information and Communications Technology (NICT).

Identity

How this bot identifies itself and what it does with content

Access level

Direct

Reaches origins directly, under its own identity

Content use

Full

Retained and reused, e.g. for model training or an index

User agent

  • ICC-Crawler/3.0 (Mozilla-compatible; ; https://ucri.nict.go.jp/en/icccrawler.html)

Traffic

Requests from this bot across the Cloudflare network

HTTP traffic from ICC Crawler

HTTP requests from the specified bot over the selected time period

Learn more... (opens in new tab)