Internet Archive - Archive-It Bot Information

Internet Archive’s Archive-It service preserves publicly accessible web pages for the historical record.

Category: Data Collection
Operator: Archive-It
AccessIndicates who drives the bot's activity. Bots with "direct" access are controlled directly by their operator, while bots with "intermediary" access can be controlled by end users.: Direct
Documentation: https://archive-it.org/files/site-owners.html

HTTP requests: Mozilla/5.0 (X11; Linux x86_64; special_archiver; Archive-It; +http://archive-it.org/files/site-owners-special.html) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36
Mozilla/5.0 (X11; Linux x86_64; archive.org_bot; Archive-It; +http://archive-it.org/files/site-owners.html) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/130.0.0.0 Safari/537.36
Mozilla/5.0 (compatible; special_archiver; Archive-It; +@http://archive-it.org/files/site-owners-special.html)
Mozilla/5.0 (compatible; archive.org_bot; Archive-It; +@http://archive-it.org/files/site-owners.html)
robots.txtLearn more...: User-Agent: Archive-It Disallow: /

Bot Information for Internet Archive - Archive-It Verified