Bot Information for All Africa Crawler Verified

AllAfrica Global Media produces, aggregates and distributes news from across Africa, relying on agreements with more than 140 news organizations and over 500 other institutions and individuals. The AllAfrica NewsBot scrapes content from sites with whom AllAfrica has written agreements, or whose content is available without licensing restrictions or otherwise freely distributable. In all cases, the author and institution is credited in full.

Category
AccessIndicates who drives the bot's activity. Bots with "direct" access are controlled directly by their operator, while bots with "intermediary" access can be controlled by end users.
Direct

User agent

Copy link
HTTP requests
Mozilla/5.0 (compatible; AllAfrica NewsBot/1.0)
robots.txtLearn more...
User-Agent: AllAfrica
Disallow: /

HTTP traffic from All Africa Crawler

Copy link

HTTP requests from the specified bot over the selected time period

Learn more...