The Terracotta bot scrapes websites for use in generating indices for serving searches using Ceramic's search product.
- Category
- Search Engine Crawler
- Operator
- Ceramic
- Documentation
- https://github.com/CeramicTeam/CeramicTerracotta
- HTTP requests
Terracotta
Terracotta-News
- robots.txtLearn more...
User-Agent: Terracotta Disallow: /