The Terracotta bot scrapes websites for use in generating indices for serving searches using Ceramic's search product.
- Category
- Search Engine Crawler
- Operator
- Ceramic
- Documentation
- https://github.com/CeramicTeam/CeramicTerracotta
The Terracotta bot scrapes websites for use in generating indices for serving searches using Ceramic's search product.
Terracotta
Terracotta-News
User-Agent: Terracotta Disallow: /