Use cases such as training AI models or improving products by indexing content directly.
- Category
- AI Crawler
- Operator
- Meta
Use cases such as training AI models or improving products by indexing content directly.
meta-externalagent/1.1
meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)
User-Agent: meta-externalagent Disallow: /