Applebot-Extended: what it is and how to block it
A secondary token that lets publishers opt out of their content being used to train Apple’s foundation models (Apple Intelligence and related services).
Does Applebot-Extended follow robots.txt?
Apple says Applebot may still crawl pages you disallow for Applebot-Extended; the token governs how the data is used.
What blocking it does
Opts out of foundation-model training. Your site stays discoverable in Spotlight, Siri and Safari via Applebot.
Block Applebot-Extended everywhere
User-agent: Applebot-Extended
Disallow: /
Block only some folders
User-agent: Applebot-Extended
Disallow: /members/
Disallow: /drafts/
Explicitly allow it
User-agent: Applebot-Extended
Allow: /
A group that names Applebot-Extended replaces the * group for it. Copy any shared rules into this group too. Test the result.
Applebot-Extended questions
What is Applebot-Extended?
Applebot-Extended is operated by Apple. A secondary token that lets publishers opt out of their content being used to train Apple’s foundation models (Apple Intelligence and related services).
How do I block Applebot-Extended?
Add "User-agent: Applebot-Extended" followed by "Disallow: /" to your robots.txt. Apple says Applebot may still crawl pages you disallow for Applebot-Extended; the token governs how the data is used.
What happens if I block Applebot-Extended?
Opts out of foundation-model training. Your site stays discoverable in Spotlight, Siri and Safari via Applebot.