User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /footer/ User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: OAI-SearchBot Disallow: / # Anthropic Claude Crawler User-agent: ClaudeBot Disallow: / # Google AI models User-agent: Google-Extended Disallow: / # Apple AI (Applebot-Extended) User-agent: Applebot-Extended Disallow: /