# ================================ # Allow major crawlers # ================================ # Google Search User-agent: Googlebot Crawl-delay: 10 Disallow: # Bing Search User-agent: Bingbot Crawl-delay: 10 Disallow: # Apple Search (Siri / Spotlight / Safari) User-agent: Applebot Crawl-delay: 10 Disallow: # ================================ # Block all other crawlers # ================================ User-agent: * Disallow: /