User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # XML Sitemaps Sitemap: https://yachtchartersofmiami.com/sitemap_index.xml Sitemap: https://yachtchartersofmiami.com/page-sitemap.xml Sitemap: https://yachtchartersofmiami.com/post-sitemap.xml Sitemap: https://yachtchartersofmiami.com/category-sitemap.xml Sitemap: https://yachtchartersofmiami.com/local-sitemap.xml Sitemap: https://yachtchartersofmiami.com/rank_math_locations-sitemap.xml Sitemap: https://yachtchartersofmiami.com/speedboats-sitemap.xml Sitemap: https://yachtchartersofmiami.com/yacht-charters-activ-sitemap.xml # Block known bad scrapers / bots User-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: SemrushBot Disallow: / User-agent: dotbot Disallow: / User-agent: MauiBot Disallow: / User-agent: BLEXBot Disallow: / # Optional — AI crawlers policy User-agent: GPTBot Allow: /llms.txt Disallow: /wp-admin/ Crawl-delay: 5 User-agent: ChatGPT-User Allow: /llms.txt Crawl-delay: 5 User-agent: ClaudeBot Allow: /llms.txt Crawl-delay: 5 User-agent: PerplexityBot Allow: /llms.txt Crawl-delay: 5 User-agent: Google-Extended Allow: /llms.txt # Contact for AI/Data crawling questions Contact: info@yachtchartersofmiami.com