# ========================================================== # Robots.txt for hutaifortho.com # Optimized for: Medical SEO, Crawl Budget & Anti-Scraping # ========================================================== User-agent: * Allow: / # 1. Allow Static & Media Assets for Mobile-First Rendering Allow: /media/ Allow: /static/ Allow: /*.js$ Allow: /*.css$ Allow: /*.png$ Allow: /*.jpg$ Allow: /*.jpeg$ Allow: /*.webp$ Allow: /*.svg$ # 2. Block Internal Tools, Command Center & Management Views Disallow: /admin/ Disallow: /wp-admin/ Disallow: /backend/ Disallow: /auth/ Disallow: /cmd/ Disallow: /admin-tools/ Disallow: /api/ Disallow: /ads/click/ # 3. Kill Search Crawl Traps & Infinite Query Loops Disallow: /ar/search/ Disallow: /en/search/ Disallow: /*/search/ Disallow: /*?words=* Disallow: /*?search=* Disallow: /*?s=* Disallow: /*?q=* Disallow: /*?filter=* # 4. Block Content Scrapers & Bandwidth Draining Bots User-agent: Baiduspider User-agent: Baiduspider-image User-agent: Bytespider User-agent: CCBot User-agent: GPTBot User-agent: SemrushBot User-agent: DotBot User-agent: AhrefsBot Disallow: / # ========================================================== # Master Sitemaps & RSS Feeds # ========================================================== Sitemap: https://hutaifortho.com/sitemap.xml Sitemap: https://hutaifortho.com/sitemap-ar-pages.xml Sitemap: https://hutaifortho.com/sitemap-en-pages.xml