User-agent: * Disallow: /admin/ Disallow: /private/ Disallow: /config/ Disallow: /core/ Disallow: /devalt # Block parameterized iframe URLs Disallow: /*?iframeView=true$ Allow: / # Allow all major search engines User-agent: Googlebot Disallow: User-agent: Bingbot Disallow: # Block SemrushBot User-agent: SemrushBot Disallow: / # Sitemap link (non-www canonical) Sitemap: https://devalt.org/sitemap.xml # Optional: Add crawl delay if needed # Crawl-delay: 10