# Turbo Website Reviewer - PHP Script User-agent: * Crawl-delay: 18 Disallow: /admin/ Disallow: /core/ Disallow: /resources/ Disallow: /uploads/ User-agent: SemrushBot Crawl-delay: 60 User-agent: MJ12bot Disallow: /