# Costa Taxi CY — robots.txt User-agent: * Allow: / Disallow: /admin Disallow: /admin/* Disallow: /driver Disallow: /driver/* Disallow: /payment/* # Give the Google crawler explicit priority (Search Console tip) User-agent: Googlebot Allow: / Disallow: /admin Disallow: /driver Disallow: /payment/* User-agent: Bingbot Allow: / Disallow: /admin Disallow: /driver # Block AI training scrapers — protects content freshness for search User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CCBot Disallow: / Sitemap: https://costataxicy.com/sitemap.xml