User-agent: * Sitemap: https://experiences.travelloapp.com/sitemap.xml Disallow: /*/api$ Disallow: /*/api/ Disallow: /api/ Disallow: /api Disallow: /*/admin$ Disallow: /admin/ Disallow: /book/ Disallow: /*/book$ Disallow: /merchant/ Disallow: /*?categories=* # Block imgproxy from all bots Disallow: /imgproxy/ # Disable the specific Googlebot/Googlebot-image sections # so they follow the "User-agent: *" rules above. # ---------------------------------------------------------------------------------- # User-agent: Googlebot # Disallow: # # User-agent: Googlebot-image # Disallow: