# This is a robots.txt file that causes the 'production' # Google open source parser to misbehave. # # The old Search Console checker reported that Googlebot is # ALLOWED to crawl /bar/ which is incorrect - the "/" and everything # after it should be ignored. # # The open source parser will report that googlebot-image is # ALLOWED to crawl /bar/ which is incorrect - it should be blocked by # the googlebot rule in the absence of a ruleset targeting # googlebot-image. # # See: https://realrobotstxt.com/ for more information. User-agent: * Disallow: /foo/ User-agent: googlebot/1.2 Disallow: /bar/