# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # Google allows some wildcards: https://support.google.com/webmasters/answer/6062596?hl=en&ref_topic=6061961 User-Agent: * Disallow: /admin/ Disallow: /*/my$ Disallow: /*/my/* Sitemap: https://auctionet-exports.s3-eu-west-1.amazonaws.com/sitemap.xml.gz