# https://www.customervector.com/robots.txt User-agent: * Allow: / # Featured images are referenced as og:image and in-article art, so they must # stay crawlable. This Allow is listed before the Disallow below because the # longer, more specific rule wins. Allow: /content/images/ # Raw article JSON. Every article is prerendered to real HTML at # /resources//; the JSON behind it is data, not a page. Disallow: /content/ # Post-purchase and in-app flows. Also noindex in the markup. Disallow: /checkout # Stripe appends ?session_id=... on return from checkout. Keep those out of # the index so a paid session URL is never crawled or indexed. Disallow: /*?session_id= Sitemap: https://www.customervector.com/sitemap.xml