Fixing X-Robots-Tag noindex errors in Next.js with Cloudflare
Summary A high-growth SaaS platform encountered a critical discrepancy between their local validation and Google Search Console (GSC) reporting. While the team verified that HTML <meta> tags were correct and manually tested URLs using Googlebot user-agents, GSC consistently flagged pages with the error: “Excluded by ‘noindex’ tag – ‘noindex’ detected in ‘X-Robots-Tag’ HTTP header.” The … Read more