Forum

Thread tagged as: Question, Problem, Error

X-robots-tag set to "noindex" on one collection

Today I discovered that one collection within my site wasn't being indexed by Google. When I used the Google Webmaster Tools to fetch a page within the section as the Google bot I noticed that the x-Robots-Tag was set to "noindex,follow". I then started troubleshooting, and immediately discovered that only one collection was showing this tag. After several hours of banging my head against the wall I discovered that removing the "Header set X-Robots-Tag "noindex, follow"" from the .htaccess within the /perch/ directory. I removed that and added an exclusion to my robots.txt file for the /perch/ directory.

The question is why is only one collection affected by this? And have I opened a massive security hole into my Perch Runway install?

Thanks for any insight.

Timothy Swan

Timothy Swan 0 points

  • 4 years ago
Drew McLellan

Drew McLellan 2638 points
Perch Support

That's not something we've set - we don't distribute a .htaccess file within the perch folder.

Hmm, I guess I'll have to check to see whether my server host put it there -- I sure didn't. Thanks for your response.