Forum
X-robots-tag set to "noindex" on one collection
Today I discovered that one collection within my site wasn't being indexed by Google. When I used the Google Webmaster Tools to fetch a page within the section as the Google bot I noticed that the x-Robots-Tag was set to "noindex,follow". I then started troubleshooting, and immediately discovered that only one collection was showing this tag. After several hours of banging my head against the wall I discovered that removing the "Header set X-Robots-Tag "noindex, follow"" from the .htaccess within the /perch/ directory. I removed that and added an exclusion to my robots.txt file for the /perch/ directory.
The question is why is only one collection affected by this? And have I opened a massive security hole into my Perch Runway install?
Thanks for any insight.
That's not something we've set - we don't distribute a
.htaccess
file within theperch
folder.Hmm, I guess I'll have to check to see whether my server host put it there -- I sure didn't. Thanks for your response.