Forum

Thread tagged as: Configuration, Hosting

Googlebot cannot crawl my site

Hi guys

I've got a really odd problem. My site works fine, but I google and applications that try to access it like https://technicalseo.com/seo-tools/robots-txt/
Fail with 500 error message.

I have no idea how to debug / resolve this. I'm confident its not a perch issue, but desperate for a resolution, so any help would be appreciated.

My site URL www.glsescouts.org.uk

SUMMARY INFORMATION

Perch: 2.8.31, PHP: 5.6.31, MySQL: mysqlnd 5.0.11-dev - 20120503 - $Id: 76b08b24596e12d4553bd41fc93cccd5bac2fe7a $, with PDO
Server OS: Linux, litespeed
Installed apps: content (2.8.31), assets (2.8.31), categories (2.8.31), perch_blog (5.0), perch_twitter (2.0.1)
App runtimes: <?php include(PERCH_PATH.'/core/apps/content/runtime.php'); include(PERCH_PATH.'/addons/apps/perch_blog/runtime.php'); ?>
PERCH_LOGINPATH: /perch
PERCH_PATH: /home/glsesc/public_html/perch
PERCH_CORE: /home/glsesc/public_html/perch/core
PERCH_RESFILEPATH: /home/glsesc/public_html/perch/resources
Image manipulation: GD
PHP limits: Max upload 1024M, Max POST 1024M, Memory: 1024M, Total max file upload: 1024M
F1: 2edba60ed1f613d6dd804feb202456a2
Resource folder writeable: Yes
HTTP_HOST: www.glsescouts.org.uk
DOCUMENT_ROOT: /home/glsesc/public_html
REQUEST_URI: /perch/core/settings/diagnostics/
SCRIPT_NAME: /perch/core/settings/diagnostics/index.php
Paul Amass

Paul Amass 0 points

  • 3 years ago
Drew McLellan

Drew McLellan 2638 points
Perch Support

3 years ago

A 500 status response should correspond with an error message in your log file. Check for that.
Blake Myers

Blake Myers 0 points

3 years ago

Very odd ... when I click the link to your website above, I get an Internal Server Error 500 ... but when I right click, open in new tab ... I see your website. I think you have a server setting error or bug.
Paul Amass

Paul Amass 0 points

3 years ago

Route cause found in .htaccess - all sorted - thanks