Forum

Thread tagged as: Problem, Runway

Images uploaded to default S3 bucket not processed

Perch Runway is having problems processing some jpgs uploaded to the default (S3) bucket but not others.

Here are 2 images from the same batch: 1) https://www.dropbox.com/s/x0y4pzela7zb9e7/Southern%20Int%204.jpg?dl=0 2) https://www.dropbox.com/s/0ud72qhzf297u7b/Southern%20Int%205.jpg?dl=0

Both images have been resized / reduced to 72dpi & batch saved from Photoshop (saved as jpg, quality 10).

When uploaded directly into the assets panel (not using a template) & default S3 bucket ('assets-cdn') selected, the first image uploads fine & a thumbnail is created for it. The second image gets uploaded ok (the file is there on the download link after it says 'Successfully updated' ), but it doesn't get processed, i.e. no thumbnail is generated, and when you re-open the image in the assets panel, the download link is gone.

I also tried duplicating the second image, renaming it then uploading again but same problem. It seems to get processed fine when I uploaded it to another install of Perch (normal / non S3) and if I 'save for web' out of photoshop as opposed to 'save as jpg', it also uploads and gets processed fine. That's fine for me to do in this situation but not so easy for the client.

Any ideas why the 2nd image (& others) aren't being processed? Anyone else experience these issues with the S3 implementation?

Perch Runway: 3.0.14
Production mode: Production (100)
Installed apps: content (3.0.14), assets (3.0.14), categories (3.0.14), perch_blog (5.6.1), perch_forms (1.10)
DB driver: PDO
DB tables: perch2_backup_plans (0), perch2_backup_resources (0), perch2_backup_runs (0), perch2_blog_authors (5), perch2_blog_comments (0), perch2_blog_index (856), perch2_blog_posts (17), perch2_blog_posts_to_tags (51), perch2_blog_sections (1), perch2_blog_tags (48), perch2_blog_webmention_queue (0), perch2_blogs (1), perch2_categories (102), perch2_category_counts (5), perch2_category_sets (5), perch2_collection_index (72837), perch2_collection_items (459), perch2_collection_revisions (60), perch2_collections (2), perch2_content_index (9616), perch2_content_items (345), perch2_content_locks (1), perch2_content_regions (73), perch2_forms (3), perch2_forms_responses (997), perch2_menu_items (12), perch2_navigation (1), perch2_navigation_pages (6), perch2_page_routes (10), perch2_page_templates (21), perch2_pages (44), perch2_resource_log (39224), perch2_resource_tags (172), perch2_resources (6328), perch2_resources_to_tags (1023), perch2_settings (35), perch2_user_passwords (7), perch2_user_privileges (43), perch2_user_role_buckets (4), perch2_user_role_privileges (41), perch2_user_roles (3), perch2_users (10)
Users: 10
App runtimes:
<?php
    $apps_list = [
        'perch_blog',
        'perch_forms',
    ];
Scheduled tasks for perch_blog: delete_spam_comments (1440 mins), publish_posts (1 mins), process_webmentions (1 mins)
Editor plug-ins:
H1: d2c574764488da5a1464b2d0ae09acdd
L1: 7fd80df947dc33688c5a673b45308b30
F1: 3b606135b33e6a102526838f4152a807
headerColour: #57726e
content_singlePageEdit: 1
helpURL:
siteURL: /
hideBranding: 0
content_collapseList: 1
lang: en-gb
update_2.8.32: done
update_runway_3.0: done
headerScheme: dark
update_runway_2.8.32: done
latest_version:
on_sale_version:
update_runway_2.8.34: done
perch_blog_update: 5.6
perch_blog_post_url: /blog/{postSlug}
perch_blog_site_name:
perch_blog_slug_format: %Y-%m-%d-{postTitle}
perch_blog_akismet_key:
perch_blog_max_spam_days: 0
dashboard: 1
hide_pwd_reset: 0
content_hideNonEditableRegions: 0
content_frontend_edit: 0
perch_blog_comment_notify: 0
siteOffline: 0
update_runway_3.0.1: done
update_runway_3.0.2: done
update_runway_3.0.4: done
update_runway_3.0.10: done
update_runway_3.0.11: done
update_runway_3.0.14: done
PERCH_DEVELOPMENT: 10
PERCH_STAGING: 50
PERCH_PRODUCTION: 100
PERCH_DB_DATABASE: hiddenir_db
PERCH_DB_USERNAME: hiddenir_user
PERCH_PRODUCTION_MODE: 100
PERCH_DB_SERVER: localhost
PERCH_DB_PREFIX: perch2_
PERCH_EMAIL_FROM: adam@bristlebird.com
PERCH_EMAIL_FROM_NAME: Adam Green
PERCH_LOGINPATH: /perch
PERCH_PATH: /home/hiddenireland/public_html/perch
PERCH_CORE: /home/hiddenireland/public_html/perch/core
PERCH_RESFILEPATH: /home/hiddenireland/public_html/perch/resources
PERCH_RESPATH: https://cdn.hiddenireland.com
PERCH_DEFAULT_BUCKET: assets-cdn
PERCH_HTML5: 1
PERCH_TZ: UTC
PERCH_RWD: 1
PERCH_GMAPS_API_KEY: AIzaSyCnjtZG92WPkkTQD5KafpwKjShxeVDfIts
PERCH_MAP_JS: /js/min/perch_public_maps-min.js
PERCH_TEMPLATE_FILTERS: 1
PERCH_SSL: 1
PERCH_RUNWAY: 1
PERCH_ERROR_MODE: DIE
PERCH_DATE_LONG: %d %B %Y
PERCH_DATE_SHORT: %d %b %Y
PERCH_TIME_SHORT: %H:%M
PERCH_TIME_LONG: %H:%M:%S
PERCH_RUNWAY_ROUTED:
PERCH_STRONG_PASSWORDS:
PERCH_ASSET_VERSION: f704e7442d11292c99b5
PERCH_DEBUG:
PERCH_PREVIEW_ARG: preview
PERCH_TEMPLATE_PATH: /home/hiddenireland/public_html/perch/templates
PERCH_DEFAULT_DOC: index.php
PERCH_DEFAULT_EXT: .php
PERCH_XHTML_MARKUP:
PERCH_HTML_ENTITIES:
PERCH_STRIPSLASHES:
PERCH_PROGRESSIVE_FLUSH: 1
PERCH_PARANOID:
PERCH_FORCE_SECURE_COOKIES:
PERCH_TRANSLATION_ASSIST:
PERCH_PASSWORD_MIN_LENGTH: 6
PERCH_MAX_FAILED_LOGINS: 10
PERCH_AUTH_LOCKOUT_DURATION: 1 HOUR
PERCH_VERIFY_UPLOADS:
PERCH_PRIV_ASSIST:
PERCH_CUSTOM_EDITOR_CONFIGS:
PERCH_ENABLE_EXIF: 1
PERCH_AUTH_PLUGIN:
PERCH_DB_CHARSET: utf8
PERCH_DB_PORT:
PERCH_DB_SOCKET:
PERCH_APPS_EDITOR_PLUGIN: markitup
PERCH_APPS_EDITOR_MARKUP_LANGUAGE: markdown
Hosting settings
PHP: 7.0.27
Zend: 3.0.0
OS: Linux
SAPI: fpm-fcgi
Safe mode: not detected
MySQL client: mysqlnd 5.0.12-dev - 20150407 - $Id: b5c5906d452ec590732a93b051f3827e02749b83 $
MySQL server: 5.6.38
Free disk space: 5.96 GB
Extensions: Core, date, libxml, openssl, pcre, zlib, filter, hash, Reflection, SPL, session, standard, cgi-fcgi, bcmath, calendar, ctype, curl, dom, fileinfo, ftp, gd, iconv, imap, json, mbstring, mcrypt, mysqlnd, PDO, Phar, posix, SimpleXML, sockets, sqlite3, tokenizer, xml, xmlwriter, xsl, zip, mysqli, pdo_mysql, pdo_sqlite, wddx, xmlreader, Zend OPcache
GD: Yes
ImageMagick: No
PHP max upload size: 64M
PHP max form post size: 64M
PHP memory limit: 512M
Total max uploadable file size: 64M
Resource folder writeable: Yes
Session timeout: 24 minutes
Native JSON: Yes
Filter functions: Yes
Transliteration functions: No
USER: hiddenireland
HOME: /home/hiddenireland
SCRIPT_NAME: /perch/core/settings/diagnostics/index.php
REQUEST_URI: /perch/core/settings/diagnostics/?extended
QUERY_STRING: extended
REQUEST_METHOD: GET
SERVER_PROTOCOL: HTTP/1.1
GATEWAY_INTERFACE: CGI/1.1
REMOTE_PORT: 50864
SCRIPT_FILENAME: /home/hiddenireland/public_html/perch/core/settings/diagnostics/index.php
SERVER_ADMIN: webmaster@hiddenireland.com
CONTEXT_DOCUMENT_ROOT: /home/hiddenireland/public_html
REQUEST_SCHEME: https
DOCUMENT_ROOT: /home/hiddenireland/public_html
REMOTE_ADDR: 95.83.249.66
SERVER_PORT: 443
SERVER_ADDR: 78.31.107.104
SERVER_NAME: hiddenireland.com
SERVER_SOFTWARE: Apache
PATH: /usr/local/jdk/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/usr/X11R6/bin:/usr/local/bin:/usr/X11R6/bin:/root/bin:/opt/bin
HTTP_X_HTTPS: 1
HTTP_COOKIE: PHPSESSID=u67l0t856fth72ub7v775htnc1; cmsa=1
HTTP_ACCEPT_LANGUAGE: en-US,en;q=0.9
HTTP_ACCEPT_ENCODING: gzip, deflate, br
HTTP_REFERER: https://hiddenireland.com/perch/core/settings/diagnostics/
HTTP_ACCEPT: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8
HTTP_USER_AGENT: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/64.0.3282.186 Safari/537.36
HTTP_UPGRADE_INSECURE_REQUESTS: 1
HTTP_CACHE_CONTROL: no-cache
HTTP_PRAGMA: no-cache
HTTP_CONNECTION: keep-alive
HTTP_HOST: hiddenireland.com
proxy-nokeepalive: 1
SSL_TLS_SNI: hiddenireland.com
HTTPS: on
proto: https
SCRIPT_URI: https://hiddenireland.com/perch/core/settings/diagnostics/
SCRIPT_URL: /perch/core/settings/diagnostics/
UNIQUE_ID: Wpmh4wvfxNqVnK8YDSDELwAAAAk
FCGI_ROLE: RESPONDER
PHP_SELF: /perch/core/settings/diagnostics/index.php
REQUEST_TIME_FLOAT: 1520017891.2341
REQUEST_TIME: 1520017891
argc: 1
Adam Green

Adam Green 0 points

  • 3 years ago
Drew McLellan

Drew McLellan 2638 points
Perch Support

That sounds like it could perhaps be a corrupt image header or something like that. What’s the source of the image? Do you have other files from the same source?

Thanks Drew, sounds like that might be the case. I believe all the images came from the same camera taken on the same day & about half of the 16 didn't get processed - seems odd that some were fine & others not when all from same batch.

Clients just upload the massive 300dpi files they get given rather than reducing them first as recommended, then of course hit memory issues when Perch is trying process & resize!