503 Errors – AWS Elastic Beanstalk

  • rubberbullets

    (@rubberbullets)


    2 years, 3 months ago

    We are experiencing 503 Service Unavailable and 504 Gateway errors when using this plugin in the Admin area. We don’t get the errors anywhere else within the application.

    The site runs in an auto-scaled environment on AWS Elastic Beanstalk, with load balancer. Minimum 2 EC2 instances (max 8). The platform used is PHP 7.4 running on 64bit Amazon Linux 2/3.3.9. WordPress version 5.8.3. Plugins are up to date.

    Does anyone else here have a similar set up and share similar difficulties? It is becoming incredibly hard to debug.

    * File upload shows no error but does not appear in the folder
    * Cannot create or rename a folder without a 503 error
    * Processing files in the Media Library Maintenance section fails with a 503 error

    Additionally, logs indicate that proxy_fcgi errors are occuring. Examples:

    “[Thu Jan 20 00:40:23.811525 2022] [proxy_fcgi:error] [pid 6371:tid 140649982564096] (70007)The timeout specified has expired: [client [IP]:41968] AH01075: Error dispatching request to : (polling), referer: https://[SITE]/wp-admin/admin.php?page=media-library-folders”

    “[Thu Jan 20 00:40:23.811525 2022] [proxy_fcgi:error] [pid 6371:tid 140649982564096] (70007)The timeout specified has expired: [client [IP]:41968] AH01075: Error dispatching request to : (polling), referer: https://[SITE]/wp-admin/admin.php?page=media-library-folders”

    “[Thu Jan 20 03:06:18.292424 2022] [proxy_fcgi:error] [pid 29596:tid 140264519739136] [client [IP]:55354] AH01067: Failed to read FastCGI header, referer: https://[SITE]/wp-admin/admin.php?page=media-library-folders”

    “[Thu Jan 20 03:06:18.292504 2022] [proxy_fcgi:error] [pid 29596:tid 140264519739136] (104)Connection reset by peer: [client [IP]:55354] AH01075: Error dispatching request to : , referer: https://[SITE]/wp-admin/admin.php?page=media-library-folders”

    Any direction on this would be amazing.

Viewing 3 replies - 1 through 3 (of 3 total)
  • Thread Starter rubberbullets

    (@rubberbullets)

    2 years, 3 months ago

    Update:

    * Switched to a single EC2 instance to run tests outside of the scaled environment.
    * Tested processing a single ‘import’ action in Media Library Maintenance and it failed with a 503 Error.
    * Success: Created folder directly under /uploads
    * Failed: Creating a nested folder deeper down
    * Failed: Uploading a file into a nested folder

    I’m not even sure if all the issue above have the same root cause.

    Continue to get this error:

    [Thu Jan 20 05:00:15.526783 2022] [proxy_fcgi:error] [pid 7365:tid 139627180537600] [client [HIDDEN]:64944] AH01067: Failed to read FastCGI header, referer: https://[HIDDEN]/wp-admin/admin.php?page=mlfp-maintenance
[Thu Jan 20 05:00:15.527613 2022] [proxy_fcgi:error] [pid 7365:tid 139627180537600] (104)Connection reset by peer: [client [HIDDEN]:64944] AH01075: Error dispatching request to : , referer: https://[HIDDEN]/wp-admin/admin.php?page=mlfp-maintenance

    And it corresponds in access logs to:

    10.183.2.140 - - [20/Jan/2022:05:00:12 +0000] "POST /wp-admin/admin-ajax.php HTTP/1.1" 503 299 "https://[HIDDEN]/wp-a
dmin/admin.php?page=mlfp-maintenance" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.
4692.71 Safari/537.36 Edg/97.0.1072.62"

    The “client” in this case seems to indicate the load balancer.

    —-

    I just found this too (which may separate file/folder errors for the 503 errors):

    [20-Jan-2022 05:00:12 UTC] PHP Warning: unlink(/var/app/current/wp-content/uploads/Digital-Assets-2021/Webinar-Wallpaper/BHGRE-Google-Meets-Wallpaper-2.jpg): Permission denied in /var/app/current/wp-content/plugins/media-library-folders-pro-s3-addon/media-library-folders-pro-s3-addon.php on line 1789

    Thread Starter rubberbullets

    (@rubberbullets)

    2 years, 3 months ago

    Update:

    Resolved: Folder and file management has been resolved after discovering a file system permission issue on the Amazon EFS we store the /uploads files on (shared between instances). Apparently when upgrading from Linux 2018.03 to Linux 2 (to get to PHP7.4) web app ID changes.

    Fix: sudo chown -R webapp.webapp /efs/{mydrive}

    Unresolved: 503 and 504 errors. This is much less of a problem than file perms so I’ll continue investigating.

    Plugin Author AlanP57

    (@alanp57)

    2 years, 3 months ago

    Ok, thank you for the update.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘503 Errors – AWS Elastic Beanstalk’ is closed to new replies.