Problems with Scheduling and Remote Storage

  • ddayco

    (@ddayco)


    9 years, 1 month ago

    Using XCLoner ver 4.0.2

    Trying to schedule backups and send to AWS or Dropbox. The manual backup is 3GB, but when it’s scheduled it only gets part way. Last test was 118 mb, 53mb the time before.

    On the last test I disabled all other plugins, same result.

    Below are the last few lines of the log:

    [2017-03-25 03:08:00] php_system.INFO: E_NOTICE: array ( ‘type’ => 8, ‘message’ => ‘Undefined index: attachment_weight’, ‘file’ => ‘/var/www/vhosts/rkwinc.com/httpdocs/owfg-projects/wp-content/plugins/wp-media-folder/class/wpmf-fillter-size.php’, ‘line’ => 58, ) [] []
    [2017-03-25 03:07:07] php_system.INFO: E_NOTICE: array ( ‘type’ => 8, ‘message’ => ‘ob_end_clean(): failed to delete buffer. No buffer to delete’, ‘file’ => ‘/var/www/vhosts/rkwinc.com/httpdocs/owfg-projects/wp-content/plugins/xcloner-backup-and-restore/includes/class-xcloner-api.php’, ‘line’ => 927, ) [] []
    [2017-03-25 03:06:37] xcloner_file_system.INFO: Cleaning the backup storage on matching rules [] []
    [2017-03-25 01:35:56] xcloner_file_system.INFO: Cleaning the backup storage on matching rules [] []
    [2017-03-25 01:34:01] xcloner_archive.INFO: Adding 1579168 bytes of file wp-content/uploads/2015/09/L32398-005_art-outlined_SO_PW.pdf to archive backup_new.rkwinc.com-2017-03-25_01-33-sql-7acb8.tar [] []
    [2017-03-25 01:34:01] xcloner_archive.INFO: Adding 207418 bytes of file wp-content/uploads/2015/09/FUSILLI-Tracciato.pdf to archive backup_new.rkwinc.com-2017-03-25_01-33-sql-7acb8.tar [] []
    [2017-03-25 01:34:01] xcloner_archive.INFO: Adding 25889 bytes of file wp-content/uploads/2015/09/Dieline-184.pdf to archive backup_new.rkwinc.com-2017-03-25_01-33-sql-7acb8.tar [] []

Viewing 5 replies - 1 through 5 (of 5 total)
  • XCloner

    (@xcloner)

    9 years, 1 month ago

    It could be that you are running into a server timeout on backup process specially if the cron runs using the default WordPress setup, so i would advise checking this tutorial http://support.hostgator.com/articles/how-to-replace-wordpress-cron-with-a-real-cron-job on how to setup cron to run properly from the server side.

    Let us know if you get further issues… As a separate test, you should try scheduling a database only backup excluding all files and see if that helps.

    Thread Starter ddayco

    (@ddayco)

    9 years, 1 month ago

    We’re on a Windows server using Parallels Plesk, so I used the scheduled task manager to setup the cron job. Hopefully I configured it correctly.

    schedule task

    It got to 170mb, but still doesn’t complete. I tried to schedule a DB only backup, but it still produced a 170mb file that didn’t transfer to remote storage.

    [2017-03-25 19:47:29] php_system.INFO: E_NOTICE: array ( ‘type’ => 8, ‘message’ => ‘Undefined index: action’, ‘file’ => ‘/var/www/vhosts/rkwinc.com/httpdocs/owfg-projects/wp-content/plugins/xcloner-backup-and-restore/admin/class-xcloner-admin.php’, ‘line’ => 146, ) [] []
    [2017-03-25 19:46:08] xcloner_remote_storage.INFO: Transferring backup backup_new.rkwinc.com-2017-03-25_19-45-sql-94eff.tar to remote storage DROPBOX [“”] []
    [2017-03-25 19:46:08] xcloner_remote_storage.INFO: Deleting remote file backup_new.rkwinc.com-2017-03-18_00-59-sql-multipart-d7739.csv matching rule [“RETENTION LIMIT TIMESTAMP”,”1489805389 =< 5″] []
    [2017-03-25 19:46:07] xcloner_remote_storage.INFO: Doing DROPBOX remote storage cleanup for 5 days limit [] []
    [2017-03-25 19:46:07] xcloner_remote_storage.INFO: Creating the DROPBOX remote storage connection [“”] []
    [2017-03-25 19:46:07] xcloner_scheduler.INFO: Transferring backup to remote storage DROPBOX [“CRON”] []
    [2017-03-25 19:46:06] xcloner_scheduler.INFO: File archive process FINISHED. [“CRON”] []
    [2017-03-25 19:46:06] xcloner_archive.INFO: Closing the backup archive backup_new.rkwinc.com-2017-03-25_19-45-sql-94eff.tar with 2*512 zero bytes blocks. [] []
    [2017-03-25 19:46:06] xcloner_archive.INFO: Deleting 6cf13378795c216863d3a9fcb91e8d33 from the tmp filesystem [] []
    [2017-03-25 19:46:06] xcloner_archive.INFO: Appended 21417038 bytes, starting position 157287936, of tmp file 6cf13378795c216863d3a9fcb91e8d33 (xcloner-94eff/database-backup.sql) to archive backup_new.rkwinc.com-2017-03-25_19-45-sql [] []
    [2017-03-25 19:46:03] xcloner_archive.INFO: Opening for append the backup archive backup_new.rkwinc.com-2017-03-25_19-45-sql [] []
    [2017-03-25 19:46:03] xcloner_archive.INFO: Reached the maximum 52428800 request data limit, returning response [] []
    [2017-03-25 19:46:03] xcloner_archive.INFO: Appended 52429312 bytes, starting position 104858624, of tmp file 6cf13378795c216863d3a9fcb91e8d33 (xcloner-94eff/database-backup.sql) to archive backup_new.rkwinc.com-2017-03-25_19-45-sql [] []
    [2017-03-25 19:46:00] xcloner_archive.INFO: Opening for append the backup archive backup_new.rkwinc.com-2017-03-25_19-45-sql [] []
    [2017-03-25 19:46:00] xcloner_archive.INFO: Reached the maximum 52428800 request data limit, returning response [] []
    [2017-03-25 19:46:00] xcloner_archive.INFO: Appended 52429312 bytes, starting position 52429312, of tmp file 6cf13378795c216863d3a9fcb91e8d33 (xcloner-94eff/database-backup.sql) to archive backup_new.rkwinc.com-2017-03-25_19-45-sql [] []
    [2017-03-25 19:45:59] xcloner_archive.INFO: Opening for append the backup archive backup_new.rkwinc.com-2017-03-25_19-45-sql [] []
    [2017-03-25 19:45:59] xcloner_archive.INFO: Reached the maximum 52428800 request data limit, returning response [] []
    [2017-03-25 19:45:59] xcloner_archive.INFO: Appended 52429312 bytes, starting position 0, of tmp file 6cf13378795c216863d3a9fcb91e8d33 (xcloner-94eff/database-backup.sql) to archive backup_new.rkwinc.com-2017-03-25_19-45-sql [] []
    [2017-03-25 19:45:56] xcloner_archive.INFO: Copying database-backup.sql file to tmp filesystem file 6cf13378795c216863d3a9fcb91e8d33 to prevent reading changes [] []
    [2017-03-25 19:45:56] xcloner_archive.INFO: Adding 10865 bytes of file xcloner-94eff/xcloner-94eff.log to archive backup_new.rkwinc.com-2017-03-25_19-45-sql-94eff.tar [] []
    [2017-03-25 19:45:56] xcloner_archive.INFO: Adding 319 bytes of file xcloner-94eff/backup_files.csv to archive backup_new.rkwinc.com-2017-03-25_19-45-sql-94eff.tar [] []
    [2017-03-25 19:45:56] xcloner_archive.INFO: Adding 0 bytes of file xcloner-94eff/index.html to archive backup_new.rkwinc.com-2017-03-25_19-45-sql-94eff.tar [] []
    [2017-03-25 19:45:56] xcloner_archive.INFO: Opening for append the backup archive backup_new.rkwinc.com-2017-03-25_19-45-sql [] []
    [2017-03-25 19:45:56] xcloner_scheduler.INFO: Starting file archive process [“CRON”] []
    [2017-03-25 19:45:56] xcloner_scheduler.INFO: Database backup done [“CRON”] []
    [2017-03-25 19:45:56] xcloner_database.INFO: Dumping 3 records starting position 0 from rkwincdb1.rkw_xcloner_scheduler table [“”] []
    [2017-03-25 19:45:56] xcloner_database.INFO: Dumping the structure for rkwincdb1.rkw_xcloner_scheduler table [“”] []
    [2017-03-25 19:45:56] xcloner_database.INFO: Dumping 5 records starting position 0 from rkwincdb1.rkw_users table [“”] []
    [2017-03-25 19:45:56] xcloner_database.INFO: Dumping the structure for rkwincdb1.rkw_users table [“”] []
    [2017-03-25 19:45:56] xcloner_database.INFO: Dumping 100 records starting position 0 from rkwincdb1.rkw_usermeta table [“”] []
    [2017-03-25 19:45:56] xcloner_database.INFO: Dumping the structure for rkwincdb1.rkw_usermeta table [“”] []

    XCloner

    (@xcloner)

    9 years, 1 month ago

    I think your command line should contain the full path to your wp-cron.php as well as prefix the php cli executable, but maybe i am wrong and your server is configured differently.

    You can try and enable backup compression by setting a compression level in Xcloner Config to get a smaller backup size.

    Also, you should change your backup Store path from the default wp-content/backups/ folder for security reasons.

    Thread Starter ddayco

    (@ddayco)

    9 years, 1 month ago

    I updated the scheduled task to use the full path, still not getting anywhere. No change using compression either. Are there settings my host might be able to change to avoid server time outs? Memory limits or execution times? Any recommendations?

    XCloner

    (@xcloner)

    9 years, 1 month ago

    Did you change this option in wp-config.php?

    define(‘DISABLE_WP_CRON’, true);

    For execution timeouts, there is the max_execution_time parameter in your php.ini, for memory limit there is the memory_limit parameter in the same php.ini, but there could be timeout parameters at the IIS server level as well, a good start would be here http://stackoverflow.com/questions/23148813/how-to-address-the-fastcgi-process-exceeded-configured-request-timeout-error if you are running php as fastcgi process.
    But it would be best to check further with your hosting support , check as well the main server error log to see if you get there any log reports.

Viewing 5 replies - 1 through 5 (of 5 total)

The topic ‘Problems with Scheduling and Remote Storage’ is closed to new replies.