Backup threads

**UncleSam** · Dec 17th 2016

Hello there,

I have some troubles with the bacup procedure. Currently it is using all CPU power which it is able to get. I know it is using nice and ionice but this is too much for my small server (server not responding during backups).

So my question is:
Is there a possibility to limit the threads or switch to single threaded mode (or something like that)?

**fulltilt** · Dec 17th 2016

I use rsync to save all user files and server configs incl. complete mysql dumps to an external server.
IMSCP is set to save user databases only, user file or imscp backups are set to disabled ...
There are many webs hosted on this system which are using more than 15GB space ... works very well w/ rsync without packing archives

**Nuxwin** · Dec 17th 2016

@UncleSam

In latest i-MSCP versions, default value for the BACKUP_COMPRESS_ALGORITHM configuration parameter in the /etc/imscp/imscp.conf file is bzip2, meaning that there is only one CPU core used for backuping data. First please, check the current value of this parameter on your system.

Also, note that the i-MSCP backup script process backup of one client data at time. If your server get crazy with such setup, you should think about an alternative such as an incremental backup solution. This would help you mitigating server load because only new or modified files would be processed.

Once again, the i-MSCP backup solution is not perfect and we will implement a better solution in v2.0.0.

@fulltilt

Data get compressed on remote server or not compressed at all?

**UncleSam** · Dec 17th 2016

@Nuxwin
Thanks for the information. It is currently set to bzip2 so I am going to disable the backup system by letting the cron entry commented.

If you are searching for a good backup solution with full and incremental support you could give duplicity a try:
Homepage: http://duplicity.nongnu.org/
Wrapper which I am using at the moment: https://github.com/zertrin/duplicity-backup.sh

**fulltilt** · Dec 17th 2016

Quote from Nuxwin

Data get compressed on remote server or not compressed at all?

no not compressed ... the customers have to use FTP for their local file backups and can download daily SQL backups also via FTP
I have disabled customer file backups because of high CPU usage ... and removed restore button from client template

Shell-Script

#!/bin/sh
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /etc root@xxx.xxx.xx.xxx:/backup/host1
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /root root@xxx.xxx.xx.xxx:/backup/host1
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /var/mail root@xxx.xxx.xx.xxx:/backup/host1/var
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /var/cache/bind root@xxx.xxx.xx.xxx:/backup/host1/var/cache
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /var/spool/cron root@xxx.xxx.xx.xxx:/backup/host1/var/spool
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --exclude=/virtual/*/backups --exclude=/virtual/*/logs --exclude=/virtual/*/phptmp --delete /var/www/virtual root@xxx.xxx.xx.xxx:/backup/host1/var/www
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /var/www/imscp root@xxx.xxx.xx.xxx:/backup/host1/var/www
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /var/www/scoreboards root@xxx.xxx.xx.xxx:/backup/host1/var/www
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /var/www/fcgi root@xxx.xxx.xx.xxx:/backup/host1/var/www
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /usr/local/src root@xxx.xxx.xx.xxx:/backup/host1/usr
echo "Rsync Backup Host 1" | mail -s "Rsync Backup Host 1" myEmail@addess

Display More

Backup threads

Share

Daily visitors