Backup threads

**UncleSam** · Dec 17th 2016

Hello there,

I have some troubles with the bacup procedure. Currently it is using all CPU power which it is able to get. I know it is using nice and ionice but this is too much for my small server (server not responding during backups).

So my question is:
Is there a possibility to limit the threads or switch to single threaded mode (or something like that)?

**fulltilt** · Dec 17th 2016

I use rsync to save all user files and server configs incl. complete mysql dumps to an external server.
IMSCP is set to save user databases only, user file or imscp backups are set to disabled ...
There are many webs hosted on this system which are using more than 15GB space ... works very well w/ rsync without packing archives

**Nuxwin** · Dec 17th 2016

@UncleSam

In latest i-MSCP versions, default value for the BACKUP_COMPRESS_ALGORITHM configuration parameter in the /etc/imscp/imscp.conf file is bzip2, meaning that there is only one CPU core used for backuping data. First please, check the current value of this parameter on your system.

Also, note that the i-MSCP backup script process backup of one client data at time. If your server get crazy with such setup, you should think about an alternative such as an incremental backup solution. This would help you mitigating server load because only new or modified files would be processed.

Once again, the i-MSCP backup solution is not perfect and we will implement a better solution in v2.0.0.

@fulltilt

Data get compressed on remote server or not compressed at all?

**UncleSam** · Dec 17th 2016

@Nuxwin
Thanks for the information. It is currently set to bzip2 so I am going to disable the backup system by letting the cron entry commented.

If you are searching for a good backup solution with full and incremental support you could give duplicity a try:
Homepage: http://duplicity.nongnu.org/
Wrapper which I am using at the moment: https://github.com/zertrin/duplicity-backup.sh

**fulltilt** · Dec 17th 2016

Quote from Nuxwin

Data get compressed on remote server or not compressed at all?

no not compressed ... the customers have to use FTP for their local file backups and can download daily SQL backups also via FTP
I have disabled customer file backups because of high CPU usage ... and removed restore button from client template

Shell-Script

#!/bin/sh
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /etc [email protected]:/backup/host1
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /root [email protected]:/backup/host1
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /var/mail [email protected]:/backup/host1/var
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /var/cache/bind [email protected]:/backup/host1/var/cache
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /var/spool/cron [email protected]:/backup/host1/var/spool
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --exclude=/virtual/*/backups --exclude=/virtual/*/logs --exclude=/virtual/*/phptmp --delete /var/www/virtual [email protected]:/backup/host1/var/www
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /var/www/imscp [email protected]:/backup/host1/var/www
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /var/www/scoreboards [email protected]:/backup/host1/var/www
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /var/www/fcgi [email protected]:/backup/host1/var/www
ionice -c 3 rsync -avze "ssh -p 2222 -i /root/keys/my-key" --stats --numeric-ids --delete /usr/local/src [email protected]:/backup/host1/usr
echo "Rsync Backup Host 1" | mail -s "Rsync Backup Host 1" myEmail@addess

Display More

Backup threads

Share

Daily visitors