Categories
Linux Mastering Development Ubuntu

Duplicity (Duply) over SCP very slow. What to look for?

I’m struggling to setup a simple backup routine to go from my local fileserver over to my friend’s server (both Ubuntu 18.04).

I finally got it all ‘working’, but when I do a test of a 750Mb fileset, it took over 26 minutes to complete (that would take 15 days for 1 TB!).

But here’s the thing… if instead of SCP to the remote server, I do a local “file://” backup (otherwise identical backup) it takes < 30 seconds. OK, so it isn’t the backup generation. It must be the transfer, right? But when I do a manual SCP of the resulting local backup to the remote server, that same 750 Mb takes < 30 seconds as I’d expect given mine and my friend’s bandwidth. So it isn’t the transfer speed.

If it isn’t duplicity making the backup and it isn’t SCP sending it… what do I look for as to what the problem could be?

Thanks.

Below is the config file for Duply (uncommented lines only).

GPG_KEY='[my key ID]'
GPG_PW='[GPG passphrase]'
TARGET='scp://user@friends_server.duckdns.org//mnt/bigdisk/backup'
SOURCE='/mnt/bigdisk/Books'

When doing the local, the only thing I changed was the TARGET to:

TARGET='file:///mnt/bigdisk/backup'

Now obviously I could script it to do a local and then SCP over rather than SCP within Duply/Duplicity, but that seems dumb.

Leave a Reply

Your email address will not be published. Required fields are marked *