Discussion:
[unison-users] copyprog with SCP
Alain Mouette alainm@pobox.com [unison-users]
2016-05-11 16:14:36 UTC
Permalink
Please help me configuring SCP for file copy...

My problem is that I hava a partition with many VirtualBox machines,
disk images range from 5 to 8 Giga bytes each.
Copy for these files is exceedingly slow, around 4kb/s, eats a lot od
CPU power on the sending machine and there is very little network trafic !!!

I changed to rsync, but it only got marginaly better. Here is how I
configured it:
----------
copythreshold = 50000
copyprogrest = rsync --partial --append-verify --compress
copyprog = rsync --partial --inplace --compress
----------

copying with sftp goes at 4Mb/s, how could I use SCP for external copy???

Thanks,
Alain
Adrian Klaver adrian.klaver@aklaver.com [unison-users]
2016-05-11 18:06:27 UTC
Permalink
Post by Alain Mouette ***@pobox.com [unison-users]
Please help me configuring SCP for file copy...
My problem is that I hava a partition with many VirtualBox machines,
disk images range from 5 to 8 Giga bytes each.
Copy for these files is exceedingly slow, around 4kb/s, eats a lot od
CPU power on the sending machine and there is very little network trafic !!!
I changed to rsync, but it only got marginaly better. Here is how I
----------
copythreshold = 50000
copyprogrest = rsync --partial --append-verify --compress
copyprog = rsync --partial --inplace --compress
----------
copying with sftp goes at 4Mb/s, how could I use SCP for external copy???
Best guess is that compression is eating up the CPU cycles. Try without
compression and see what happens.
Post by Alain Mouette ***@pobox.com [unison-users]
Thanks,
Alain
--
Adrian Klaver
***@aklaver.com
Adrian Klaver adrian.klaver@aklaver.com [unison-users]
2016-05-17 17:54:59 UTC
Permalink
On 05/17/2016 09:42 AM, Alain Mouette wrote:

Ccing list
It seems the nobody knows how to use an external program other than
*rsync* for big file copy..
_*Is there any DOC on how the external program is called*__*? Command
line parameters and such ???*_
Here is an example for a different program:

https://alliance.seas.upenn.edu/~bcpierce/wiki/index.php?n=Main.UnisonFAQTips

See:

Is it possible to synchronize two hosts via a removable drive?
I DID search the doc for quite a time and could not find it
Please Help,
Alain
--
Adrian Klaver
***@aklaver.com
worley@alum.mit.edu [unison-users]
2016-05-12 02:25:40 UTC
Permalink
Post by Alain Mouette ***@pobox.com [unison-users]
Please help me configuring SCP for file copy...
My problem is that I hava a partition with many VirtualBox machines,
disk images range from 5 to 8 Giga bytes each.
Copy for these files is exceedingly slow, around 4kb/s, eats a lot od
CPU power on the sending machine and there is very little network trafic !!!
I changed to rsync, but it only got marginaly better. Here is how I
----------
copythreshold = 50000
copyprogrest = rsync --partial --append-verify --compress
copyprog = rsync --partial --inplace --compress
----------
copying with sftp goes at 4Mb/s, how could I use SCP for external copy???
It looks like you've got some ugly problem with network copies
themselves. First, find out how to copy files across the network
quickly; after that, work on configuring Unison to use that method.

Dale
Loading...