[Bloat] Fwd: High Speed WAN Rsync now possible via UDT

[Dave Taht]

Since we are essentially observing "wan" latencies anyway I am curious as
to how the UDT protocol functions... has anyone tried it?

If useful (or scary) I'll try to find the time to package it up for cero.

I liked how mosh solved the terminal emulation problem over lousy links (in
fact, reflecting on it, had it existed in 1998 when I was mucking with the
strip protocol, I'd have not bothered with getting tcp to work at all. :) )
I also get a kick out of people using ssh to "authenticate" and then
dropping to something else....


---------- Forwarded message ----------
From: Erich Weiler <weiler at soe.ucsc.edu>
Date: Fri, Feb 22, 2013 at 10:54 AM
Subject: High Speed WAN Rsync now possible!!!
To: rsync at lists.samba.org


Folks-

Just wanted to plug a totally awesome software package from a group I know:
UDR (UDT Enabled Rsync).

For those not familiar with UDT, it is a low level network protocol based
on UDP that allows for high speed transfers over high latency WAN networks:

http://udt.sourceforge.net/

For a while the UDT API was available, developed by the Laboratory for
Advanced Computing at the University of Chicago, but there were little
development around it for actually developing a software suite to allow for
high speed WAN transfers, such as can be achieved by Aspera, GridFTP, FDT,
and a couple others.  The problem with those often is:

Aspera: Great but *crazy* expensive
GridFTP: Not bad but non-trivial to set up
FDT: Java (Eh...)

But the awesome thing here is that UDR is a lightweight wrapper for rsync
that allows for rsync functionality, but uses UDT as the underlying
protocol for transfer (no rsh or ssh).  It authenticates over ssh and then
transfers the data over UDT streams.  And supports encryption.

Right now it is kind of in beta but we've been using it for a while and
it's very stable.  It has been tested on Linux, BSD and OSX.  It may
compile on other platforms but not much testing has been done on those.
 Written in C++.

https://github.com/LabAdvComp/**UDR <https://github.com/LabAdvComp/UDR>

You can clone the repo with 'git clone' and build the code.  It compiles
very easily and only requires the OpenSSL library as a dependency.

As an example:  We have been trying to transfer data from California to our
servers in Germany for a while, and have only be getting 10Mb/s. With UDR
we get 700Mb/s.  Not bad.

There are details on the GitHub page.  Check it out!!

-erich
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/**
mailman/listinfo/rsync <https://lists.samba.org/mailman/listinfo/rsync>
Before posting, read:
http://www.catb.org/~esr/faqs/**smart-questions.html<http://www.catb.org/~esr/faqs/smart-questions.html>



-- 
Dave Täht

Fixing bufferbloat with cerowrt:
http://www.teklibre.com/cerowrt/subscribe.html
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.bufferbloat.net/pipermail/bloat/attachments/20130222/660a23d7/attachment.html>