[ale] Parallel data transfers (NFS).

[JD]

On 11/05/2014 04:26 PM, Raj Wurttemberg wrote:
>> I'd use rsync and be done. Be certain to RTFM about rsync and local copies
>> (they always copy the file). NFS appears to rsync as local storage.  I
> routinely
>> see
>> 65+MB/s (520 Mbps) transfers.
>>
>> 10G really isn't much data - just 5-10 min to transfer.
> 
> It's 10TB, not GB. Haha!
> 
> Yeah, rsync is looking to be a good option. Thanks!

So - for 10TB .... I'd look at getting better connections and a great disk
subsystem.  Thought about infiniband and 10G networking for the NAS?

Is the data all new or is it partially changed?  Can you get a live, replicated,
feed, from the source?