Page 1 of 1

Best way to transfer TB from PC to 5304T (background)

PostPosted: Sun Dec 01, 2019 12:43 am
by kaosguy
I'm loading up my 5304T with more than 20 TB of content from my PC's hard drives.
I'm doing this by dragging folders from my PC to folders on my NAS volume (which I mapped to a PC drive) with Windows 10 Explorer.
I've done this a few times before and for whatever reason I have accidentally (or on purpose) interrupted the process.
So I have to start over.
I'm not asked about overwriting/skipping files when it finds some of the content already on the NAS volume, so I'm starting over from scratch.

Can someone suggest a way to do this that is...
1) As fast as possible.
2) Ideally in the background/will pick up from where it left off if interrupted.
3) Similar to 2, will not waste time copying over any files previously fully copied.

I don't care if this is a windows utility or an Asustor utility.

I imagine the Asustor Backup utility can do this, but I want a simple file transfer, not the creation of some kind of archive.

Thanks!

Re: Best way to transfer TB from PC to 5304T (background)

PostPosted: Sun Dec 01, 2019 1:49 am
by father.mande
Hi,

I don't know if my own usage is acceptable for you and correspond to your case.
I use Syncthing
... require Syncthing on the two node (or all system / node impacted)
... totally in background and with restart after a boot but never redo the copy if already done
... you can split sync. by folder (for ex.) and have multiple nodes
... NO pivot node or database node, all is local / replicate to each machine
... two way simultaneously (except if you define one as master ... so only one way is used) in your case perhaps the PC if unique can be a master

BUT if I use it for TB (up to 8/10) never for a so large in one peer (20 TB)
ALSO Syncthing is very interesting if you want to transparently later have an auto update of your file on NAS from PC (change / new / delete (reported or not to NAS))

my opinion is that SMB (Windows share) is not the best solution (even you can if you have the hardware use aggregated Ethernet link ... ) for my own I prefer multiple FTP with resume function to use maximum bandwidth of my network.

I don't have miraculous solution ... so wait for other responses (or ask Asustor support team ?)

Philippe.

Re: Best way to transfer TB from PC to 5304T (background)

PostPosted: Sun Dec 01, 2019 10:00 pm
by kaosguy
Thanks!
I'll look into Syncing.
FTP... wow, I haven't done that for 20 years, will have to look at setup and syntax.

Alan

Re: Best way to transfer TB from PC to 5304T (background)

PostPosted: Mon Dec 02, 2019 10:29 am
by orion
You should try Asustor Backup Plan for Windows. It actually does delta copy (file base).

Re: Best way to transfer TB from PC to 5304T (background)

PostPosted: Tue Dec 03, 2019 12:35 pm
by kaosguy
Thanks!

Re: Best way to transfer TB from PC to 5304T (background)

PostPosted: Fri Dec 06, 2019 4:23 pm
by Nazar78
You can also look into robocopy https://docs.microsoft.com/en-us/window ... s/robocopy

It's CLI based but with various options sort of rsync for Windows. I noticed that this is the fastest of all tools/methods I've used for selective file migrations as it can do multi-threading (too many threads will slow down normal network sharing operations). Depending on your transfer preference, there's also mirror option (use with caution).