It is currently Sun Dec 08, 2019 6:21 pm
All times are UTC + 8 hours

Best way to transfer TB from PC to 5304T (background)

Got a question about our NAS utilities? The answer lies within.

Best way to transfer TB from PC to 5304T (background)

Postby kaosguy » Sun Dec 01, 2019 12:43 am

I'm loading up my 5304T with more than 20 TB of content from my PC's hard drives.
I'm doing this by dragging folders from my PC to folders on my NAS volume (which I mapped to a PC drive) with Windows 10 Explorer.
I've done this a few times before and for whatever reason I have accidentally (or on purpose) interrupted the process.
So I have to start over.
I'm not asked about overwriting/skipping files when it finds some of the content already on the NAS volume, so I'm starting over from scratch.

Can someone suggest a way to do this that is...
1) As fast as possible.
2) Ideally in the background/will pick up from where it left off if interrupted.
3) Similar to 2, will not waste time copying over any files previously fully copied.

I don't care if this is a windows utility or an Asustor utility.

I imagine the Asustor Backup utility can do this, but I want a simple file transfer, not the creation of some kind of archive.

Thanks!
kaosguy
 
Posts: 7
Joined: Thu Nov 21, 2019 8:57 pm

Re: Best way to transfer TB from PC to 5304T (background)

Postby father.mande » Sun Dec 01, 2019 1:49 am

Hi,

I don't know if my own usage is acceptable for you and correspond to your case.
I use Syncthing
... require Syncthing on the two node (or all system / node impacted)
... totally in background and with restart after a boot but never redo the copy if already done
... you can split sync. by folder (for ex.) and have multiple nodes
... NO pivot node or database node, all is local / replicate to each machine
... two way simultaneously (except if you define one as master ... so only one way is used) in your case perhaps the PC if unique can be a master

BUT if I use it for TB (up to 8/10) never for a so large in one peer (20 TB)
ALSO Syncthing is very interesting if you want to transparently later have an auto update of your file on NAS from PC (change / new / delete (reported or not to NAS))

my opinion is that SMB (Windows share) is not the best solution (even you can if you have the hardware use aggregated Ethernet link ... ) for my own I prefer multiple FTP with resume function to use maximum bandwidth of my network.

I don't have miraculous solution ... so wait for other responses (or ask Asustor support team ?)

Philippe.
AS5002T / AS202TE / AS1002T
My Blog specific to my APKG : https://blog.father-mande.ovh/
User avatar
father.mande
 
Posts: 820
Joined: Sat Sep 12, 2015 2:55 am

Re: Best way to transfer TB from PC to 5304T (background)

Postby kaosguy » Sun Dec 01, 2019 10:00 pm

Thanks!
I'll look into Syncing.
FTP... wow, I haven't done that for 20 years, will have to look at setup and syntax.

Alan
kaosguy
 
Posts: 7
Joined: Thu Nov 21, 2019 8:57 pm

Re: Best way to transfer TB from PC to 5304T (background)

Postby orion » Mon Dec 02, 2019 10:29 am

You should try Asustor Backup Plan for Windows. It actually does delta copy (file base).
User avatar
orion
 
Posts: 2421
Joined: Wed May 29, 2013 11:09 am

Re: Best way to transfer TB from PC to 5304T (background)

Postby kaosguy » Tue Dec 03, 2019 12:35 pm

Thanks!
kaosguy
 
Posts: 7
Joined: Thu Nov 21, 2019 8:57 pm

Re: Best way to transfer TB from PC to 5304T (background)

Postby Nazar78 » Fri Dec 06, 2019 4:23 pm

You can also look into robocopy https://docs.microsoft.com/en-us/window ... s/robocopy

It's CLI based but with various options sort of rsync for Windows. I noticed that this is the fastest of all tools/methods I've used for selective file migrations as it can do multi-threading (too many threads will slow down normal network sharing operations). Depending on your transfer preference, there's also mirror option (use with caution).
AS5304T - 16GB DDR4 - 40TB N300 RAID10 - 5 Bay JBOD
Nazar78
 
Posts: 22
Joined: Wed Jul 17, 2019 10:21 pm

Return to NAS Utilities

  • You cannot post new topics in this forum
    You cannot reply to topics in this forum
    You cannot edit your posts in this forum
    You cannot delete your posts in this forum
    You cannot post attachments in this forum
  • Who is online

    Users browsing this forum: No registered users and 2 guests