Quantcast
Transferring large data volume - Beyond.ca - Car Forums
Results 1 to 17 of 17

Thread: Transferring large data volume

  1. #1
    Join Date
    Jan 2008
    Location
    Upstairs
    My Ride
    Natural Gas.
    Posts
    13,414
    Rep Power
    100

    Default Transferring large data volume

    So I'm copying files from my old nas to my new one, and I'm wondering if there is an efficient method to do this.

    The old drag and drop in windows explorer seems to be having issues.
    Approximately 1TB in maybe 5000 files total.

    Theres probably a better way, thoughts?
    Quote Originally Posted by killramos View Post
    This quote is hidden because you are ignoring this member. Show Quote
    You realize you are talking to the guy who made his own furniture out of salad bowls right?

  2. #2
    Thaco's Avatar
    Thaco is offline sucks off little boys (ya, don't fuck with rage2 bitch!!!)
    Join Date
    Oct 2004
    Location
    Calgary
    My Ride
    Rage2
    Posts
    3,868
    Rep Power
    29

    Default

    Quote Originally Posted by ExtraSlow View Post
    This quote is hidden because you are ignoring this member. Show Quote
    So I'm copying files from my old nas to my new one, and I'm wondering if there is an efficient method to do this.

    The old drag and drop in windows explorer seems to be having issues.
    Approximately 1TB in maybe 5000 files total.

    Theres probably a better way, thoughts?
    i use robocopy, then you can always pick up where you left off... there are lots of programs that will do it, but robocopy is free and does exactly what is needed.
    User title molested by Rage2.

    Quote Originally Posted by rage2 View Post
    This quote is hidden because you are ignoring this member. Show Quote
    It's not the size that matters, it's the taste it leaves in your mouth.

    Quote Originally Posted by JRSC00LUDE
    This quote is hidden because you are ignoring this member. Show Quote
    I say stupid shit all the time.
    ^^ Fact Checked


    Quote Originally Posted by Misterman View Post
    This quote is hidden because you are ignoring this member. Show Quote
    No logic, thought, input, etc from cult member...

  3. #3
    Join Date
    Jan 2008
    Location
    Upstairs
    My Ride
    Natural Gas.
    Posts
    13,414
    Rep Power
    100

    Default

    Thanks. I knew there had to be a system for this. Just grabbed richcopy as it seems like that's the updated version of robocopy.

    Trying it now.
    Quote Originally Posted by killramos View Post
    This quote is hidden because you are ignoring this member. Show Quote
    You realize you are talking to the guy who made his own furniture out of salad bowls right?

  4. #4
    Join Date
    Nov 2003
    Location
    Calgary
    Posts
    521
    Rep Power
    21

    Default

    the problem.with a copy and paste from nas to nas in windows is that the file gets transferred through your computer to the other nas.

    do either od your nas have a web interface with a file manager? maybe see if ou can copy nas to nas without the middleman.

    depending in your technical level a ssh to the nas and rsync will solve this too.

  5. #5
    Join Date
    Feb 2010
    Location
    Calgary
    Posts
    426
    Rep Power
    21

    Default

    Quote Originally Posted by Alterac View Post
    This quote is hidden because you are ignoring this member. Show Quote
    the problem.with a copy and paste from nas to nas in windows is that the file gets transferred through your computer to the other nas.

    do either od your nas have a web interface with a file manager? maybe see if ou can copy nas to nas without the middleman.

    depending in your technical level a ssh to the nas and rsync will solve this too.
    Most consumer NAS boxes have some web interface provision for scheduling a backup; just have the old NAS direct it to the desired directory on the new one, supply credentials, set Full backup to "now", Presto!

  6. #6
    Join Date
    Jan 2008
    Location
    Upstairs
    My Ride
    Natural Gas.
    Posts
    13,414
    Rep Power
    100

    Default

    So the computer in the middle is the bottleneck? That makes sense.
    Quote Originally Posted by killramos View Post
    This quote is hidden because you are ignoring this member. Show Quote
    You realize you are talking to the guy who made his own furniture out of salad bowls right?

  7. #7
    Join Date
    Nov 2003
    Location
    Calgary
    Posts
    521
    Rep Power
    21

    Default

    Quote Originally Posted by ExtraSlow View Post
    This quote is hidden because you are ignoring this member. Show Quote
    So the computer in the middle is the bottleneck? That makes sense.
    well, it really depends on your nas's and how they are connected along with how your pc is connected.

    if all a hardwired in with gigabit, and entry level nas devices, you most likely wont have a bottleneck with your pc.

    but if your computer is on wireless it could get quite slow

  8. #8
    Join Date
    Jan 2008
    Location
    Upstairs
    My Ride
    Natural Gas.
    Posts
    13,414
    Rep Power
    100

    Default

    It's all hardwired, and the two NAS boxes are sitting side by side with just a switch in between. The desktop computer is also sitting right there and hardwired in through the same switch.

    I do have some stuff to send over wireless eventually from one of my laptops, but for now everything is through copper.
    Quote Originally Posted by killramos View Post
    This quote is hidden because you are ignoring this member. Show Quote
    You realize you are talking to the guy who made his own furniture out of salad bowls right?

  9. #9
    Join Date
    Nov 2003
    Location
    Calgary
    Posts
    521
    Rep Power
    21

    Default

    assuming you have a dns-323 as your old nas, and the qnap ts-231p your new one, the biggest bottleneck is the dns-323 nas. it tops.out at around 15MB/s, and your computer and new nas can saturate a gigabit link (125MB/s)

    i had a few of those dns-323 in the past before i changed to my new setup.
    Last edited by Alterac; 10-10-2017 at 10:09 AM.

  10. #10
    Join Date
    Jan 2008
    Location
    Upstairs
    My Ride
    Natural Gas.
    Posts
    13,414
    Rep Power
    100

    Default

    Yeah that's my setup. The DNS323 wasn't working for a while, and now it is. Although it's possibly that it was just unplugged. Hahaha that's kind of embarrassing, but because both my wife and I were trying to troubleshoot thing thing, who knows who did what to it.

    Having some issues to mapping drives as well. Win10 OS on the desktop. Win7 on the laptop. what a hassle.
    Quote Originally Posted by killramos View Post
    This quote is hidden because you are ignoring this member. Show Quote
    You realize you are talking to the guy who made his own furniture out of salad bowls right?

  11. #11
    Join Date
    Nov 2003
    Location
    Calgary
    Posts
    521
    Rep Power
    21

    Default

    are you mapping the drives with the IP of the nas, or the name?

    if the name is failing try the ip, and double check the nas DNS settings.

    pretty much your easy option is the robocopy and patience

  12. #12
    Join Date
    Apr 2008
    Location
    calgary
    My Ride
    CLK 55 / 2g Eclipse / EP3
    Posts
    4,422
    Rep Power
    22

    Default

    DNS323 uses an EXT2/3 (Linux) format. If all else fails, remove one drive (assuming RAID 1) and install in your PC with a EXT disk reader program. Then you can drag and drop using the robocopy program.

    http://www.download3k.com/Install-Di...ux-Reader.html

    If all else fails, you can stop by with a bottle of booze here again and well get it done

  13. #13
    Join Date
    Jan 2008
    Location
    Upstairs
    My Ride
    Natural Gas.
    Posts
    13,414
    Rep Power
    100

    Default

    That's a good option if this stupid transfer takes much longer.
    Quote Originally Posted by killramos View Post
    This quote is hidden because you are ignoring this member. Show Quote
    You realize you are talking to the guy who made his own furniture out of salad bowls right?

  14. #14
    Join Date
    Jan 2004
    Location
    Calgary, Alberta
    My Ride
    Bicycle
    Posts
    9,279
    Rep Power
    49

    Default

    mount old location as E:
    mount new location as F:

    robocopy e:\ f:\ /s /e /copyAT /r:0 /log:c:\temp\copy.log

    now you can check copy.log in c:\temp to see what failed to copy.

    And if there is any disruptions, running the same command again we only bring over files that are newer in the old location. Also make sure both NAS and the windows machine is on the same switch and 1Gbps to maximize speed of transfer.

    It shouldn't take you a few hrs to do this, if you have tons of small files, at worst 48hrs.

  15. #15
    Thaco's Avatar
    Thaco is offline sucks off little boys (ya, don't fuck with rage2 bitch!!!)
    Join Date
    Oct 2004
    Location
    Calgary
    My Ride
    Rage2
    Posts
    3,868
    Rep Power
    29

    Default

    Quote Originally Posted by Xtrema View Post
    This quote is hidden because you are ignoring this member. Show Quote
    mount old location as E:
    mount new location as F:

    robocopy e:\ f:\ /s /e /copyAT /r:0 /log:c:\temp\copy.log

    now you can check copy.log in c:\temp to see what failed to copy.

    And if there is any disruptions, running the same command again we only bring over files that are newer in the old location. Also make sure both NAS and the windows machine is on the same switch and 1Gbps to maximize speed of transfer.

    It shouldn't take you a few hrs to do this, if you have tons of small files, at worst 48hrs.
    if you have to restart wouldn't you want to use /mir instead of /e to avoid re-doing everything you already did?
    User title molested by Rage2.

    Quote Originally Posted by rage2 View Post
    This quote is hidden because you are ignoring this member. Show Quote
    It's not the size that matters, it's the taste it leaves in your mouth.

    Quote Originally Posted by JRSC00LUDE
    This quote is hidden because you are ignoring this member. Show Quote
    I say stupid shit all the time.
    ^^ Fact Checked


    Quote Originally Posted by Misterman View Post
    This quote is hidden because you are ignoring this member. Show Quote
    No logic, thought, input, etc from cult member...

  16. #16
    Join Date
    Jan 2004
    Location
    Calgary, Alberta
    My Ride
    Bicycle
    Posts
    9,279
    Rep Power
    49

    Default

    /MIR do security as well, that's why I prefer /copy: DAT

    Unless you are in a corporate environment, chances are you own everything. Although I have not run into any permission issue with any NAS these days, I still hate copying permissions unless it's needed.

  17. #17
    Thaco's Avatar
    Thaco is offline sucks off little boys (ya, don't fuck with rage2 bitch!!!)
    Join Date
    Oct 2004
    Location
    Calgary
    My Ride
    Rage2
    Posts
    3,868
    Rep Power
    29

    Default

    Quote Originally Posted by Xtrema View Post
    This quote is hidden because you are ignoring this member. Show Quote
    /MIR do security as well, that's why I prefer /copy: DAT

    Unless you are in a corporate environment, chances are you own everything. Although I have not run into any permission issue with any NAS these days, I still hate copying permissions unless it's needed.
    makes sense, i only use mine in a corp environment so i guess thats why i always do /mir
    User title molested by Rage2.

    Quote Originally Posted by rage2 View Post
    This quote is hidden because you are ignoring this member. Show Quote
    It's not the size that matters, it's the taste it leaves in your mouth.

    Quote Originally Posted by JRSC00LUDE
    This quote is hidden because you are ignoring this member. Show Quote
    I say stupid shit all the time.
    ^^ Fact Checked


    Quote Originally Posted by Misterman View Post
    This quote is hidden because you are ignoring this member. Show Quote
    No logic, thought, input, etc from cult member...

Similar Threads

  1. Data usage while travelling. Roaming off. Cell Data off. Still uses data. iPhone 6+

    By benyl in forum Computers, Consoles, and other Electronics
    Replies: 41
    Latest Threads: 02-04-2015, 05:01 PM
  2. Transferring BB 9700 data to Galaxy S2

    By ramminghard in forum Computers, Consoles, and other Electronics
    Replies: 0
    Latest Threads: 07-28-2011, 09:51 PM
  3. LF Info: Logistics, data analyst, data entry, etc...

    By CompletelyNumb in forum Careers
    Replies: 0
    Latest Threads: 07-21-2011, 08:38 AM
  4. WTB: Z600 data cable and covers, V400 data cable and covers

    By GucciBoy in forum Cellular Products
    Replies: 0
    Latest Threads: 11-24-2004, 10:55 PM
  5. WTB: Large Volume 12" ported Enclosure

    By Texas in forum Automotive Parts [Audio/Video/Radar Systems]
    Replies: 0
    Latest Threads: 09-12-2004, 08:21 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •