Re: Copying large quantity of files taking forever

Tech-Archive recommends: Fix windows errors by optimizing your registry


"SwitchKat" <SwitchKat@xxxxxxxxxxxxxxxxxxxxxxxxx> wrote in message
news:EFEF754F-402C-438E-9654-0ABC30409346@xxxxxxxxxxxxxxxx
Hi, I wanted to throw this question out because after losing over a week
of
productivity, I'm not sure where else to turn.

Here's my issue. We're trying to restore a file repository for a project
that has just under 2 million files. We've tried restoring from tape,
copying from another Windows server and even moving from another Windows
server. The problem we run into in every case is that the file copy to
the
new system takes off fast and we can see file transfer rates start out
copying 1000's of files per second, but over time it always slows down to
a
crawl and we end up where we are now. We are currently transferring one
file
every few minutes.

All the files are fairly small (<10MB), gigabit network (although we see
the
same performance if we attach the drive locally and just try a copy), and
all
are running Windows Server 2000 or 2003 server. The target is always
running
2003. We've been monitoring resources, and at this point, both servers
involved show flatlines for their resources being used. My hunch is that
it
has something to do with a data block size issue or the file table (maybe
fragmentation?), but I'm not sure. Any ideas?

You don't say where these files reside but if they reside in a single
directory then this is your answer. If you want to keep your machine running
at top speed, don't keep more than 10,000 entries in a single folder. 2
million is two hundred times too many.


.

Relevant Pages

  • RE: Using a replica Server 2003 for SBS 2003 disaster recovery
    ... I understand that you want to install a replica Windows Server 2003 in the ... SBS 2K3 Domain to restore Exchange and SQL Database. ... This newsgroup only focuses on SBS technical issues. ...
    (microsoft.public.windows.server.sbs)
  • Re: Copying large quantity of files taking forever
    ... The utility xxcopy.exe is known for baulking at large copy jobs. ... copying from another Windows server and even moving from another ... are running Windows Server 2000 or 2003 server. ... at top speed, don't keep more than 10,000 entries in a single folder. ...
    (microsoft.public.windows.server.general)
  • Re: Restoring Active Directory on new Hardware
    ... I can't find a way to restore my backup to a different hardware server. ... the active directory password is wrong... ... My two server are windows server 2003 sp2. ...
    (microsoft.public.windows.server.active_directory)
  • Re: Migrate Certificate Service W2k to W2k3
    ... >Restore of an incremental image cannot be performed before performing ... >restore from a full image. ... You did not upgrade the Windows 2000 CA machine to Windows Server 2003 ...
    (microsoft.public.windows.server.active_directory)
  • Re: Copying large quantity of files taking forever
    ... copying from another Windows server and even moving from another Windows ... You don't say where these files reside but if they reside in a single ... at top speed, don't keep more than 10,000 entries in a single folder. ...
    (microsoft.public.windows.server.general)