Snapshot replication involving large table - 17million+ rows

Tech-Archive recommends: Fix windows errors by optimizing your registry



Hi,

I am looking at Snapshot Replication for an MIS system I have built.
Server1 contains 3 databases and I want to replicate tables from these
databases and publish them to a single MIS database on Server2. I
would only have to run the snapshot once a day. All good so far. The
only issue is that one of the tables I want to replicate contains
approx. 17.5 million rows. I have had issues in the past with the size
of the snapshot file when replicating large tables. What is the size
limit of a snapshot file? I did think it was 2.5GB however that may
have been due to the limitations of the system I was working on (ie -
the snapshot file grew to 2.5GB then replication hung indefinitely).

With large tables I know is it always better to bcp the table first to
the subscriber database then apply the replication however would the
snapshot only replicate rows that have have been changed/added to the
publishing database? That table performs many transactions in a day
(over 50k rows added + 200k transactions) Obviously I don't want it to
always copy the entire table everytime the snapshot runs.


Thanking you in advance,

Regards

qh

.



Relevant Pages

  • Re: Prefetch objects failed Error when added more than 2 table as
    ... snapshoting tables and then came the line:The replication agent had ... seeing (Prefetch objects failed for Database 'myDB'), ... snapshot agent from the command line with -OutputVerboseLevel of 2. ...
    (microsoft.public.sqlserver.replication)
  • Re: Log wont Truncate when Publication is created
    ... Looking for a SQL Server replication book? ... recreating the snapshot publication. ... database is almost completely rebuilt with each update, ... log space is to delete the publication. ...
    (microsoft.public.sqlserver.replication)
  • Re: Log wont Truncate when Publication is created
    ... would prevent the logs from truncating when a snapshot publication exists? ... Looking for a SQL Server replication book? ... recreating the snapshot publication. ... database is almost completely rebuilt with each update, ...
    (microsoft.public.sqlserver.replication)
  • RE: Action if name is in use property of article
    ... be in different subscription/publication. ... REPLICATION" for the FK constraints. ... Disable Foreign Key Constraints for Replication (Visual Database ... Every time the Snapshot Agent runs, ...
    (microsoft.public.sqlserver.replication)
  • Re: Replication between SQL server and SQL express ????
    ... snapshot" part 1 ... the publisher database 'NOMOS-SRVR.TEST' ... Looking for a SQL Server replication book? ...
    (microsoft.public.sqlserver.replication)