Re: Synchronising In-House and Web Data

Tech-Archive recommends: Fix windows errors by optimizing your registry

What does replicating the execution of stored procedures achieve?

"Hilary Cotter" wrote:

You might want to look at replicating the execution of stored procedures.

--
Hilary Cotter
Director of Text Mining and Database Strategy
RelevantNOISE.Com - Dedicated to mining blogs for business intelligence.

This posting is my own and doesn't necessarily represent RelevantNoise's
positions, strategies or opinions.

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com



"Steve Barker" <stevebarker@xxxxxxxxxxxxx> wrote in message
news:E8B464D2-2DEC-4AEB-AB46-050CE2007615@xxxxxxxxxxxxxxxx
Hilary,

Thanks for your reply! I realise that we could set replication up over the
net, but I'm worried that the replication wouldn't be able to cope with
the
volumes of data we'd need to send.

I understand that transactional replication is good for a constant stream
of
changes, but that's not exactly what I want to do. My changes are sent in
large, isolated batches. The analogy is that I'm filling a swimming pool
with
a bucket instead of a hose pipe.

If the replication engine suddenly gets a request to update a few hundred
thousand records, how would it cope, and what would happen to the data
during
the update? I can imagine scenarios where parent records have been updated
by
the replication, but associated child records have not yet been updated,
so
the user could theoretically see a mix of old and new data on screen,
which
could be contradictory.

My question is really this: I'm pretty sure that what we're trying to
achieve is quite a common problem. Many other organisations must have
large
web-based SQL Servers which they update periodically. How do they solve
the
synchronisation problem, while maintaining a coherent user experience and
SQL
Server responsivity?

Thanks again,

Steve.



"Hilary Cotter" wrote:

As long as you accept inbound tcp/ip on the firewall to the web site you
can
use push replication for this. If not, try a pull.

--
Hilary Cotter
Director of Text Mining and Database Strategy
RelevantNOISE.Com - Dedicated to mining blogs for business intelligence.

This posting is my own and doesn't necessarily represent RelevantNoise's
positions, strategies or opinions.

Looking for a SQL Server replication book?
http://www.nwsu.com/0974973602.html

Looking for a FAQ on Indexing Services/SQL FTS
http://www.indexserverfaq.com



"Steve Barker" <stevebarker@xxxxxxxxxxxxx> wrote in message
news:2D415143-D0B0-40EA-957F-81DD32308B37@xxxxxxxxxxxxxxxx
Hi,

This is the situation:

We have a large in-house database. It has quite a few tables, some of
which
contain in the order of 8 million records. This is our production
database;
the result of all our internal systems.

Now, we want to make some of this data available to our clients via our
web-site. Hence, we have a web-server (running SQL Server), which
exposes
data to a set of web-pages. The data on the web-server is being read
only;
our web users do not update this data. Problem: Our web-server is
hosted
by a
third party at an external location. Bringing this in-house is not an
option.

At the moment, we log what changes in our in-house production database,
and
produce CSV files of the changes. These are then FTP-ed to the
web-server
overnight, and a DTS package inserts the changes into the web-server
version
of our database. The CSV files we send to the web-server are in the
region
of
20MB, so quite a lot of information changes on a day-to-day basis.

The CSV method seems like quite an antiquated way of doing things, and
I
wondered if we could do something slicker using replication (standard
transactional with readonly subscribers). Would replication be able to
cope
with the web-database sitting there for hours without a change, and
then
all
of a sudden having to import 20MB worth of changes? Is there another
method
we could use to keep the web-server up-to-date?

I'm pretty sure that this is a problem that other organisations face.
How
do
they solve the problem?

Thanks in advance for your help!

Steve.







.

Relevant Pages

  • Re: Oracle to SQL Replication.
    ... Director of Text Mining and Database Strategy ... Looking for a SQL Server replication book? ...
    (microsoft.public.sqlserver.replication)
  • Re: Synchronising In-House and Web Data
    ... As long as you accept inbound tcp/ip on the firewall to the web site you can ... Director of Text Mining and Database Strategy ... Looking for a SQL Server replication book? ... Hence, we have a web-server, which exposes ...
    (microsoft.public.sqlserver.replication)
  • Re: Usage of LOB(s) - Replication Peformance
    ... I am not aware of any with replication I am afraid. ... Director of Text Mining and Database Strategy ... RelevantNOISE.Com - Dedicated to mining blogs for business intelligence. ...
    (microsoft.public.sqlserver.replication)
  • Re: Synchronising In-House and Web Data
    ... Director of Text Mining and Database Strategy ... Looking for a SQL Server replication book? ... The data on the web-server is being read ...
    (microsoft.public.sqlserver.replication)
  • Re: Errors in Directory Service Event Viewer
    ... >condition persists then please restore the database from a previous backup. ... >following directory partition. ... >Sites and Services for the KCC to create a spanning tree replication ... >- Add a Connection object to a domain controller that contains the directory ...
    (microsoft.public.windows.server.active_directory)