Re: Warehouse data from production db or reporting db?
- From: "Peter Nolan" <peter@xxxxxxxxxxxxxx>
- Date: 21 Jun 2005 08:00:58 -0700
Hi Solar C,
I'm not sure what you mean by the 'reporting server' because 'report
services' servers do not really store your data....they just present
the data out of the DW so I cannot imagine why you you are thing Pz-Rx
in any case...
That aside....transfering data from operational systems (what you are
calling production server I guess) to a DW server can be achieved in
many ways and replication is one of the more expensive ways I would
imagine. I have never used database replication as it is usually quite
expensive because it usually insists on having a full copy of your data
elsewhere and sometimes required the update to the remote server to be
inside the same unit of work.....I am not sure if SQL Server can
perform delayed replication to a target database......so usually if you
use replication the volume of data must be small and the volume of
transactions must be small...
Much more normal is to extract based on timestamps as well as
developing a mechanism to catch deletes or, if you can, make sure the
application writes a log so that all records that are being updated are
recorded in the log and use the log to extract the updated
records....meaning not the database log...
If that fails you can read the database log....I do not know if there
are tools to do this on sql server....
If that failes you can dump data and do delta file generation but this
is a last resort because of the CPU you will consume..
>>From your production sever (one ore more) I'd suggest you send data to
a staging area on your target DW box and then move it again into a
dimensional model...You can use MSFT DTS or third party ETL tools to
code all the data movement and transformation...
Best Regards
Peter Nolan
www.peternolan.com
.
- Follow-Ups:
- References:
- Warehouse data from production db or reporting db?
- From: SolarCoder
- Warehouse data from production db or reporting db?
- Prev by Date: SQL Server on more than 4 CPUs??
- Next by Date: Re: Can I pick your brains for a second? transferring a large database problem.
- Previous by thread: Warehouse data from production db or reporting db?
- Next by thread: Re: Warehouse data from production db or reporting db?
- Index(es):
Relevant Pages
|