Use of backups / log shipping in datawarehouse ETL
From: MarcusW (MarcusW_at_discussions.microsoft.com)
Date: 02/15/05
- Next message: Rick Sawtell: "Re: File Open"
- Previous message: Chris, Master of All Things Insignificant: "Transaction Log"
- Next in thread: Tibor Karaszi: "Re: Use of backups / log shipping in datawarehouse ETL"
- Reply: Tibor Karaszi: "Re: Use of backups / log shipping in datawarehouse ETL"
- Messages sorted by: [ date ] [ thread ]
Date: Tue, 15 Feb 2005 11:37:06 -0800
I am a datawarehouse developer, somewhat green around database maintenance
plans and log shipping.
I am looking into the use of differential backups / log shipping as a way of
propagating data from production system databases to a data warehouse.
The production system is clustered and has its own disaster preparedness
plan already in place. This includes taking full backups of the databases
daily - around 80GB of data. Ideally, I don't want to change anything with
this backup approach.
My current ETL process, run nightly, involves restoring the full backups to
a staging server as a first step. This is using up 4hrs of my batch window.
Is there some way of (a) Keeping the existing plan for nightly full backups,
and (b) having a new parallel plan which does regular (probably daily)
incremental backups against a baselined weekly or monthly full backup ?
I assume that (a) truncates the logs, which makes (b) difficult or
impossible as a standalone approach.
Thoughts including suggestion for minor modifications to (a) gratefully
received. Thanks in advance
Marcus
- Next message: Rick Sawtell: "Re: File Open"
- Previous message: Chris, Master of All Things Insignificant: "Transaction Log"
- Next in thread: Tibor Karaszi: "Re: Use of backups / log shipping in datawarehouse ETL"
- Reply: Tibor Karaszi: "Re: Use of backups / log shipping in datawarehouse ETL"
- Messages sorted by: [ date ] [ thread ]
Relevant Pages
|
