Re: Can I pick your brains for a second? transferring a large database problem
- From: "Scott M" <scott_M@xxxxxxxxxxxxx>
- Date: Wed, 8 Jun 2005 20:40:11 -0500
No. Unfortunately the data that I would like to compare it to is in one location.
I MIGHT be able to execute the query there then only pump back the updates........ HUmmm.... I COULD execute it on the server (source) and not the server(destination) :)
THANKS MUCH!!
You have been a lifesaver!!! I'll try that tomorrow during the day and see how this plays out.
<Myles.Matheson@xxxxxxxxx> wrote in message news:1118278616.128839.55570@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
Good question, I have read something similar around joining tables.
To be honest I try and avoid a pull process from any source system (although is may not be possible in all cases). I prefer the source to push the required files (data extracts) to the data warehouse.
This way if the source system goes down the data warehouse is not affected and like wise if the DW server goes down the source server is not affected.
In your case can you create the audit table on the source system? This way you will process everything on the source server and only pull back the new, updated records. To make this work DTS would call the Store procedures from a SQL Execute Task or in the data pump task. This would stop you from using Linked Servers.
Myles
.
- References:
- Can I pick your brains for a second? transferring a large database problem
- From: Scott M
- RE: Can I pick your brains for a second? transferring a large database problem
- From: Peter Yang [MSFT]
- Re: Can I pick your brains for a second? transferring a large database problem
- From: Scott M
- Re: Can I pick your brains for a second? transferring a large database problem
- From: Myles.Matheson@xxxxxxxxx
- Re: Can I pick your brains for a second? transferring a large database problem
- From: Scott M
- Re: Can I pick your brains for a second? transferring a large database problem
- From: Myles.Matheson@xxxxxxxxx
- Re: Can I pick your brains for a second? transferring a large database problem
- From: Scott M
- Re: Can I pick your brains for a second? transferring a large database problem
- From: Myles.Matheson@xxxxxxxxx
- Can I pick your brains for a second? transferring a large database problem
- Prev by Date: Re: Can I pick your brains for a second? transferring a large database problem
- Next by Date: Reprocessing Question
- Previous by thread: Re: Can I pick your brains for a second? transferring a large database problem
- Next by thread: Re: Can I pick your brains for a second? transferring a large database problem
- Index(es):
Loading