RE: data warehousing advice

Tech-Archive recommends: Repair Windows Errors & Optimize Windows Performance

You can use a concept like a Load_Id to keep track of your loads instead of
using transactions.

If some loading failed, you can easily undo the load by Load_Id.

Hope it helps
--
Shin
MS SQL Server


"Derek" wrote:

i've read the kimball books and i've created my staging tables and
star schema (dimensions and facts). Now i need advice on my ETL (I am
using SQL Server 2005 Standard Edition).

For extract, I plan on pulling in csv files via FTP into my warehouse
server. i will then bulk insert this data into stage tables. From
the stage tables, I will transform the data and load my dimensions and
facts.

this is my question:

To keep the dimensions and facts from getting corrupted I was going to
put a transaction across the whole dimension and fact loading process
(one giant transaction). But I'm afraid of tempdb or the log file
getting huge. Is this a good idea or is there a better way? My
warehouse is set to simple recovery mode.


thanks in advance!

.

Relevant Pages

  • Re: Satellite Internet
    ... you actually have several transaction taking place at once and some ... Each transactionn or data stream has ... at least two 22,500 mile paths in the down load (actually longer ... wire to ground based servers and then the back bone and the server you ...
    (rec.outdoors.rv-travel)
  • Re: HttpWeb Request from Class Library fails to 500
    ... In both classes I have a database transaction going on. ... I was committing the transaction and then trying to load the ... > SevDer ... >> some further detailed info on the asp.net page you request... ...
    (microsoft.public.dotnet.framework.aspnet)
  • Re: HttpWeb Request from Class Library fails to 500
    ... In both classes I have a database transaction going on. ... I was committing the transaction and then trying to load the ... > SevDer ... >> some further detailed info on the asp.net page you request... ...
    (microsoft.public.dotnet.framework.aspnet)
  • Re: Re: Satellite Internet
    ... you actually have several transaction taking place at once and some ... Each transactionn or data stream has ... at least two 22,500 mile paths in the down load (actually longer ... wire to ground based servers and then the back bone and the server you ...
    (rec.outdoors.rv-travel)
  • Re: Problem trying insert data into a temp table via SP
    ... needs to load some data into a temp table. ... But throws another exception, -535 (Already in transaction), this ... fact that DB-Access is a separate session will kill you again - ...
    (comp.databases.informix)