Re: Optimize large INSERT

Tech Tip: Click here to run a free scan for Windows Errors and optimize PC performance



No the problem is inserting 30 million records in general and
understanding how the DTS copy column transformation using the fast
load option compares to native the T-SQL insert.

Books online claims that DTS uses a buffer when it commits the
transformation in batches. However it is taking so long to do the
insert, I wonder if the transformation really writes 30 million records
to a buffer or if it re-queries the data after 1 or more batches.

I was only interested in the best index strategy for the insert step so
I could test and have a baseline.

Also, why can't clustered indexes be covering indexes? This makes no
sense to me at all.

.



Relevant Pages

  • Re: Transformation Data Task
    ... Make sure that DTS is Running in Transaction mode. ... make sure Commit on Successful package completion is True. ... > I'm using Transformation Data Task to copy data from one server to another ... I need source and destination connection parameter to set ...
    (microsoft.public.sqlserver.dts)
  • Re: Transformation Data Task
    ... Make sure that DTS is Running in Transaction mode. ... make sure Commit on Successful package completion is True. ... > I'm using Transformation Data Task to copy data from one server to another ... I need source and destination connection parameter to set ...
    (microsoft.public.sqlserver.dts)
  • Re: Optimize transformation
    ... I am using one copy column transformation for each column. ... T-SQL: I have considered this. ... difference between DTS and plain T-SQL? ...
    (microsoft.public.sqlserver.dts)
  • Re: How to automatically "map" the transformations in Transform Data Task?
    ... source column names and destination column names are the same then no ... DTS will do that for you. ... Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) ... >> You then need to add 1 or more Transformation Object ...
    (microsoft.public.sqlserver.server)
  • Re: How to automatically "map" the transformations in Transform Data Task?
    ... source column names and destination column names are the same then no ... DTS will do that for you. ... Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) ... >> You then need to add 1 or more Transformation Object ...
    (microsoft.public.sqlserver.dts)