Re: Bulk insert into Database

From: William Ryan eMVP (bill_at_NoSp4m.devbuzz.com)
Date: 04/12/04 

Date: Mon, 12 Apr 2004 17:37:22 -0400

Baz:

Are you using SQL Server? This is probably well suited to DTS or BCP. You
can do it with dataset, but at present, ADO.NET is a dataaccess technology
that's not really intended to bulk transfers. DataSet's contain a bunch of
information (ie diffgram) that tracks rowstate so that the dataadapter knows
what it'll need to do , so yes, it's much better suited to update scenarios.
BCP is probably the fastest way to get data around so i'd go for it if
possible

HTH,

Bill
"Baz" <Baz-at_no-spam.com> wrote in message
news:%23D$Qx0MIEHA.2128@TK2MSFTNGP11.phx.gbl...
> Hi,
>
> I am designing an application that needs to do the following on a daily
> basis:
> - Parse XML files & extract relevant information. The number of XML files
is
> in thousands...
> - Write the extracted information to a database.
>
> I was considering the use of Datasets for this application. However,
aren't
> Datasets more suited in situations where you select (query) some data from
> the database & perform updates on it? Would Datasets be efficient in cases
> where there is only one-way communication between the client & database
> server, i.e., data only travels from the client to server & only bulk
> inserts are performed.
>
> If Datasets aren't the best way to approach this, could I get some
> suggestions on how to design this? Would it be more efficient to extract
> records into a flat file & write those to a database using a stored
> procedure?
>
> Any suggestions welcome.
> thanks!
>
>

Relevant Pages

  • Re: How to manage the transaction log
    ... Just remember to backup the database before the BCP ... I am using the SQL Server 2005 Express. ... I set the Autogrowth of log file unrestricted. ...
    (microsoft.public.sqlserver.tools)
  • Re: Data migration in MSDE
    ... > database and have VB as the front end. ... list all actions, .sql DDL files, BCP to be executed, like ... personally I based this app on SQLDMO.... ... references to the described files and execute ...
    (microsoft.public.sqlserver.msde)
  • Re: How to manage the transaction log
    ... I created the database with "Simple" Recover Model. ... Just remember to backup the database before the BCP ... I am using the SQL Server 2005 Express. ... I set the Autogrowth of log file unrestricted. ...
    (microsoft.public.sqlserver.tools)
  • Re: Reposting: How to extract (and email) only 1 clients data fro
    ... > Few days back someone was mentioning that they use log files to do these ... in order to "read" that mailed data, you have to prepare a test ... database and, as per my sample, bulk load data from the mailed archive.... ... you did BCP out first, ...
    (microsoft.public.sqlserver.msde)