Re: Bulk insert into Database

Tech Tip: Click here to run a free scan for Windows Errors and optimize PC performance

From: Baz (Baz-at_no-spam.com)
Date: 04/12/04


Date: Mon, 12 Apr 2004 17:55:52 -0400

Thanks for the reply Bill. Your post confirms what I suspected.

We might end up using Oracle. Does Oracle have a command similar to bcp?

Baz

"William Ryan eMVP" <bill@NoSp4m.devbuzz.com> wrote in message
news:uZq45bNIEHA.2576@TK2MSFTNGP09.phx.gbl...
> Baz:
>
> Are you using SQL Server? This is probably well suited to DTS or BCP.
You
> can do it with dataset, but at present, ADO.NET is a dataaccess technology
> that's not really intended to bulk transfers. DataSet's contain a bunch
of
> information (ie diffgram) that tracks rowstate so that the dataadapter
knows
> what it'll need to do , so yes, it's much better suited to update
scenarios.
> BCP is probably the fastest way to get data around so i'd go for it if
> possible
>
> HTH,
>
> Bill
> "Baz" <Baz-at_no-spam.com> wrote in message
> news:%23D$Qx0MIEHA.2128@TK2MSFTNGP11.phx.gbl...
> > Hi,
> >
> > I am designing an application that needs to do the following on a daily
> > basis:
> > - Parse XML files & extract relevant information. The number of XML
files
> is
> > in thousands...
> > - Write the extracted information to a database.
> >
> > I was considering the use of Datasets for this application. However,
> aren't
> > Datasets more suited in situations where you select (query) some data
from
> > the database & perform updates on it? Would Datasets be efficient in
cases
> > where there is only one-way communication between the client & database
> > server, i.e., data only travels from the client to server & only bulk
> > inserts are performed.
> >
> > If Datasets aren't the best way to approach this, could I get some
> > suggestions on how to design this? Would it be more efficient to extract
> > records into a flat file & write those to a database using a stored
> > procedure?
> >
> > Any suggestions welcome.
> > thanks!
> >
> >
>
>



Relevant Pages

  • Re: Bulk insert into Database
    ... I haven't used Oracle since 8i but I believe SQL Loader is the equivalent. ... > Thanks for the reply Bill. ... This is probably well suited to DTS or BCP. ...
    (microsoft.public.dotnet.framework.adonet)
  • Re: Idempotence of this function met with a concatenation ?
    ... I have table bcp that contains more than 1.100.000 records. ... It has a NAME_UPPER indexed field that contains standardized ... An index range scan is how oracle ... An index range scan doesn't work well as an execution plan when you ...
    (comp.databases.oracle.server)
  • creating view to select unique records
    ... I am unsure if similar question has already been posted to this group. ... If so please point me to the relevant post/group.. ... we would do an bcp out of the table ... and load it into oracle via sqlldr. ...
    (comp.databases.sybase)
  • Oracel Linked server Problem
    ... We are trying to use linked server to oracle. ... If i do bcp out and sql loader in to oracle it is just few seconds. ...
    (microsoft.public.sqlserver.dts)