Data Insertion

Tech-Archive recommends: Repair Windows Errors & Optimize Windows Performance

From: Dave (anonymous_at_discussions.microsoft.com)
Date: 03/24/04 

Date: Wed, 24 Mar 2004 01:56:07 -0800

Hi All,

I am working with C#, SQL CE and ADO.net using the .net compact framework on a PDA.

I need to populate quite large tables from XML.
Initially I just used Dataset.ReadXML but this quickly ran into memory problems with large amounts of data.
I am now using XmlTextReader to read the data in piecemeal fashion.

It has been suggested to me that I read a single record from the XML and then insert each record one by one and work my way through the XML.
This seems far too clumsy.
I would rather extract a certain amount of data to a dataset and then update the table regularly.
Is this possible or is there another simpler more efficient way of adding the data?

Thanks,
Dave

Relevant Pages

  • Re: Random file access -cont
    ... I use a text file format similar to CSV. ... for reasonably small amounts of data - a few thousand records - but it ... recommend XML unless the data volume is very small. ... .Net Compact Framework MVP ...
    (microsoft.public.dotnet.framework.compactframework)
  • Re: XML and its uses
    ... The use of XML for data-exchange is largely a done deal, with vast ... amounts of software available, plentiful skills, relatively simple data ...
    (comp.text.xml)
  • Stored Proc Parameter
    ... I'm retrieving huge amounts of data from a local news service. ... The data is returned as XML and is processed by a stored proc, ... The only thing I can think of is processing the XML ...
    (microsoft.public.sqlserver.programming)
  • Performance issues with large ResultSet
    ... containing large amounts of data. ... rows and although the database query only takes 0.9 seconds, ... // build XML ... xmlResult is of type String, could this be causing performance issues? ...
    (comp.lang.java.programmer)
  • Data Insertion
    ... I need to populate quite large tables from XML. ... Initially I just used Dataset.ReadXML but this quickly ran into memory problems with large amounts of data. ... It has been suggested to me that I read a single record from the XML and then insert each record one by one and work my way through the XML. ...
    (microsoft.public.dotnet.framework.adonet)