Re: XML, Memory, DOM, VFP9

Tech-Archive recommends: Repair Windows Errors & Optimize Windows Performance

From: Gar (Gar_at_discussions.microsoft.com)
Date: 01/30/05


Date: Sun, 30 Jan 2005 05:31:03 -0800

Thanks for the info David.

"David Frankenbach" wrote:

> Gar,
>
> The XMLDOM is not all that well suited to handling large datasets like this.
> CursorToXML works fast because it's not using the DOM to generate the text
> output of the document.
>
> XMLToCursor though does use the DOM which means that the amount of memory
> required is 2-3 times the XML size plus the amount of time it actually takes
> to construct the 70k * 97 nodes in the document. You will never be satisfied
> with the performance on a document that big.
>
> You should look at using a SAX parser or put together your own XML document
> reader in VFP. The performance will be a whole lot better.
>
> --
> df - Microsoft MVP FoxPro http://www.geocities.com/df_foxpro
>
> "Gar" <Gar@discussions.microsoft.com> wrote in message
> news:76D2F12A-F6D1-4334-888E-9F62B0C97614@microsoft.com...
> > XML, Memory, DOM, VFP9
> > Given a table with these characteristics:
> > 70K records, 54 meg table, 97 fields, 794 total width
> >
> > I am having a problem with xmltocursor. It seems to time out or fail all
> > together.
> > Cursortoxml works fine and creates a 134 meg xml file. W2K, 512 meg ram.
> > Cursortoxml works fine if I use the same structured table with 1309
> > records
> > (but is slow, 7 seconds). Is the time out or failing a memory problem
> > since
> > it's using DOM by default, and if so or not, any suggestions? And does 7
> > seconds sound about right for xmltocursor for those 1309 records worth of
> > data?
> >
> > Thank you for any help
>
>
>



Relevant Pages

  • Re: sqlite or xml
    ... is if there is large amount of data, sqlite would be better as far as ... implementation would require parsing the entire XML document to build ... Relational databases on the other hand are designed for ... then you'll find accessing your data becomes slower and ...
    (comp.lang.python)
  • Re: Problem parsing namespaces with xml.dom.minidom
    ... It wouldn't need to conform to the official specifications of the DOM ... I need to be able to parse a namespace-using XML document ... into some kind of node tree, and then being able to query the tree to ...
    (comp.lang.python)
  • Re: Xerces c++ xml log
    ... the xml document when i'm doing the following instruction of code: ... the xerces return an xercesc::XMLException saying "Could not open ... then you can use DOM to serialize just one record instead of the ...
    (comp.text.xml)
  • Re: xml.xmldocument.load does it load document to memory?
    ... > I am making a simple app that groups files together by storing them into ... an xml document. ... It gets loaded into memory COMPLETE in an in-memory tree representation, ... DOM is supposed to work in general). ...
    (microsoft.public.dotnet.framework)
  • Re: XML Structuring in classes
    ... I have the task of reading in an XML document. ... There are nuances ... (The DOM is BIG.). ...
    (microsoft.public.vb.general.discussion)