Re: best way to retrieve thousands of records.

From: Sahil Malik (contactmethrumyblog_at_nospam.com)
Date: 12/02/04 

Date: Thu, 2 Dec 2004 09:13:32 -0500

Cor,

I agree that the queries have to be optimized, but even if we assume the
best possible case, lets say the dataset actually lives prepared in a memory
mapped file, that you just have to do a load on - there still are the issues
of binding it and browsing it and the memory it consumes. It is going to
instantiate 103,000 datarows, and setup appropriate relations. And I don't
even want to think of what it takes to bind/browse 103,000 rows
appropriately.

No matter how fast the queries run, in my opinion the best solution would be
to reduce the dataset size by changing the UI a little bit. Once you have
that squared away, along with good Sql Queries you'd have a good practicable
solution.

And if he is asking us to optimize a datapull from 90,000 rows - then we
need to see the table structures and sql statements to comment accurately.

- Sahil Malik
http://dotnetjunkies.com/weblog/sahilmalik

"Cor Ligthert" <notmyfirstname@planet.nl> wrote in message
news:%23Hd3amE2EHA.3408@tk2msftngp13.phx.gbl...
> Sahil,
>
> That is often said too jaYPee in the language.vb newsgroup, I assume that
> is the reason he is optimizing now his datasets.
>
> However he is now telling in my opinion that he has 90.000 rows in his
> database, any clue to optimize that, because that can be really
> interesting when you are able to give that when you do not know what kind
> of database table that is and not know if it is already completly
> optimized.
>
> :-)
>
> Cor
>
>

Relevant Pages

  • Re: Help! Difficulty understanding DB -> Object mapping
    ... > Optimizing things like SQL queries depends upon the specific RDB schemas ... > Virtual memory is cheap. ... > Prefer single complex queries to multiple simple queries. ... in the past you had to have a pretty good knowledge of how the query was ...
    (comp.object)
  • Re: best way to retrieve thousands of records.
    ... No matter how fast the queries run, in my opinion the best solution would be ... - Sahil Malik ... > is the reason he is optimizing now his datasets. ... > of database table that is and not know if it is already completly ...
    (microsoft.public.dotnet.languages.vb)
  • Re: mysql
    ... > we do that on a freebsd install where I use mysqld_safe? ... optimizing in the documentation. ... big queries are actually using the indexes you think they are. ... A Microsoft Certified Systems Engineer is to computing what ...
    (freebsd-isp)
  • Re: access 2003
    ... I would focus on the queries behind the combo boxes. ... the Access 97 database, I wouldn't have thought any expressions would be ... When you select a customer and a job in the two combo boxes, ...
    (microsoft.public.access.conversion)
  • Re: access 2003
    ... I would focus on the queries behind the combo boxes. ... the Access 97 database, I wouldn't have thought any expressions would be ... When you select a customer and a job in the two combo boxes, ...
    (microsoft.public.access.conversion)