Re: other table that stores data differently than ADO.Net datatable?
From: Nicholas Paldino [.NET/C# MVP] (mvp_at_spam.guard.caspershouse.com)
Date: 09/08/04
- Next message: Mike D: "sqlConnection question"
- Previous message: Dante: "Compressing soap content"
- In reply to: VMI: "Re: other table that stores data differently than ADO.Net datatable?"
- Next in thread: VMI: "Re: other table that stores data differently than ADO.Net datatable?"
- Reply: VMI: "Re: other table that stores data differently than ADO.Net datatable?"
- Messages sorted by: [ date ] [ thread ]
Date: Wed, 8 Sep 2004 16:43:46 -0400
I have to ask, what human can possibly process 500K records at one time?
Think of things like paging, etc, etc, to cut down on the result set and
then display that. I would definitely say that this is the kind of scenario
where some out of the box thinking would be a good thing.
--
- Nicholas Paldino [.NET/C# MVP]
- mvp@spam.guard.caspershouse.com
"VMI" <vonchi_m@yahoo.com> wrote in message
news:%23jNQE6dlEHA.3520@tk2msftngp13.phx.gbl...
> But there may be a possibility that a certain query will return 500K
> records. In that case, I'd need to load those 500K records into the table.
>
>
> "Lateralus [MCAD]" <dnorm252_at_yahoo.com> wrote in message
> news:OaiDo2dlEHA.2948@TK2MSFTNGP11.phx.gbl...
>> I think you may want to take another approach. Are there any fields you
> can
>> filter on? For instance you may have a foreign key to a lookup type
>> table.
> I
>> would suggest making some sort of a "search" type of screen and filter
> your
>> records that way. Just dynamically build a SQL statement using the search
>> criteria for your where clause, that will help slim down your list. If
> your
>> data is not normalized this may be a bit difficult. You can page your
>> results with a DataGrid in ASP.Net, but I don't think you can with
> winforms.
>>
>> HTH
>>
>> --
>> Lateralus [MCAD]
>>
>>
>> "VMI" <vonchi_m@yahoo.com> wrote in message
>> news:Oh8dnzdlEHA.3392@TK2MSFTNGP15.phx.gbl...
>> > Thanks for your replies.
>> > We were initially working with 10,000-15,000 records and we never
> imagined
>> > that these records would reach 1 million, so it's really something we
>> > didn't
>> > think through very well (aka a design flaw).
>> > We've already migrated the data to database but we don't exactly know
> how
>> > to
>> > query the database everytime the user does a scroll (or page up/page
> down)
>> > in the grid. What event should we capture in order to query the DB
>> > again
>> > and
>> > fill the table? Also, I assume we need to create a Select statement
>> > that
>> > will display the next N records once the user has reached the last
> visible
>> > record in the grid/datatable (in pseudocode: "Select the next N records
>> > from
>> > table following the last record displayed"). That's what we haven't
>> > been
>> > able to figure out.
>> >
>> > Any help is appreciated.
>> >
>> >
>> > "VMI" <vonchi_m@yahoo.com> wrote in message
>> > news:uMKEpVdlEHA.2680@TK2MSFTNGP15.phx.gbl...
>> >> We have this huge application that's based on storing tons of data on
>> >> a
>> >> dataTable. The only problem we're having is that storing LOTS of data
> (1
>> >> million records) into a datatable will slow down the system since all
>> >> this
>> >> data will be stored in memory. The performance is really affected with
>> > this.
>> >> Since we don't really want to redesign everything based on this
>> >> datatable,
>> >> are there any companies that offer a product similar to the datatable
>> >> that
>> >> stores lots of data in a more efficient way? Basically, we load all
> this
>> >> data (it's a one-shot process) into the datatable and work with that.
> We
>> >> don't want to change any of that; we just want something similar to
>> >> the
>> >> datatable that stores a better way. Also, the windows datagrid should
> be
>> >> able to bind to this new table without many problems.
>> >>
>> >>
>> >> Thanks.
>> >>
>> >>
>> >
>> >
>>
>>
>
>
- Next message: Mike D: "sqlConnection question"
- Previous message: Dante: "Compressing soap content"
- In reply to: VMI: "Re: other table that stores data differently than ADO.Net datatable?"
- Next in thread: VMI: "Re: other table that stores data differently than ADO.Net datatable?"
- Reply: VMI: "Re: other table that stores data differently than ADO.Net datatable?"
- Messages sorted by: [ date ] [ thread ]
Relevant Pages
|
