Re: data set fill causes app hang

Tech-Archive recommends: Repair Windows Errors & Optimize Windows Performance

From: Brian Henry (brianiupmsdn_at_newsgroups.nospam)
Date: 08/22/04


Date: Sat, 21 Aug 2004 20:52:05 -0400

well this app is a file importer, so it will load huge data sets into the
local machine, process them then push them back to the database server...
and running on a server that has 4 processors and 4GB of memory, so that
isn't a huge problem... just needed a way to get some sign of progress back
to the system :)

"William Ryan eMVP" <dotnetguru@comcast.nospam.net> wrote in message
news:uKGbu26hEHA.3992@TK2MSFTNGP11.phx.gbl...
>I see you foudn the answer but I'd like to offer my opinion if I may.
> 100,000 records is 'too' much . You can do a few things to make it
> better,
> but even with a background thread - you're not making it any faster you're
> just keeping it from blocking. Instead, I'd pull over smaller blocks and
> each time the user needs a records that's not there, pull over another
> block. This will have the same effect in many ways as another thread but
> will give you much better performance and won't eat up memory like 100,000
> records will. Also w/ update, you can use the OnRowUpdated event to get
> info back and update a progress bar.
>
> --
> W.G. Ryan MVP Windows - Embedded
>
> Have an opinion on the effectiveness of Microsoft Embedded newsgroups?
> Let Microsoft know!
> https://www.windowsembeddedeval.com/community/newsgroups
> "Brian Henry" <brianiupmsdn@newsgroups.nospam> wrote in message
> news:u4zZbhthEHA.632@TK2MSFTNGP12.phx.gbl...
>> when i have a dataset with 100,000 records (all new) and try to update it
>> back to the sql server 2000 database server it causes a application hang
>> (because it stops processing messages) until it is finished... is there
> any
>> way i can turn this update from the data adapter into a background
>> process
>> in a thread so it doesnt do this? i tried putitng it into a thread and
>> didn't seem to do anything but the same thing as it did outside of a
>> thread... does anyone know of a way to keep the app from hanging while
>> the
>> data set gets pushed back to the database? thanks
>>
>> also is there any way to get the progress of an update back to the
> database?
>> a large update process like 100,00 records takes some time, i'd like to
> have
>> some show of progress on screen.. thanks!
>>
>>
>
>



Relevant Pages

  • Re: Is 5.0.7 ready for production?
    ... >> the database is started. ... Spent six hours on that server last night and this morning. ... does kick in and reboot the server if I wait. ... Progress to start up, but if a wait a while the machine locks instantly ...
    (comp.unix.sco.misc)
  • Re: Prolog on a web server
    ... thrilled if you wanted to load it all into server VM:-/ ... rapidly build yourself a desktop app (Delphi? ... As for Prolog, it could surely be the basis of a decent ... grown-up database query language (an open standard dialect ...
    (comp.lang.prolog)
  • Re: Python Database Apps
    ... It's gonna be a desktop app. ... so that I don't need a database server on the client side. ... If you have an offline mode then the most important thing to work out ...
    (comp.lang.python)
  • Re: HELP PLEASE - need app to modify multiple MDB table designs simultaneously
    ... ONE database runs ONE application and EACH ... application runs only ONE web site and it work great this way. ... particular app, it would not be efficient to have ONE application run ALL ... web sites on my server. ...
    (microsoft.public.vb.com)
  • Re: HELP PLEASE - need app to modify multiple MDB table designs simultaneously
    ... ONE database runs ONE application and EACH ... application runs only ONE web site and it work great this way. ... particular app, it would not be efficient to have ONE application run ALL ... web sites on my server. ...
    (microsoft.public.inetserver.asp.db)