Re: merge multiple databases

Tech-Archive recommends: Speed Up your PC by fixing your registry

From: DIOS (sindizzy.pak_at_softhome.net)
Date: 05/14/04 

Date: Fri, 14 May 2004 04:44:00 GMT

My results were astonishing. As YYZ commented the SQL version was way
faster.
Here are my results:

Test applied to merging 8 databases with three tables each. 4 medium sized
databases
and 4 small databases. Four runs were applied and the times were avearged.

Record Looping method: 410 seconds
SQL UPDATE method: 57 seconds

The record looping method had more status updates via a label but the
difference wa still
heavily favoring the SQL method.

Thanx for all the help guys.

AGP 

-- 
**********************************************************************
Unpak my email address before sending me personal email
**********************************************************************
"YYZ" <notapplicable> wrote in message
news:eqq9q37NEHA.3452@TK2MSFTNGP10.phx.gbl...
> "DIOS" <sindizzy.pak@softhome.net> wrote in message
> news:UH7oc.72168$Ik.5216674@attbi_s53...
> > That is a very interesting algoithm. It might work so ill give it a
shot.
> > I will create the tempID fiields and then run my queries and updates
against
> > those
> > and just inputa  temp number for tha actual Ids until i fill them in. I
have
> > the iteration
> > algorithm already written but this eems like it may be more efficient
and
> > faster.
>
> In my experience, it should be IMMENSELY faster.  We were doing somewhat
the
> same thing a while ago, copying down a "library" of materials and other
things.
> Initially, we were selecting everything into a recordset, then inserting
into
> the local database.  Once we changed the logic to select from one DB
directly
> into the other, it sped the process up over 100x if I remember correctly.
>
> > I will post my comparisons.
>
> Please do!  I'd be interested to see how it fares.
>
> Matt
>
>

Relevant Pages

  • Re: merge multiple databases
    ... As YYZ commented the SQL version was way ... Test applied to merging 8 databases with three tables each. ... The record looping method had more status updates via a label but the ...
    (microsoft.public.vb.database.dao)
  • Re: merge multiple databases
    ... As YYZ commented the SQL version was way ... Test applied to merging 8 databases with three tables each. ... The record looping method had more status updates via a label but the ...
    (microsoft.public.vb.general.discussion)
  • Re: Database Design - 3000+ users
    ... locking issues for updates,, on a properly ... Wayne Snyder, MCDBA, SQL Server MVP ... > My boss wants to partition the data into different databases based on ...
    (microsoft.public.sqlserver.server)
  • Re: VIEWS
    ... databases, different projects, different folders on the same local disk? ... Still it would be two separate views with seperate ... needed for the updates. ... leaves you alone at a certain complexity of the SQL, ...
    (microsoft.public.fox.programmer.exchange)
  • Re: merge multiple databases
    ... As YYZ commented the SQL version was way ... > and 4 small databases. ... > SQL UPDATE method: 57 seconds ... > The record looping method had more status updates via a label but the ...
    (microsoft.public.vb.database.dao)