Re: import large text file

Tech-Archive recommends: Repair Windows Errors & Optimize Windows Performance

Robin,

Zipping the file only makes it smaller on the disk. It doesn't make it
have fewer records.

What do you mean by that, I really cannot understand what you mean with this
sentence. Do you mean that it is important for the loading time what the
database is loading. A loading a zippfile is just one transaction, which can
be written with an execute.nonquery and what I never be tried but should be
possible even to be read by an executescalar.

And you can't load a zip file into Access.

I find it great that you know what I can, an object is just an object and
can as far as I know be written as a bytearray (BLOB) in Access in the same
way as in SQL server.

Cor




Robin S.
---------------------------------------
"Cor Ligthert [MVP]" <notmyfirstname@xxxxxxxxx> wrote in message
news:eBBin74XHHA.4560@xxxxxxxxxxxxxxxxxxxxxxx
Robin,

But you can't load a zipped file into Access

Read my message to the OP until the last sentence. It has nothing to do
with space, loading a small file takes just less time than a hug file.

Cor

"RobinS" <RobinS@xxxxxxxxxxxxxxx> schreef in bericht
news:2ZedndmhQ4TJLnHYnZ2dnUVZ_sSmnZ2d@xxxxxxxxxxxxxx
But you can't load a zipped file into Access, can you? I don't get the
idea that his problem was disk space, but rather, loading the file in an
Access database.

Robin S.
---------------------------------------
"Cor Ligthert [MVP]" <notmyfirstname@xxxxxxxxx> wrote in message
news:e5MoH50XHHA.4000@xxxxxxxxxxxxxxxxxxxxxxx
Robin,

That is easy when a textfile is zipped it is mostly 100 times as small
and with that will improve the storing time.

Cor

"RobinS" <RobinS@xxxxxxxxxxxxxxx> schreef in bericht
news:17idnUWfMtKCo3HYnZ2dnUVZ_uSgnZ2d@xxxxxxxxxxxxxx
You posted this:

In your situation I surely would check if I am not able (and I am)
to make a Zip method in my program.
Then I can save it as a Image file.

And I don't understand how that helps the OP with his problem of
loading a large file into a database. So I'm asking for clarification.

Robin S.
---------------------------------
"Cor Ligthert [MVP]" <notmyfirstname@xxxxxxxxx> wrote in message
news:ude5SquXHHA.1388@xxxxxxxxxxxxxxxxxxxxxxx
Robin,

I am not sure if I understand you?

I know that updating a Jet database goes slow.

Cor

"RobinS" <RobinS@xxxxxxxxxxxxxxx> schreef in bericht
news:66Gdnb5spbLCMnbYnZ2dnUVZ_uGjnZ2d@xxxxxxxxxxxxxx
How does that get a big text file imported into an Access database?
I don't think it's the physical size of the file on the disk that's
a problem.

Robin S.
---------------------------------------
"Cor Ligthert [MVP]" <notmyfirstname@xxxxxxxxx> wrote in message
news:OiRaaVuXHHA.3272@xxxxxxxxxxxxxxxxxxxxxxx
mfrsousa,

In your situation I surely would check if I am not able (and I am)
to make a Zip method in my program.
Then I can save it as a Image file.

Cor

"mfrsousa" <mfrsousa@xxxxxxxxx> schreef in bericht
news:1173042613.051721.313220@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
hi there,

i have a huge large text file (350.000 lines) that i want to
import to
a MS Acccess Database, of course i don't want to use Access, but
do it
with C#.

i already have tried the AddRow method or Insert, reading each
line of
the text file, the problem of course is velocity, it would take
more
than 4 hours to add all lines/records to the database.




any suggestion?

thank you



















.

Relevant Pages

  • Re: Generating one table with a terabyte of data
    ... I didn't know we could split a database file group over multiple HDs. ... > Run perfmon counters to a log and analyze them after a bulk load. ... Another thing is to split the updates across file sets. ... >> loading of daily data in the fastest time. ...
    (microsoft.public.sqlserver.dts)
  • Re: import large text file
    ... Zipping the file only makes it smaller on the disk. ... Robin S. ... loading a small file takes just less time than a hug file. ... loading a large file into a database. ...
    (microsoft.public.dotnet.framework.adonet)
  • Re: "top" consumes 25% cpu time
    ... Actually it's a webserver - what has gotten slow is the page loading ... On my local test machine with local database (a ...
    (alt.os.linux.suse)
  • Delay navigation until image loads in vba
    ... I have an Access 2003 database where each record of the database is displayed, added to, and edited on a form. ... If the operator keeps tapping the navigation controls looking for a particular record, the image loading can't keep up, and this will eventually cause a run time error. ...
    (microsoft.public.access.formscoding)
  • Re: import large text file
    ... loading a small file takes just less time than a hug file. ... Access database. ... Robin S. ... Then I can save it as a Image file. ...
    (microsoft.public.dotnet.framework.adonet)