Re: serialized binary files vs Sql Server Performance..

Tech-Archive recommends: Fix windows errors by optimizing your registry

Fabuloussites wrote:
I'm considering deploying an application that will us an IP address locaiton database provided by Ip2location.com...

http://www.ip2location.net/ip2location-dotnet-component.aspx

their .net component reads data from a binary file. I'm guess i'm wondering which of the two options would be best.

1) read data from the binary files (~27 mb or so)
2) or query a sql DB with the same info.

The database will have about 8 columns and ~ 1.8 millions rows.

i'm developing for a high traffic webisite, and i would like to query this DB to get the City info from the DB when a visitor first visits the site (based on their ip address).

Also, how do serialized binary files handle simultaneous file access? Would a high traffic webisite be able to use a serialized file efficiently if the file was read often?

Thanks!

I don't see reading from a file as a big problem (open read-only), but that's still a fair amount of data to parse (27MB). A database can handle that much data easily (they can handle many GBs of data no problem). Perhaps the best thing to do would be to benchmark both (like say, query it 1000 times each ways and compare how much time it took) and to do some load testing (not just 1 request after each other but many simultaneous queries). My guess is that the results (which one works best) will vary depending on how much traffic you have, the load on the server as well as the load on the database server. It's hard to predict accurately what would work best.

If you didn't need the city I'd recommend you have a look at this article http://www.eggheadcafe.com/articles/20051109.asp which manages to do it all in RAM (no file access or DB queries).
.

Relevant Pages

  • RE: serialized binary files vs Sql Server Performance..
    ... thanks for the info. i think i will try to get access to a sample database ... and use your methods to make my own binary files. ... how do serialized binary files handle simultaneous file access? ... >>> a high traffic webisite be able to use a serialized file efficiently if the ...
    (microsoft.public.dotnet.framework.aspnet)
  • Re: Generating one table with a terabyte of data
    ... I didn't know we could split a database file group over multiple HDs. ... > Run perfmon counters to a log and analyze them after a bulk load. ... Another thing is to split the updates across file sets. ... >> loading of daily data in the fastest time. ...
    (microsoft.public.sqlserver.dts)
  • Re: ORACLE RAC and ORACLE Standby
    ... standby is better for disaster recovery and RAC is ... with taking any downtime on your primary database instance. ... The standby database provides a local or off-site recovery instance. ... Load balancing capabilities of RAC include ...
    (comp.databases.oracle.server)
  • Re: Poser? What happens to empty pages in a database unload/load?
    ... At my company, several time each weekend, a database is unloaded at ... squeezed out of the load. ... I unload the table and load it back and now all those empty pages are ... Art S. Kagel ...
    (comp.databases.informix)
  • Re: Too many objects loaded at the same time and cause OutOfMemory exception.
    ... Stored procedures won't necessarily help here, ... allow the database to pre-plan the implementation. ... There should be a way to load objects without having to load all ... each student has 5 lessons. ...
    (microsoft.public.dotnet.framework.aspnet)