Newbie: Need advice with database manipulation decision

From: steve (noemail._at_try.com)
Date: 10/13/04 

Date: Wed, 13 Oct 2004 09:51:29 -0400

Hello,

Firstly, I want to apologize if this question reaches the borders of "out of
topic" but i think both the ado.net and the vb.net groups have a lot to do
with it.

I created a small application that is supposed to manipulate meteorological
and Air Quality data stored in an SQL Server Database.

So far I've created the first "view" which only shows station info and
details. I did this using datasets, since the number of stations is quite
small. I needed to relate a couple of tables so i used
dataset.relations.add( ), and synchronized/binded the data to various
controls. So far so good .

Now comes the harder part:
I need, *after* an involved query(ies) to get a whole bunch of data (e.g.
20,000 rows X 30 columns) and then perform mathematical/statistical
operations on them. For example get a moving average. Also allow the user to
save them in a text file to be imported later into Excel.
-OR-
Scan through all the data from a specific station and through Date/Time
methods find out *exactly* how many actual *calendar* days are missing.
-ETC.-

>From what you see, there are TWO important points:
1) Quite a "big" number of data
2) Data will need to be manipulated through programming since SQL would not
be enough (or too complicated)., therefore store the data locally.

Can you give me the keywords of the tools I should be looking into?
-Datareader VS Dataset
-Where should I store my data for easier manipulation? Multidimensional
array?
-How can i export to Excel? or i have to save as text and then import to
Excel?
-????

Any help/suggestions would be *greatly* appreciated!

TIA
_steve_

Relevant Pages

  • Newbie: Need advice with database manipulation decision
    ... I created a small application that is supposed to manipulate meteorological ... save them in a text file to be imported later into Excel. ... Scan through all the data from a specific station and through Date/Time ... therefore store the data locally. ...
    (microsoft.public.dotnet.framework.adonet)
  • Re: dummy needs help with Python
    ... I just want to read two CSV files and match them on several fields, manipulate some of the fields, and write a couple of output files. ... cost_center, store, location, manager_id = line ... If there's such urgency, I hope you resorted to simply using one of these multitude of other languages you know -- Even in C, this wouldn't be too painful as projects go. ... Python text I bought is not easy to understand. ...
    (comp.lang.python)
  • RE: Store Added Value List Items
    ... station to station. ... Property set to a Combo Box and The Row Source Type set to Value List. ... When users in my database want to add a new customer they select the button ... random set of choices for the user to store for this particular field in the ...
    (microsoft.public.access.formscoding)
  • Re: Data from Access database needed in Excel spreadsheet...how to do it?
    ... > of projects in your crosstab, ... > rule it's much preferable to manipulate data at the set level with SQL ... > Column Headings property of the query (in SQL view, ... > Sample Excel automation ...
    (microsoft.public.access.externaldata)
  • I was ending to stick you some of my nearby wounds.
    ... Agha's mode engages against our pillar after we manipulate until it. ... She might store once, get briefly, then occupy contrary to the ... one at times the ceiling. ...
    (rec.arts.drwho)