Re: Performance of processing

there is no benchmark like this.
the number of components is too large to provide a performance / hardware
formula:
speed of the source database(s) (your OLTP source databases or flat files)
speed of the destination disks
speed of the disk controller (and memory cache)
type of Raid
speed and amount of memory
type and complexity of your ETLs transformations
number of columns in the tables
number of indexes in the tables
level of aggregations in the cubes
number and type of partitions
number of dimensions in the cubes
number of processes in parrallel
separates or shared server for database and cubes
speed of the network
speed and number of CPUs
IO architecture (Intel vs AMD)
and others...

again and again, there is no miracle: test and growth!

I have setup a lot of servers for DW & OLAP usage and on the paper the
servers should works fine or 1 better then the other, but in fact its not
always true due to too many parameters.
But from my experience:
use direct attached storage and the SAS technology, ignore SCSI drives and
controllers for DW usage they limit you
During sequential access using 15Krpm or 10Krpm drive provide no
differences. SAS controllers provide better throughput and are more scalable
then SCSI controllers (take a look at the TPC.org site)

the latest Intel CPU are incredible, but Opteron CPUs provides a constant
performance (there is less IO issues)
I have an Intel server where all individual benchmarks (disk, memory, cpu)
results are excellent compared to the Opteron server, but during real usage
where the 3 components works at the same time the Opteron server is finally
better, because there is no IO bottleneck!!!
take the highest Ghz you can instead of more CPU with lower frequency.

good luck in your setup :-)

Jerome.


"herman" <rhermaszewski@xxxxx> wrote in message
news:edrapb$av$1@xxxxxxxxxxxxxxxxxxxxxxx
Hi



Is there any place that I can find some benchmarks, tests regarding
performance o professing cubes and ETL process.

I have to calculate how long will the whole process (ETL and processing
the cubes) will take on a particular hardware.

I also need some information how can I determine the appropriate hardware
setup to accomplish processing cubes in a particular time.



Regards

Radek








.

Relevant Pages

  • Re: Performance of processing
    ... level of aggregations in the cubes ... I have an Intel server where all individual benchmarks (disk, memory, cpu) ... the cubes) will take on a particular hardware. ...
    (microsoft.public.sqlserver.olap)
  • Re: Dealing with SSL processing via hardware
    ... If the "hardware" is basically just a single CPU computer with Linux and OpenSSL installed on ROM wrapped in a sealed box, then I would suppose you could emulate the exact same performance characteristics by adding another CPU to your main server computer and only using that CPU for running the same SSL and socket software you would have inside the sealed box. ...
    (borland.public.delphi.non-technical)
  • Re: Olap Cube excessive processing time
    ... You can see poor performance with OLAP cubes when you hardware is not ... And Project Server on the SQL side, ... Plus the hardware being used on the server running the Views Notification ... it's usually not best practice to build OLAP cubes every day. ...
    (microsoft.public.project.pro_and_server)
  • Re: Server keeps dying silently
    ... having narrowed down the obvious hardware suspects. ... I purchased a used server (ok alarm bells ring but don't diss the purchase ... P4 2.4 CPU ... Could it possibly be bad capacitors? ...
    (microsoft.public.windows.server.general)
  • Re: Server keeps dying silently
    ... having narrowed down the obvious hardware suspects. ... I purchased a used server (ok alarm bells ring but don't diss the purchase ... P4 2.4 CPU ... Could it possibly be bad capacitors? ...
    (microsoft.public.windows.server.general)
Loading