Re: DTS Process Cube Task

From: Dave Wickert [MSFT] (dwickert_at_online.microsoft.com)
Date: 02/19/04 

Date: Thu, 19 Feb 2004 17:35:38 -0500

Yes. It has a command-line interface -- so you would use a DTS Process Task
to start it working. 

-- 
Dave Wickert [MS]
dwickert@online.microsoft.com
Program Manager
BI Practices Team
SQL BI Product Unit (Analysis Services)
--
This posting is provided "AS IS" with no warranties, and confers no rights.
"Asa Monsey" <Asa@NoMoreViri.com> wrote in message
news:6B933412-6256-404F-9724-FAC8BE501CD7@microsoft.com...
> Dave,
>
> Actually, My problem was that the process was not ending, and there was no
error or status to indicate why.
>
> Through trial and error and a lot more web searching, I found that I had a
private dimension that contained more than 2 million members.   In fact, it
had one member for every row of the fact table.  The strange thing was that
occasionally the cube would process, and that was throwing me off.  Analysis
Services finally gave up the ghost and started giving me the member with key
'' could not be found error.  This led me to research on the web that made
me conclude that the dimension was to large and was causing memory errors
(we are running Win2K server with 3GB of memory).
>
> I have since made the dimension shared, which causes it to be processed
separate from the cube, and simplified it to 1.2 million members at the cost
of some precision in selecting query criteria, which can be made up by being
more precise in selecting related dimensions.
>
> Your post does answer a question I had about the difference between DTS
and the ParallelProcess tool you released in the newsgroup last year.  Would
I be correct to assume that I could install that tool on the server and run
it from DTS to process more than one cube in parallel?
>
> Thanks,
> Asa Monsey
>
>
>      ----- Dave Wickert [MSFT] wrote: -----
>
>      The DTS OLAP Processing task is a VB component written which uses
>      single-appartment model threading. This means that only one can be
>      in-progress at a time even through your workflow makes it looks like
they
>      should be happening in parallel. To truly run it in parallel you have
to
>      place it in a different package and invoke it via a Process Task and
issue a
>      DTSRUN of the package from the command-line.  Books-On-Line will
explain how
>      to run a package from the command-line. When you do it this way, an
entirely
>      new process is started. By executing it as a sub-package, the
threading is
>      done in-process in the master package's thread pool -- and thus you
run into
>      issues if one of the components are single-appartment model threaded
(like
>      all VB components are).
>      Hope this helps.
>      -- 
>      Dave Wickert [MS]
>      dwickert@online.microsoft.com
>      Program Manager
>      BI Practices Team
>      SQL BI Product Unit (Analysis Services)
>      --
>      This posting is provided "AS IS" with no warranties, and confers no
rights.
>
>
>      "Asa Monsey" <Asa@NoMoreViri.com> wrote in message
>      news:78DE41D0-38D6-45C7-9BA6-A65952B3BBFF@microsoft.com...
>      > Hi all,
>      >> I have a DTS package that manages my overall ETL process.  Within
this
>      package, I fire another package that processes my dimensions, then
processes
>      all of my cubes.  I have workflow steps setup so that the dimension
step has
>      to succeed before the cubes get reprocessed, but all of the cubes can
run
>      simultaneously. In reality, it seems that only one cube gets
processed at a
>      time.  The DTS package step within the master package is set to run
on the
>      main package thread.  I start the overall process using a SQL Agent
job.
>      The DTS packages are set to log to the msdb database, and the Agent
job is
>      logging to a file.
>      >> My problem is that when the SQL Agent runs the processing job, it
hangs on
>      one of the process cube steps.  In the Package Log, it shows the step
run
>      status as 0 (zero) with no details.  The SQL Agent log does not show
an
>      error. In fact, the last line of the log it typically truncated and
refers
>      to an earlier step than that which I know was last completed. During
this
>      time, the Analysis Server is hung, and no connections are allowed.
The only
>      way to free the OLAP service is to restart it.
>      >> When I run the steps manually, or even run the child package that
process
>      the OLAP objects, it works fine.  It seems that it is only when the
full
>      process is started by SQL Agent that it gets hung.
>      >> My frustrations are that it used to work fine a couple of weeks
ago and
>      that I have not been able to discover a way to find out what is
causing the
>      process to hang.  There are no error messages being written to any of
the
>      log files.
>      >> If anyone could provide a suggestion as to what is causing this or
how to
>      diagnose it, I would be very appreciative.
>      >> Thanks,
>      > Asa Monsey
>
>
>

Relevant Pages

  • Re: DTS Process Cube Task
    ... Your private dimension sounds like it's exceeding the transaction ... See if you can consistently process just that cube *by ... So you may end up with separate DTS packages to get everything ... >> place it in a different package and invoke it via a Process Task ...
    (microsoft.public.sqlserver.olap)
  • RE: Problems scripting a DTS package that processes a cube
    ... Have you made sure that the "Execute on main package thread" checkbox is checked in the Options tab of the Workflow Propeties dialog for the DTS step that processes the cube? ... > The execution of the following DTS Package failed: ...
    (microsoft.public.sqlserver.olap)
  • RE: Process cube through programming
    ... Dear Nin, ... If u read my questation in deep then i want to tell u that creating a DTS ... package is not the best option and not even good with other application i ... > fisrt of all i want to know that after creating these cube have you designed ...
    (microsoft.public.sqlserver.olap)
  • Re: Cube Design Question
    ... > the package name itself, ... > rows from the cube. ... > the Project level to the Package level, and you will see a package ... you can go into the dimension ...
    (microsoft.public.sqlserver.olap)
  • Re: DTS OLAP Cube processing
    ... you will have to process the whole cube anyways. ... send me a package to my e-mail. ... > I am doing this by making local package in DTS, for processing it requires 15 GB ... > of space in tempdb database. ...
    (microsoft.public.sqlserver.olap)
Loading