Re: ETL usage
- From: "Peter Nolan" <peter@xxxxxxxxxxxxxx>
- Date: 30 Oct 2006 10:08:46 -0800
Hi Soalvajav,
to the best of my knowledge no vendor generates 'ETL on the fly' as
there is a design time process and a run time process to all these
things.....
That is...at design time you some how have to encode your mappings into
a tool.
Then when the mapping 'runs' it performs those design time
instructions...
I can assure you none of the leading ETL tools do it any differently
than that.....
What we have done is a bit different because we have cut out the
'coding' of the mappings into the ETL tool.
We take the mapping spread***...and you have to define you mappings
somewhere and a spread*** is as good a place as any.......and we
generate the ETL subsytem at 'design time'....this effectively removes
the need for ETL programmers (sorry guys) when using our etl tools.....
They are downloadable and free for development/prototyping.....only
limitation is the name of the database you must connect to.....
We have also developed the ability to print ETL programmer
specificationfrom the mapping spread***...so far we have only done
INFA program specs because a client asked for it...in many cases
clients use our ETL software to build the complete prototype including
ETL subsystem before then converting the ETL to their 'strategic' ETL
tool....usually INFA or DataStage.
Best Regards
Peter
www.peternolan.com
Jeje wrote:
I write script which generate something (like tables, SP, views...)
and creating these scripts takes a lot of time to debug them.
So creating scripts which generate scripts etc... can be good, but when you
have hundreds of same things to do.
in an ETL process, its rare to have to do 2 times the exact same things.
but if you have the time to, you can do this.
SSIS packages are XML files, so you can generate these file by creating your
own tool.
Personnaly I have never created this type of tool to generates my packages
because there is too many transformation to do etc...
Can you describe which type of generation you looking for?
sometimes there is other options then creating scripts by script.
<soalvajavab1@xxxxxxxxx> wrote in message
news:1159313134.633124.115450@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
I heard from my collegue that in FME and some other ETL tools you will
creating scripts and scripts will create GUI and Mappings and it is
more effecient!
Does Informatica be able to do the same thing?
If yes, how and why we do not usually use it?
If no, what is the reason?
And generally does this make sense? ( Having script and ETL create
mapping and tranformation on the fly? )
.
- References:
- Re: ETL usage
- From: Jeje
- Re: ETL usage
- Prev by Date: Re: DataWarehouse
- Previous by thread: Re: ETL usage
- Next by thread: Re: VLDB nearing 85% space utilization on underlying drives.
- Index(es):
Loading