MS SQL Data Warehousing

Author

ETL usage

soalvajavab1@yahoo.com

2006-10-25, 6:00 am

I heard from my collegue that in FME and some other ETL tools you will
creating scripts and scripts will create GUI and Mappings and it is
more effecient!

Does Informatica be able to do the same thing?

If yes, how and why we do not usually use it?

If no, what is the reason?

And generally does this make sense? ( Having script and ETL create
mapping and tranformation on the fly? )

susiedba@hotmail.com

2006-10-25, 6:00 am

dude use SSIS
it's very very powerful.

Informatica will cost you $100,000 and it will just lead to more
complexity.
MS won the database war 5 years ago. Don't listen to people that tell
you otherwise.

-Susie

soalvajavab1@yahoo.com wrote:
> I heard from my collegue that in FME and some other ETL tools you will
> creating scripts and scripts will create GUI and Mappings and it is
> more effecient!
>
> Does Informatica be able to do the same thing?
>
> If yes, how and why we do not usually use it?
>
> If no, what is the reason?
>
> And generally does this make sense? ( Having script and ETL create
> mapping and tranformation on the fly? )

Jeje

2006-10-25, 6:00 am

I write script which generate something (like tables, SP, views...)
and creating these scripts takes a lot of time to debug them.

So creating scripts which generate scripts etc... can be good, but when you
have hundreds of same things to do.
in an ETL process, its rare to have to do 2 times the exact same things.
but if you have the time to, you can do this.

SSIS packages are XML files, so you can generate these file by creating your
own tool.

Personnaly I have never created this type of tool to generates my packages
because there is too many transformation to do etc...

Can you describe which type of generation you looking for?
sometimes there is other options then creating scripts by script.

<soalvajavab1@yahoo.com> wrote in message
news:1159313134.633124.115450@b28g2000cwb.googlegroups.com...
>I heard from my collegue that in FME and some other ETL tools you will
> creating scripts and scripts will create GUI and Mappings and it is
> more effecient!
>
> Does Informatica be able to do the same thing?
>
> If yes, how and why we do not usually use it?
>
> If no, what is the reason?
>
> And generally does this make sense? ( Having script and ETL create
> mapping and tranformation on the fly? )
>

Peter Nolan

2006-10-31, 12:15 am

Hi Soalvajav,
to the best of my knowledge no vendor generates 'ETL on the fly' as
there is a design time process and a run time process to all these
things.....

That is...at design time you some how have to encode your mappings into
a tool.

Then when the mapping 'runs' it performs those design time
instructions...

I can assure you none of the leading ETL tools do it any differently
than that.....

What we have done is a bit different because we have cut out the
'coding' of the mappings into the ETL tool.

We take the mapping spreadsheet...and you have to define you mappings
somewhere and a spreadsheet is as good a place as any.......and we
generate the ETL subsytem at 'design time'....this effectively removes
the need for ETL programmers (sorry guys) when using our etl tools.....

They are downloadable and free for development/prototyping.....only
limitation is the name of the database you must connect to.....

We have also developed the ability to print ETL programmer
specificationfrom the mapping spreadsheet...so far we have only done
INFA program specs because a client asked for it...in many cases
clients use our ETL software to build the complete prototype including
ETL subsystem before then converting the ETL to their 'strategic' ETL
tool....usually INFA or DataStage.

Best Regards

Peter
www.peternolan.com

Jeje wrote:[color=darkred
]
> I write script which generate something (like tables, SP, views...)
> and creating these scripts takes a lot of time to debug them.
>
> So creating scripts which generate scripts etc... can be good, but when you
> have hundreds of same things to do.
> in an ETL process, its rare to have to do 2 times the exact same things.
> but if you have the time to, you can do this.
>
> SSIS packages are XML files, so you can generate these file by creating your
> own tool.
>
> Personnaly I have never created this type of tool to generates my packages
> because there is too many transformation to do etc...
>
> Can you describe which type of generation you looking for?
> sometimes there is other options then creating scripts by script.
>
> <soalvajavab1@yahoo.com> wrote in message
> news:1159313134.633124.115450@b28g2000cwb.googlegroups.com...

Sponsored Links