Re: SISS vs Biztalk Large data

Well, if you need to copy the file to local, because you can not process it
from it source location. You can use the file adapter to move it to a local
folder with biztalk, and then call a store procedure that calls the ssis
packates to process it.
In case you have your file, and you can start processing it in its actual
location, you can use the file adapter to move it to another folder like I
said before.
You can also have a SQL job that pools for files and process it with a
package and then fire an orchestration some how, dropping the processed file
in a folder. Or have the SQL adapter polling for results of the job.



Francisco A. Gonzalez
fgonzalez@xxxxxxxxxx




"Selvan" <Selvan@xxxxxxxxxxxxxxxxxxxxxxxxx> wrote in message
news:0FAFEF74-9CAD-47ED-949E-47D36BFDDDAD@xxxxxxxxxxxxxxxx
Francis,

Thanks for your sugession, I just wonder how your file will be polled by
SSIS?
Do we have any better article/tutorial for Flat-to-flat scenario?.

Thanks again

Regards
Selvan.

"Francisco A. Gonzalez" wrote:

Hi,
SSIS is your tool.
I am a BizTalk guy, and so many times I use SSIS for scenarios like
yours.

You can get the flat file, do look ups and transformations, do error
handling at record level, and convert the format to different flat files
formats.


BUT, it will for sure be faster than BizTalk but depending of RAM and
your
skills with task and transformations you can get those few seconds that
you
mention.

cheers.

Francisco A. Gonzalez
fgonzalez@xxxxxxxxxx



"Selvan" <Selvan@xxxxxxxxxxxxxxxxxxxxxxxxx> wrote in message
news:5546D8FF-9943-4FFB-A3D4-8525A2F02B1D@xxxxxxxxxxxxxxxx
Geeks,

I am a Biztalk guy, I receive a flatfile of 1GB approximatly everyday
and
have to transform another flatfile format with in 30 mins of time. As
for
as
i know flatfiles are converted to xml in biztalk which results 3 times
bigger
than the souce flatfile in biztalk databases. From various articles i
understood that SISS in SQL 2005 does it in few seconds. Can i
transform
one
format data to different format flatfile in SISS?.
I just need to Group, Sum the records (I know biztalk map cannot play
with
(1 GB *3 =3 GB) such a large file.

Apart from that i need a record level error handling, if one record
failed
for some reason say lookup not found or data error, can SISS log the
error
and skip to
the next record?.

Since i am new to SISS do you have any suggession pls?

TIA,
Selvan.





.

Relevant Pages

  • =?Utf-8?Q?Alternative_to_BizTalk=E2=80=99s_File_Ad?= =?Utf-8?Q?apter?=
    ... BizTalk, or at least in my experience it is. ... hook it up to a file adapter and see what happens. ... the scenario of a convenience store chain that has 1000 stores. ... It supplies a library of custom workflow ...
    (microsoft.public.biztalk.general)
  • Re: Is Biztalk for remittance industry??
    ... different adapters and pipelines, which will convert all incoming messages ... I am not much aware of the functionalities and capabilities of biztalk ... format, excel sheet format, xml data etc etc. ... this server in a production enviroment and let all business partners ...
    (microsoft.public.biztalk.general)
  • Re: Is Biztalk for remittance industry??
    ... different adapters and pipelines, which will convert all incoming messages ... I am not much aware of the functionalities and capabilities of biztalk ... format, excel sheet format, xml data etc etc. ... this server in a production enviroment and let all business partners ...
    (microsoft.public.biztalk.general)
  • Mapping semi-known XML
    ... I've just started experimenting with BizTalk, and my first project is to transform some XML documents from an external application into our own internal XML format. ...
    (microsoft.public.biztalk.general)
  • Re: SISS vs Biztalk Large data
    ... SSIS is your tool. ... I am a BizTalk guy, and so many times I use SSIS for scenarios like yours. ... have to transform another flatfile format with in 30 mins of time. ...
    (microsoft.public.sqlserver.dts)