Quantcast
Channel: SQL Server Integration Services forum
Viewing all articles
Browse latest Browse all 24688

Design Delimma- SSIS Consuming Data from 5 DataSources

$
0
0

I am working on a SSIS package which is consuming data from 5 data sources. I am trying not to use the SORT transform but ending up using them here is my scenario,

On the first version of this package i had 3 data sources only:

Source1, Source2( Key1), I could join them no issues all works fine without using the SORT, I used the  order by clause and joined them.

Source3 comes in it has a composit key(Ke1, Key2): So what do i do next i use the same order by for source 3, but now as Source1 and source3 combined was sorted only on KEY1, here comes my first sort transform. I have the screenprint below

This was OK till now, but as SOurce 4 and Source5 comes in all have diff key column which i need to join on so again i would have to introduce further sort transform 2 of them going by my present design, i cant come up with any better design other then this. which i think is not good as i have to use so many Sort Transform 

Just to mention, All the new sources are additional columns to exisiting data so i have to join them using the keys provided which are existing columns already on the pipeline.

I am incresingly thinking of doing this via a Stored PRoc as the sources i mentioned are tables on same DB/Server.

Any suggestion if i want to use SSIS and not have to use So many sort Transforms would be appreciated


Abhinav <br/> http://bishtabhinav.wordpress.com/


Viewing all articles
Browse latest Browse all 24688

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>