I have one very long query which I would like to breakdown into small chunks that I can then use in several Execute SQL Tasks so that I can take advantage of SSIS parallelism thus by so doing obtain performance gains. I’m hoping to cut down the time it currently takes for the job to complete when the various components in this query run sequentially. An example which is repeated in a number of scenarios in my query is as follows:
The first two components in the query (will call them A & B) are not dependent on each other. It is component C in the pipeline which depends on both A & B. Currently component A runs until it finishes while component B waits in the queue. Apparently, these two components are currently set to load their data into temp tables in a stored procedure. Once A has finished, B kicks in. What I would like is to split the stored procedure and set A & B to run in parallel. While this is possible to do using Execute SQL Tasks, what I’m not sure about is how to set the scene in SSIS so that component C will only fire once both A & B have finished as A can finish far much earlier than B. Is there any polling of some sort that I can use in the Control Flow pane for this?
Many thanks,
Mpumelelo