Hi all,
I am in the process of migrating an old linked server ETL process to SSIS 2012. The old process extracts data in a stored proc so is one table at a time. Part of the benefit I want to make use of is having multiple tables (OLEDB data sources) to run in parallel
in one data flow task.
However, I'm just considering how to do this, and ran into a slight problem. There's about 30 different tables in the ETL, some that need to be filtered with different where clauses (and have different column meta data too). My plan was to get the value from the database and assign to the WHERE clause variable, construct the SQL statement then use that value in the "SQL Statement with Variable" setting.
I'm familar with how to do that for a single table, but I wanted to know if/how I can set the WHERE variable value with a different value to use in each "SQL Statement from Variable" (given that each OLEDB source will be running in parallel). I had a look at using an object variable type but it seems that won't work.
Any ideas about how I can set the variable with multiple values without moving the transformations to be sequential or setting up a separate variable for each table/OLEDB data source?
Thanks in advance!
Looking for answers on the internets