I have to build about 25 SSIS packages that extract (AS400) data and transfer it to a SQL Server 2012 DataMart. Each package supports one table that contains approximately 100 columns and 10,000 rows of data. The source data changes daily as the data is cleaned. My packages will run nightly so that my DataMart stays current with the source. For any given package, I will be updating about 100 rows every night.
I want to build a logic structure (Control Flow and Data Flow) that can support each package. Here are my ideas so far.
Using OLE DB Command to update the changes. This seems like a lot of work if I need to code each of the many columns int Param0, Param1, etc.
I can write the updates to a temp or stage table but still have to UPDATE or MERGE back to my DataMart table and must write code mapping each column.
The best idea I've come up with is writing a stage table and Merge Join with the original table. Then, I would Execute SQL to TRUNCATE the table and re-load it with my stage table.
Any suggestions for a better approach would be greatly appreciated.
Mario