Quantcast
Channel: SQL Server Integration Services forum
Viewing all articles
Browse latest Browse all 24688

Importing multiple Flat Files into Single OLE DB Table destination(all files have different columns for table)

$
0
0

I am currently working on creating an SSIS package for a new import files we will received. The company changed how it was before - 1 flat file for 1 table. Now they have there data scatted across multiple files for 1 table.

I have 2 data flow tasks of the 12 that I am fiddling with trying to get to work correctly. --1 has 5 files to 1 db destionation --1 has 3 files to 1 db destination.

Each file does have a consistent key (Property_ID) that I am using for sorting. Current setup of a  flat file data flow task is:

  • FlatFile Source1
  • Data Conversion
  • Merge Join1(on sorting ID for other file)
  • FlatFile Source2
  • Data Conversion
  • Merge Join1
  • Sort(sort on propertyID)
  • Merge Join2

  • Flat File Source

  • Data Conversion
  • Merge Join2

  • Merge Join2 -> OLE DB Destination

I have tried all join types for the merge join and am still having problems getting the data into the table correctly.

Each file has different columns for the specified destination table aside from the "Property_ID"

The current results I am receiving are Just rows of data with data from only 1 flat source file and not the others.

Any assistance is greatly appreciated.


Viewing all articles
Browse latest Browse all 24688