I need to import a text file we receive from a vendor. Unfortunately, the vendor sends a somewhat messed up file. The file is comma delimited, which is no big deal. But, the file sprinkles quotation marks throughout the file, and it's not consistent. Not every column has quotation mark qualifiers. Here's an example:
Canada,abc-123, "VP, Technical operations", 123-XYZ, "some text, more text", last column
So in this example, there should be six columns, but when using SSIS flat file connector, no matter what you do, it will actually see eight columns - splitting "VP, Technical Operations" and "some text, more text" both into into two columns each - totaling eight columns.
I would like to remove the double quotes and change the column identifier to a pipe instead of a comma.
I found the following blog post, but it doesn't really fill in some gaps - like the first step. How do you get SSIS to "see" an input file as one gigantic row??
http://geekswithblogs.net/Compudicted/archive/2011/09/19/ssis-how-to-remove-occasional-quotes-and-replace-the-column.aspx
Is anyone aware of another way to accomplish this? If not a different way, could you provide a littler more detail on how to get this to work?
Thanks in advance!
A. M. Robinson