Good afternoon, all -
I am using a Flat File Connection Manager to read data from a pipe-delimited .txt file with 80-or so thousand rows.
Unfortunately, when I preview the data or look at it using the Columns option in the CM Editor, I see that it is adding 68 empty columns to the end of each row.
At first, I thought the client might have sent data with a gob of pipes at the end of each line and the CM was interpreting these as columns. But, looking at the raw data, I saw this wasn't the case. However, I did notice that none of the rows had a final delimiting pipe. Now, I don't know if this matters, but I thought that, perhaps, SSIS has some sort of buffer that it uses to import each row and, if a final delimiter isn't there, it interprets this as additional blank columns until the buffer is filled.
So, my thought was to add a pipe to the end of each record using a Script Task. Unfortunately, my C#-fu is poor and I hoped that someone had already met this problem and could give me an assist. Of course, this is predicated on the presumption that my guess about what's happening is correct. If I'm wrong, then such an idea won't work. If that's the case, does anyone know why the Flat File Connection Manager might be adding additional empty columns to the end of my data?
Thanx in advance for any assistance!