I have a situation in which our client has given a flat file (.csv) to be loaded into a SQL Server table using SSIS.
This huge raw .csv file (with about 400,000 records) does not have a proper format - particularly it does not have the double quotation ("), either in the column name header or in the row data. Please see an example below:
Column 1, Column 2, Column 3,....
Z , 342343242424 , 10.83 , 000001001765 , 2018-12-03 , 2018-12-03 , ABCD , XYZ, , CA , 001 , 00 , ?
(This is an instance of a data row, with the column header names as Column 1, Column 2,...There is no double quotation(") at all in this file)
I am using Visual Studio 2017 to work in SSIS.
In the SSIS Flat File Connection Manager Editor - General page, I have set the following properties:Format: Delimited
Text Qualifier: <none>
Header row delimiter: {CR}{LF}
As you can see XYZ, is desired as XYZ, in a single cell; instead I seeXYZ in once cell and a blank in the adjacent cell to the right. (I am currently de-bugging using a Data Viewer.)
Every cell gets shifted one place to the right side. In the last column on the right side, I get this: 00 , ? in one cell
I do not have an idea on how to load this sort of an improperly formatted .csv file (without double quotations(")).
Is there a way I can load properly ? May be changing the file to a text file or something.
Any suggestions will be appreciated.