Dear Experts,
SSIS falt file to daatbase table import is only importing 9899 (1 header + 9898) rows though the file has 19000+ rows and giving a success message. Is there a limitation in importing flat file data to table only 9899 rows at once?? I have never seen this before..and why its showing as success where as only half of the data is imported?
ISSUE BACKGROUND
I am using SQL Server 2005 Sp4 (very recently applied SP4). I am importing data from Acive directory in a CSV file and then importing that data to SQL table and using it for reportig purpose. the import job runs once a day in the midnight.
Since past 18 months I am managing this and have been facing issues in data import..the import fails many times with very strange error and takes lots of sleeples nigfht to fix it.
Recently, it failed because the column delimiter for a particular column was not available. This error is very common and it sometimes works and sometimes it never gets fixed and I have drop that column from importing.
I only came to know about the failure, when I found that data is missing from my table, saying this I mean to say though the package was importing only a part of the data and was failing to import the rest of the data, it was regstering as success in the job history...strange...
Now, to fix the error, I dropped that particular column from importing and rerun the package. its only importing 9898 rows and giving a success message though my flat file has 19000+ rows. Why??? What might be the cause and why exactly 9898 rows???
Thanks