I have this package to import .dat files to sql database table.
Most of the .dat files have the same record, they have been dropped to FTP periodically,I have a sql task which checks if there is any new record in the file, if yes- it will insert it to sql table if not it will send it directly to archive.
Here is my problem, the "data flow task" fails(RED) importing some of .DAT files, it doesn't work for all of these .DAT files( i have a foreach loop task, which loops a folder). I experimented by adding script task to know on which file the data flow task is falling. And i managed identifying the files, I open them and see the content(record) of the file. And I compared it with the files which are imported successively. I don't see any difference. All the columns and # records are the same with the same data.
I get one suggestion
"I am not sure that I understand exactly what is happening, but what you described sounds like the .dat files may be of different formats, as in ASCII vs. Unicode. Another possibility is that if your folder view option is set to hide file extensions for known types, some of the files names may end in something other than .dat but the actual extension such as .txt is not visible. "
I checked the file extensions, they are all .DAT, and they are not hidden. But i don't check the Unicod property,
Any help will be appreciated.
Thanks