Quantcast
Channel: SQL Server Integration Services forum
Viewing all articles
Browse latest Browse all 24688

Large CSV with bad data rows, import wizard, no BIDS

$
0
0

Hello everyone,

I've been busy with the import wizard provided by sql server 2008r2 to import data from csv-files.

Sometimes the files can be pretty big: 2GB+

Also sometimes there are bad rows e.g. triple " when the text qualifier is a ", a ? instead of an empty field->convert to numeric error, etc.

So sometimes the import jams on these rows. Of course I have to lookup the row so I can fix it. Sql server tells you the datarow on which it jams, so in smaller files you can lookup the bad rows to troubleshoot the bad data and fix it. Now with big files this is kinda of a problem, because you can't simply open the file. In that case how can i find out the values of the bad row?

Tip: For replacing strings/characters in large files you can use FART (find and replace text - command line app), very fast and it does the trick.

Thx for you suggestions


Viewing all articles
Browse latest Browse all 24688

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>