Hello,
I am creating SSIS package where below mentioned is the scenario :
- There is sourcefiles folder -- > Need to pick CSV files of yesterday's date for processing.
- There are many validations which needs to be done.
- Store all (valid + invalid) rows in SQL destination Parent table.
- Store invalid rows in child table with Foreign ID of parent table.
There are around 30K to 40K rows in the CSV file.
I have created Script component to perform validations on each row. This is running very slow. Any solution to this ?
I have defined two outputs of this script task.
Also,
- I am not getting an idea how to get Scope identity of Parent table inserted row ?
- Which approach I should use to insert these rows --> Data flow, Execute SQL Task or in script component ? which one would be faster in this scenario ?
- Can I use Bulk Insert ?
Can anyone please help me on this ?
Thank you, Mittal.