Quantcast
Channel: SQL Server Integration Services forum
Viewing all articles
Browse latest Browse all 24688

Bulk XML Files Import (2000) files, need to speed up import

$
0
0

Good day, Urgently need help. Bulk XML Files Import (2000) files, need to speed up import

I have over 2,000 XML files that import every 15min. And move to a drive on the server

Loop > XMLsource to oracle destination > then move file, I am importing 1 files every 3 seconds.

Instead want to do a bulk insert after reading all files, I do not want to open/close connection every time when importing a file

so I was thinking of storing the values I want to insert into variables and append as it loops then do a bulk insert and then do a directory copy compared to individual inserts and 1 file move

Sql table is not fast enough (open/close connections), I thought I could append a record destination but it gets overwritten everytime the loop iterates. Can I perhaps use the onvariablevalue changed event or something to store the field values to variable

please help, I need to do this this evening :(

Regards


Viewing all articles
Browse latest Browse all 24688

Trending Articles