Quantcast
Channel: SQL Server Integration Services forum
Viewing all articles
Browse latest Browse all 24688

XML Source - how to stream a 50GB XML file to a database?

$
0
0

Hi guys!

I have been trying to load a 50GB XML file (well, just a 1 "row" at first) in to SQL server via OleDB connection. It seems that this component does not stream the data, but tried to load it into memory - I have only 8GB, so that might be an issue.

Very few people will have 50GB mem on their development machines, so how do I get around this limit? Is there a streaming version of the XML source????

I did make a test with a 500MB subset version of the same file, and it worked just fine. All became green - with 50GB I do not even get to the "yellow stage". :-(

Thanks



Viewing all articles
Browse latest Browse all 24688

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>