Quantcast
Viewing all articles
Browse latest Browse all 24688

Best way to load huge chunks of data

Hello All,

I have a question regarding the best way to load huge amounts of data. I am using SSIS to load load data from source into the destination. Both are sql server tables. There are two packages and they need to run sequentially as the second package is dependent on the first one (for some calculations).

I have to load data from Jan 1st  to August 2018 (80 million plus records).

My question is when i load the first table (can i partition the table and make it run in batches), will that speed up the load? Its not fast load , but loading using sql command. If partitioning the table the best way to speed up, please point me to a link or document.

Thanks


Viewing all articles
Browse latest Browse all 24688

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>