We have a SSIS Package that is pumping close to 5 million rows of CMS NPI Provider data into a SQL Server Table. When I ran Max Row Length on this table the value returned was 7881. There's a lot of provider information contained within this National NPI Health Provider file from the government.
When I divide the Max Buffer size of 10485760 by the 7881, I get 1330.51136. So I believe the Default Buffer Max Rows should be 1300.
It is taking our SSIS Package over 2 hours to load almost 5 million records. Are there any other things I need to look at in trying to fine tune this and make this quicker?
Based on real raw numbers, does this seem extraordinary in terms of a data pump wall time for a max row length of 7881 and almost 5 million records to be taking upwards to 2 hors to complete?
Thanks for your review and am hopeful for a reply.