HI,
i am using the oracle source and i am loading the data from 2005 to till today and i am running package using the loop day bay day basis because i need to keep all historical data as per daily basis.
for this i am using for loop with starting date as 01-01-2005 and till today.the problem here is for me it is taking almost 6 hours to ran the total package,this package i need to run daily basis full load,because there is no proper date field to do incremental Load,could any one give me the best solution to reduce the time to at least 2 to 3 hours.
i am thinking to use parallel process ,i will break down the years and for every 4 years i am planning to use one data flow task.for this approach can i reduce the time or is there any other alternative best approach,please suggest me.
Best regards,
