Quantcast
Channel: SQL Server Integration Services forum
Viewing all articles
Browse latest Browse all 24688

Incremental Load in Via CDC tables

$
0
0

Hi ,

I am using SQL Server 2008 SSIS and SQL Server 2008 CDC features.

my Source system will be a different machine.

I do have seen lot of blogs and codplex package for CDC incremental load.

I saw example from MSDN site as well.

http://msdn.microsoft.com/en-us/library/bb895315(v=sql.100).aspx

but if understand correctly that using LSN number of CDC database for detecting changes is not relaible.  i am facing same challange.

See this post

http://www.sqltact.com/2010/08/cdc-dbofnallchanges-frustrating.html

I am facing same problem, it is not necessary that maximum and Min LSN number from CDC database can be pass on to cdc.fn_cdc_get_all_changes_. it will throw an error.

also wehn you have mutiple tables to load it may be possible some of the tables have not captured any data as there was no change. so getting min and max LSN number from every table is again not a solution.

What i would like to understand that what is way to reduce complexity of ETL and make this loading smother and faster.

Else we have to create configuration table for having MAX-MIN LSN number for every table and also need to have conditional execution in SSIS to ensure those MAX and MIN LSN are not null and if NULL then dont pull data from Source.

Please suggest?? if there are any better way...

samples


Gaurav Gupta http://sqlservermsbiblog.blogspot.com/ Please click "Mark as Answer" if this resolves your problem or "Vote as Helpful" if you find it helpful.


Viewing all articles
Browse latest Browse all 24688

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>