Hi ,
I am using SQL Server 2008 SSIS and SQL Server 2008 CDC features.
my Source system will be a different machine.
I do have seen lot of blogs and codplex package for CDC incremental load.
I saw example from MSDN site as well.
http://msdn.microsoft.com/en-us/library/bb895315(v=sql.100).aspx
but if understand correctly that using LSN number of CDC database for detecting changes is not relaible. i am facing same challange.
See this post
http://www.sqltact.com/2010/08/cdc-dbofnallchanges-frustrating.html
I am facing same problem, it is not necessary that maximum and Min LSN number from CDC database can be pass on to cdc.fn_cdc_get_all_changes_. it will throw an error.
also wehn you have mutiple tables to load it may be possible some of the tables have not captured any data as there was no change. so getting min and max LSN number from every table is again not a solution.
What i would like to understand that what is way to reduce complexity of ETL and make this loading smother and faster.
Else we have to create configuration table for having MAX-MIN LSN number for every table and also need to have conditional execution in SSIS to ensure those MAX and MIN LSN are not null and if NULL then dont pull data from Source.
Please suggest?? if there are any better way...
samples
Gaurav Gupta http://sqlservermsbiblog.blogspot.com/ Please click "Mark as Answer" if this resolves your problem or "Vote as Helpful" if you find it helpful.