hi every one
i am doing an academic project where i need to run an ETL task continuously(its for a real time data warehouse), the logic will be of some thing like this...
if there are around 10 changes done in the source database then the ETL should be fired or else we should wait for some 5 minutes and run the ETL with the present changes.
here what i am planning to do is, i am taking the changes into some corresponding temp tables and incrementing a dummy table row by one and our ETL will check the row count of the dummy table and when the count is 10 it will fire the ETL task and if not
more than 9 inserts/updates are done in a time span of 5 minutes then i will fire the ETL and again start the whole thing from beginning
suggest me if i am wrong with my planning
thanks
shashi