Hello all,
A newbie with SSIS here, so apologies if I am not describing my question correctly. So I have a table named abcTbl, the data in there is populated from other tables from a different database. Every time I am loading data to abcTbl I am doing a delete all to it and loading the buffer data into it. This package runs daily. My question is how do I avoid losing data from the abcTbl if we fail to load the data into it. So my first step is deleting all the data in the abcTbl and then selecting the data from various sources into a buffer and then loading the buffer data into the abcTbl. Since we can encounter issues like failed connections, package stopping prematurely, supernatural forces trying to stop/break my package from running smoothly, etc which will end up with the package losing all the data in the buffer after I have already deleted the data from abcTbl. My first intuition was to save the data from the abcTbl into a backup table and then deleting the data in the abcTbl but my dbas wouldn't be too thrilled about creating a backup table for in every environment for the purpose of this package, and giving me juice to create backup tables on the fly and then deleting it again is out of the question too. This data is not business critical and can be repopulated again if lost. But what is the best approach here? What are the best practices for this issue? Any help is very appreciated. Thanks.