Dear all,
i'm newbie at MS SQL Server use, and i wonder does anyone can tell me or maybe give me an article or maybe can show me a quick demo how to handle BIG DATA with MS SQL Server 2012 ?
i have scenario problem like this :
i have to do ETL process from Flat file with csv file type and insert it into DB and create Data Mart from that DB that i have been created. so far, i got the picture and imagine the SSIS package that i will use, but the main issue were the flat files data that i have to Extract and process have minimum size about 100 - 500 GB per-files or it can be split into several files but the size from all that several files were 500 GB. so i imagine, how to handle this files and how the best practice to handle this process using SSIS ? how i handle this process, can i configure the threads manually or by automatically this threads already handle by MS SQL Server 2012 (i read that MS SQL Server 2012 can handle until 1 Pentabyte data right?). or i split the flat files into several data and process it with several package, if yes its a good solution, does anyone can give me a short demo or tutorial how supposed i can do that ? and last issue was, how to handle the error, especially if on the middle of the extract process has error,and it takes a time if the process was started from the beginning once again after the process remark or flag the error flat files.
thank you for the answer and support.
regards,
Bambang