In my case, the culprit was the explicit data type cast on all columns. This low-efficient design flaw was not significant on smaller tables, until it came to the bigger ones like the 6 GB table with 100 columns. I reduced castings to only the necessary columns, the number is down from 100 to 15, and the problem is resolved.
I reached this point by removing the features one by one, so it was like guess-and-try with brutal force. I'm just unsure if I missed any indication in logs pointing more directly to the castings.
====== The original post below: ======
The SSIS package is trying to load data from MySQL source by incremental way, which means to check the current latest record in target database and read source from there.
It's a big table of about 2 million records by 100 columns, and takes 6GB disk space.
The SSIS package always fail on the ADO.NET Source, with the error message listed in details below. Any help and pointers will be highly appreciated.
The tab of Execution Results / Process doesn't seem to contain very useful information. I'm also wondering how to add in a log provider with higher verbose level. Thank you for your help.
Details:
1) Error messages during debug in "Progress" tab of Visual Studio 2015:
[Source extract [1340]] Error: The Source extract was unable to process the data. Fatal error encountered during data read.
[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on Source extract returned error code 0xC02090F5. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure
code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
2) Corresponding error in Windows 2016 Event Viewer > Windows Logs > Application:
Log Name: Application
Source: SQLISPackage130
Date: 7/31/2019 4:11:00 PM
Event ID: 12291
Task Category: None
Level: Error
Keywords: Classic
User: WIN\Administrator
Computer: win
Description:
Package "etl-biml__sales_order_item" failed.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="SQLISPackage130" />
<EventID Qualifiers="16385">12291</EventID>
<Level>2</Level>
<Task>0</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2019-07-31T22:11:00.451522100Z" />
<EventRecordID>25952</EventRecordID>
<Channel>Application</Channel>
<Computer>win</Computer>
<Security UserID="S-1-5-21-1557172356-3261685372-714728931-500" />
</System>
<EventData>
<Data>etl-biml__sales_order_item</Data>
</EventData>
</Event>