data conversion error importing excel files (*.xlsx) to a SQL server table

November 14, 2014, 3:29 pm

≪ Previous: SSIS- Oracle 64 bit OLEDB Provider gives unicode conversion errors only in one environment

Hello,

I'm importing a set of excel files to SQL table. I have a for each loop container that iterates through the set of files to be imported. The structure of the excel files is the same and the data type in the excel columns in each of those files is similar.

The data in some of the columns may be sparse depending on the availability. The package was successful loading a file but when loading the second file fails with the following error:

[Excel Source [200]] Error: There was an error with Excel Source.Outputs[Excel Source Output].Columns[columnX] on Excel Source.Outputs[Excel Source Output]. The column status returned was: "The value could not be converted because of a potential loss of data.".

[Excel Source [200]] Error: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "Excel Source.Outputs[Excel Source Output].Columns[columnX]" failed because error code 0xC0209072 occurred, and the error row disposition on "Excel Source.Outputs[Excel Source Output].Columns[columnX]" specifies failure on error. An error occurred on the specified object of the specified component. There may be error messages posted before this with more information about the failure."

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on Excel Source returned error code 0xC0209029. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.

To trouble shoot the error I tried to import the file that was failing via package using the import/export wizard to the destination table. There was a warning message"potential lost conversion from varchar to float" displayed on "columnX" (i.e, the column which was failing in the package). I checked the column covert and proceeded further and the import via import/export wizard failed.

I have reviewed the data and find that there are no character data in columnX.Tried using the data conversion transform in the package to covert the data to float but it keeps failing with the same error. I don't have IMEX=1 in the connection string of the package. Does anyone know how to fix this error? Any help pointers is very much appreciated.

Thank you!

↧

Handle different date formats

November 25, 2014, 2:53 am

≫ Next: SQL server query without indicating server name

≪ Previous: data conversion error importing excel files (*.xlsx) to a SQL server table

We have CSV files as our data source and some files have different data formats (DD-MM-YYYY and MM-DD-YYYY)

We are using Flat File Source Editor for reading our CSV data.

After failing on multiple procedures (as source files can contain many empty fields), we had success by reading all data into a single row for processing using a Script Component.

This works great until we parsed a source file that had a different date format which caused a failure as the DateTime.Parse method expected DD-MM-YYYY.

We have no way of finding out what format the CSV files will be.

We obviously need to know the format prior to the Script Component parsing which could fail on any record with a month value > 12.

Our thinking is we could extract all the date values prior to the parsing and traverse the string array to see if any month value is > 12 and if so the format is MM-DD-YYYY.

We could then swap the DD and MM values to be a consistent format for our Script Component.

We are looking for recommendations on the best way of handling this?

↧

SQL server query without indicating server name

November 25, 2014, 6:02 am

≫ Next: SSIS Package developed in SQL Server 2008 R2 Using BIDS 2008 is not working in SQL Server 2012

≪ Previous: Handle different date formats

I am writing a query in SSIS and utilize servername everytime but it drags every time

I am authorized to work in Development area and can indicate deve server

But Senior officer ask me not to use Server name and when package goes to production query can execute without indicate server name any idea

thank you very much.

Vijay

Vijay Patel

↧

SSIS Package developed in SQL Server 2008 R2 Using BIDS 2008 is not working in SQL Server 2012

November 25, 2014, 4:55 am

≫ Next: SQL server query without indicating server name

≪ Previous: SQL server query without indicating server name

I am working in a Product based company.
We have given a Pre-requisites to our customers like SQL Server version should be 2008 or later.
I have developed and deployed my SSIS package in SQL Server 2008 R2 with BIDS 2008.
I have used "Script Component" in my package.
We will take only DTSX package file to the customer places and run using SQL Agent Job daily.
Who are all(Customer Environments) using SQL 2008 or R2 my package is running fine.
Who are all(Customer Environments) using SQL 2012, I am facing the below issue

The component metadata for “Script Component, clsid {874F7595-FB5F-4OFF-9BAF-FBFF825OE3EF}” could not be upgraded to the newer version of the component. The PerformUpgrade method failed.

Still the same package is running fine for some of the customers having SQL 2012.
I am getting the above error only for few customers.

Can someone please guide me how to proceed on this. Is there any solution to go without upgrading the package to SQL 2012. Because we need to maintain only one package for all customers

↧

SQL server query without indicating server name

November 25, 2014, 6:01 am

≫ Next: Migrate DTS between SQL 2000 Server

≪ Previous: SSIS Package developed in SQL Server 2008 R2 Using BIDS 2008 is not working in SQL Server 2012

I am writing a query in SSIS and utilize servername everytime but it drags every time

I am authorized to work in Development area and can indicate deve server

But Senior officer ask me not to use Server name and when package goes to production query can execute without indicate server name any idea

thank you very much.

Vijay

Vijay Patel

↧

Migrate DTS between SQL 2000 Server

October 30, 2014, 8:51 pm

≫ Next: Connection Manager in SSIS

≪ Previous: SQL server query without indicating server name

Hi ~ Are there any way I can copy all the DTS package from one SQL 2000 to another ?

↧

Connection Manager in SSIS

November 24, 2014, 10:33 pm

≫ Next: error with sequence containers and global temp variables

≪ Previous: Migrate DTS between SQL 2000 Server

Hi All,

I have two servers (Server-A and Server-B), Both servers data bases are mirrored. My SSIS package pointing to the server-A Database, If any failure in the Server-A (or) Crashed, My package automatically should point to the Server-B, without any failure in the package.

I am using failover partner in SSIS to achive the above one. It's working before running of the package, if Server-A down,It is automatically connecting to the Server- B. But Middle of the package running, if Server - A down. It's throw an below errors.

[ADO NET Source [37]] Error: The ADO NET Source was unable to process the data. Exception from HRESULT: 0xC0047020.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on ADO NET Source returned error code 0xC02090F5. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.

Thanks in Advance...

↧

error with sequence containers and global temp variables

November 17, 2014, 11:16 am

≫ Next: Alternative to Script Component( VB ) inside Data Flow

≪ Previous: Connection Manager in SSIS

I have a process which does the following -

1. Inside a sequence container an execute sql task has a stored proc which inserts result set into a global temp table.

2. DFT after the execute sql uses that global temp as a source and the final destinatoion is a oledb destination.

I have done the following also -

1. Set the connection manager property RetainSameConnection = true

2. Delay validation of dft to true

3. Validatexternalmetadata of source inside dft to false.

The first task inside the sequence container works fine(execute sql task),but it fails in the dft with errors as -

[DST xyz[576]] Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80040E37.
An OLE DB record is available. Source: "Microsoft SQL Server Native Client 10.0" Hresult: 0x80040E37 Description: "Invalid object name 'abcd'.".
[DST xyz[576]] Error: Failed to open a fastload rowset for "[abcd]". Check that the object exists in the database.
[SSIS.Pipeline] Error: component "DST xyz" (576) failed the pre-execute phase and returned error code 0xC0202040.Could anyone guide me with what i am doing wrong or ignorinf some property.Thanks

↧

Alternative to Script Component( VB ) inside Data Flow

November 25, 2014, 8:06 am

≫ Next: CDC SSIS 2012 ,CDC TASK,CDC Source,CDC Splitter

≪ Previous: error with sequence containers and global temp variables

I have a process which readwrites / updates 7-8 fields inside a vb script component inside a data flow before it hits dest table. Could anyone give me possible alternatives to replace it ? ... Would like to do it without using staging tables ( don't want to separate the tasks) ,,, Trying out with an OLEDB command,,,,but that updates row by row at db table level which would mean i would need staging tables. Would appreaciate a solution for this. Thanks

↧

CDC SSIS 2012 ,CDC TASK,CDC Source,CDC Splitter

May 23, 2012, 3:19 am

≫ Next: changing ? or ¿ or � back to Special characters.

≪ Previous: Alternative to Script Component( VB ) inside Data Flow

Hi,

I tried CDC in SSIS 2012 yesterday I was unable to run the hole process sucessfully

http://www.mattmasson.com/index.php/2011/12/cdc-in-ssis-for-sql-server-2012-2/?utm_source=rss&utm_medium=rss&utm_campaign=cdc-in-ssis-for-sql-server-2012-2--------------------------------------------------------------------------------

did any one tried this process

Sri.Tummala

↧

changing ? or ¿ or � back to Special characters.

October 22, 2014, 11:04 am

≫ Next: Logging Query Messages From ExecuteSQL Task

≪ Previous: CDC SSIS 2012 ,CDC TASK,CDC Source,CDC Splitter

Hi there,

I am working with a ETL importing data from Oracle to SQL Server using SSIS 2012. Oracle source data contains special characters which appear as ? or ¿ or � in Toad.

I know this oracle data is Puerto-Rico Spanish and because of improper character set, these characters are showing as '?' etc.

I do not think it is possible to convert these '?' etc into their original special characters. Had the source data been correct , SSIS would have easily handled the data correctly. But I am not a SSIS expert and just wanted to ask around if anyone has dealt with similar issues.

Thanks

↧

Logging Query Messages From ExecuteSQL Task

December 14, 2006, 8:15 pm

≫ Next: Oracle Connectors (3.0) with SSDT (2013)

≪ Previous: changing ? or ¿ or � back to Special characters.

The ExecuteSQL task makes it easy to capture the resultset of a query or stored proc in a variable. But what about the messages that would normally appear in the Messages tab when running queries in Management Studio or Query Analyzer? There must be a way to display and log rowcounts and other messages that a query normally produces.

Various package/task logging configrations haven't helped. I've read discussions about logging rowcounts in data flow tasks, but what about capturing messages in ExecuteSQL and other control flow tasks that run T-SQL?

I only have enough time to dabble in this technology so I may be missing something obvious or approaching this incorrectly. Any suggestion, reference, constructive criticism or reponse would be appreciated.

↧

Oracle Connectors (3.0) with SSDT (2013)

November 14, 2014, 10:44 am

≫ Next: Tasks ===> Export Data... in SQL Server Management Studio

≪ Previous: Logging Query Messages From ExecuteSQL Task

In previous versions of BIDS we were able to customize the DataFlow toolbox to incorporate the Oracle Source and Oracle Destination items - however, it appears this is no longer the case in SSDT (no option to customize toolbox). I've installed the 3.0 Microsoft Connectors for Oracle - when I create a new connection in the Connection Manager I can see the Attunity drivers, but under Other Source/Other Destinations in the Toolbox I cannot find the Oracle Source/Destination components.

Any help would be greatly appreciated!

↧

Tasks ===> Export Data... in SQL Server Management Studio

November 25, 2014, 12:17 pm

≫ Next: Use Merge Join instead of Lookup?

≪ Previous: Oracle Connectors (3.0) with SSDT (2013)

I used Tasks ==> Export Data... within SQL Server Management Studio which invoked theSQL Server Import and Export Wizard. I went through the wizard and extracted my data perfectly. Within the last panel of theSQL Server Import and Export Wizard I did specify to Save my work.

Where can I find the work that I specifically asked to Save? Is it a SSIS Package? I am assuming it stored it somewhere on the SQL Server and within the Database I actually right-clicked on to initiate.

Also, once I can find it, can I then turn this created Wizard SSIS Package into a Visual Studio project so that I can save it and do more work on it if need be?

Thanks for your review and am hopeful for an answer and a reply.

↧

Use Merge Join instead of Lookup?

November 25, 2014, 9:40 am

≫ Next: SSIS 2012 Teradata connection error

≪ Previous: Tasks ===> Export Data... in SQL Server Management Studio

I am inserting from a stage table to a dictionary table using the Lookup Transformation. I need to change this Lookup Transformation to use a Merge Join, where the Derived Columns - CreateDate(Insert Table) and UpdateDate(Update Table) work the same as the Lookup Transformation did. Please advised or illustrate. Thanks

↧

SSIS 2012 Teradata connection error

November 25, 2014, 10:52 am

≫ Next: Question about redeploying a Project with multiple packages

≪ Previous: Use Merge Join instead of Lookup?

I have a package in SSIS 2012 catalog trying to get some data from Teradata 13.10. The connection is not working for me and I keep getting the error:
ADO.NET Source has failed to acquire the connection with the following error message:
"Could not create a managed connection manager".
This connection works and the package runs from my local desktop but not from the SSIS Catalog. Any ideas why this is happening?
I tried OLEDB, ADO.NET & ODBC connections. None of them work so far. Please help!

↧

Question about redeploying a Project with multiple packages

November 25, 2014, 10:48 am

≫ Next: How do you run the packages?

≪ Previous: SSIS 2012 Teradata connection error

I know that if I make changes to a single package within a project in SSIS 2012 that the entire project must be re-deployed. Also, I know that the project version is updated when it is re-deployed. My question is about the packages in the re-deployed project that have not changed. Does anything actually change in the unaffected packages when only a single package is modified? Do the Identifiers for the all packages change or just the package (or packages) that have been modified? I'd really like to hear from someone with actual experience with this issue.

Harold Jackson

↧

How do you run the packages?

November 25, 2014, 11:20 am

≫ Next: Microsoft ODBC for Oracle on a Windows 7 64Bit OS and Oracle 11g Client

≪ Previous: Question about redeploying a Project with multiple packages

Hi guys, just a question. I'm used to running the package (even complex package) or manually or using SQL agent job. I would like to have a list of possibilities. How do you usually run the packages?

↧

Microsoft ODBC for Oracle on a Windows 7 64Bit OS and Oracle 11g Client

November 26, 2014, 3:27 am

≫ Next: Command line for end users

≪ Previous: How do you run the packages?

Hi,

I have installed Oracle 11g client 64Bit edition on a Windows 7 Professional 64Bit OS. Trying to connect to Oracle DB through ODBC Driver I get the following Message:

Microsoft ODBC for Oracle:

"The Oracle(tm) client and networking components were not found. These components ar supplied by Oracle Corporation and are part of the Oracle Version 7.3 (or greater) client software installation....".

Any ideas how to resolve that problem?

↧