Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

VS_BROKEN CAN NOT CONVERT UNICODE TO NON UNICODE STRING

$
0
0

Hi,

I am importing data from orcle to sql through etl if i run it manually it works fine but when i am scheduling in sql agent job it throws VS_BROKEN CAN NOT CONVERT UNICODE TO NON UNICODE STRING error like this

please any body help me how to solve this.

Thanks,

Khasim


Is there a recommended way to migrate a 2012 SSISDB to a 2017 SQL server?

$
0
0

Hello,

I have an SSISDB catalog ( with a couple hundred packages), on a SQL Server 2012 that I want to migrate a newly built 2017 SQL Server (with SSIS, and a fresh and still empty SSISDB catalog).

Of course, I do not wish to redeploy the 200 packages t the new server.

Is there a sure way (steps ?) of doing this migration ?

So far the few migration trial I attempted (using Backup & Restore of both the SSISDB database and its Master Key) failed:

While SSISDB database is on CL 140, the Catalog Properties show a Schema Build of 11.0.7462.6 (of the source server)

The "Database Upgrade" wizard (invoked from Integration Services Catalogs by right clicking SSISDB) fail with the following error:

Microsoft SQL Server Management Studio -- The system cannot find the file specified (System), etc...

Executing

use SSISDB

exec catalog.check_schema_version @use32bitruntime = 0 --- or 1

shows the following error:

Msg 27222, Level 16, State 1, Line 7

The required components for the 64-bit edition of Integration Services cannot be found. Run SQL Setup to install the required components

Msg 6522, Level 16, State 1, Procedure internal.check_schema_version_internal, Line 0 [Batch Start Line 6]

A .NET Framework error occurred during execution of user-defined routine or aggregate "check_schema_version_internal"

[……]

and trying to run any of the packages failed with the above error

I ran SQL Setup  to repair the SQL install. that did not fix the problem

I un-installed SSMS then installed a new version (18.1), but that too did not fix the problem.

Any help resolving this issue is greatly appreciated.

Thanks

ODBC Source properties are missing in the Data Flow Task expressions dialogue

$
0
0

I am trying to create an SSIS package to transfer data from a MySQL database (ODBC Source) to SQL server (ADO.NET Destination).

I need to use a dynamic query for the extract from the MySQL database. In the past, I have done this by setting the SqlCommand property as an expression via the Data Flow Task properties window. However, no ODBC source properties are shown in the expressions dialogue.

I have tried deleting and re-creating the data flow task, with no improvement.

This does not appear to be a known bug (or, at least, I haven't managed to find anything by Googling). Can anyone suggest a solution for this, please?

I am using Visual Studio Professional 2017 (version 15.9.3) with SSIS Designer version 15.0.900.40

Thanks,

Rob


URGENT HELP- HOW TO REMOVE OR AVOID 'SheetName$'_xlnm#_FilterDatabaset WHILE LOADING SSIS

$
0
0

Hi All,

I'm working on SSIS package to load the multiple sheets from single excel file. every month my client will update/insert the data in the sheets, my excel file has 9 sheets, while running SSIS package, apart from 9 sheets ,I see another 9 sheets  with names like 'SheetName$'_xlnm#_FilterDatabaset.

while I'm running the SSIS package, it's  looping through 'SheetName$'_xlnm#_FilterDatabaset also, and at one staging its failing with error " The Microsoft Access database engine could not find the object 'SheetName$_xlnm._FilterDatabase'. Make sure the object exists and that you spell its name and the path name correctly. If 'sheetname$_xlnm._FilterDatabase' is not a local object.

 

How to avoid or remove 'SheetName$'_xlnm#_FilterDatabaset from excel, Could someone help me with this please, its biturgent for me

Thanks In Advance

Vasu

Output flat file not in correct format

$
0
0

Hi,

I have a scenario where sql db table is dynamically populate from a front end form. I just need to output the data from the table into flat file destination exactly the way it is stored in sql db table in pipe delimited format. One of the columns has data like ["output","output only","output output"]. I am using ssis data flow task and inside DF I used oledb source to get data from the table and connect it to flat file destination. When I execute package the data in above mentioned column is displayed in different lines and not in single line in output text file.

I tried using derived column to replace [ with " and use " as text qualifier in flat file destination but since input column is varchar max and output column is DT_TEXT replace is not supported for this datatype.

How do I fix this?

Thanks






SSIS Project - Catalog Deployment - Environment Variable (for location information) accessing file server mapped to a local Z drive - SQL Server Agent issue

$
0
0

I have an SSIS package that reads a number of files using a For Each Loop Container. There are a number
of parameters in this package, and in the Integration Services Catalog in the SSMS, I have created an 
environment with many variables for this project/package.

There are a number of environment variables for this package. There is a particular environment variable forSource Location.

While in my DEV setting, I was able to pass the Source Location environment variable as :

C:\Data Repository\Files    (in a local machine).

Everything fine. Package runs perfectly, and For Each Loop Container works reads the files.



However, in the PROD setting, I have to use a file server, mapped to a Z drive.

For example:   

This PC > Data Repository (\\tordfs) (Z:) > Data Repository > X

becomes

Z:\Data Repository\X

when I copy the path.

Inside the SSIS package, I am able to set the parameter value for Source Location as Z:\Data Repository\X
and the For Each Loop Container works fine from the SSDT/Visual Studio.

Now after the SSIS package/project is deployed to the SSMS Catalog, when I feed Z:\Data Repository\X as a value for the Source Location environment variable, and I Execute the packagemanually from the Catalog, it works fine.

However, when I use the SQL Server Agent for the above process, I get the following error:


For Each Loop Container:Warning: The For Each File enumerator is empty.
The For Each File enumerator did not find any files that
matched the file pattern, or the specified directory was
empty.

Is there anything I need to do in the For Each Loop Container or the SSIS Catalog to eliminate the above error during execution from the Catalog  using SQL Server Agent?

Let me know.


Error While Executing the SSIS Package

$
0
0

Hi,

     I have created a SSIS package to sync data from MS SQL to My SQL. While executing the package i am seeing the following error in the "Execution Results" Tab.

[My SQL [311]] Error: An exception has occurred during data insertion, the message returned from the provider is: Unable to cast object of type 'System.Double' to type 'System.Char[]'.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "My SQL" (311) failed with error code 0xC020844B while processing input "ADO NET Destination Input" (318). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

[MS SQL [2]] Error: The MS SQL was unable to process the data. Exception from HRESULT: 0xC0047020

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on MS SQL returned error code 0xC02090F5.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

But in my source table i do not have a Double datatype. Unable to understand on what might be going wrong.

Any Idea or Suggestion on how to resolve this would be much appreciated. 


Regards, Dillu

Microsoft OLE DB provider suddenly insisting on finding a former SQL ( 10 year defunct!) server during Goldmine startup blocking Goldmine from starting

$
0
0

Have happily used Goldmine for the last 20 years. The first 10 years my various laptops would connect to a server when in the office. That server was eliminated 10 years ago! Todaystraight after a 'Malwarebites' update, when I tried to re-open Goldmine, the following popped up:

Goldmine Database Connection Problem

Description: [DBNETLIB][ConnectionOpen (Connect 0)

                   SQL Server does not exist or access denied

Native Code  17

Source          Microsoft OLE DB Provider for SQL Server

Trying to reconnect. Please Wait.

Two choices are given i.e Quit Goldmine    and Reconnect Now

The Quit choice makes the opening Goldmine disappear, the Reconnect choice keeps going around in circles

BOTH stop my Goldmine from opening. Have tried rebooting several times, and disconnecting from the internet, to no avail. How can I get my Goldmine to open without this text box popping up blocking it?


How t o Start/Control a SSIS Package (Project-deployed) with SQL Server Agent

$
0
0

UPDATE

Hi team,

I have some projects-deployed SSIS-packages stored in SSISBD which are working fine when started with Management Studio. The package contains aconnection manager that adresses (localdb)\ProjectsV13 using the instance pipe name instead of the symbolic instance name. In addition I have added the SQLSERVERAGENT credential to the security settings of instance data and Database files of (localdb). Executing with SSIS works well as before.

Nevertheless the job terminates with error. The error code now says, that the Agent cannot login with it's credentials (See below - second block).

Is it a bug or a feature? All in all, this problem makes it practically impossible to develop SQL Server Agent solutions to control and backup of SSDT project based (localdb) instances. 



Regards Jörg







SQL Server Agent Job Failed due to Linked Server

$
0
0

Hi

I am getting the error in step 2 of SQL Job used in when scheduled in SQL Server Agent as T-SQL has been used

Cannot fetch the rowset from OLE DB provider "SQLNCLI10" for linked server "PRODERP".

Please provide help

The AcquireConnection method call to the connection manager failed with error code 0xC0014009

$
0
0

Background:

The SSIS package has been running fine every week for last 10 months. It extracts data from Oracle using ODBC connection and then loading to sql server db. A week back, it failed in SQL Server Agent Job and also failed in Visual Studio SSDT with same connection issue. Nothing has changed. I could not figure out why. Can someone please help me on this? Thanks in advance.

error message in cmd.

C:\Program Files (x86)\Microsoft SQL Server\110\DTS\Binn>dtexec.exe /file "C:\

Visual Studio 2010\Projects\SSIS\TestIssues\ODBC_Connect_Issue1\ODBC_Connect_Issue1\test2.dtsx"

Microsoft (R) SQL Server Execute Package Utility

Version 11.0.6020.0 for 32-bit

Copyright (C) Microsoft Corporation. All rights reserved.

Started:  12:17:31 AM

Progress: 2019-07-08 00:17:33.26

   Source: test ODBC

   Validating: 0% complete

End Progress

Error: 2019-07-08 00:17:34.91

   Code: 0xC0014020

   Source: test2 Connection manager "hcmp1"

   Description: An ODBC error -1 has occurred.

End Error

Error: 2019-07-08 00:17:34.91

   Code: 0xC0014009

   Source: test2 Connection manager "hcmp1"

   Description: There was an error trying to establish an Open Database Connectivity (ODBC) connection with the database server.

End Error

Error: 2019-07-08 00:17:34.92

   Code: 0x0000020F

   Source: test ODBC Oracle Data Source [2]

   Description: The AcquireConnection method call to the connection manager hcmp1 failed with error code 0xC0014009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

End Error

Error: 2019-07-08 00:17:34.94

   Code: 0xC0047017

   Source: test ODBC SSIS.Pipeline

   Description: Oracle Data Source failed validation and returned error code 0x80004005.

End Error

Progress: 2019-07-08 00:17:34.94

   Source: test ODBC

   Validating: 100% complete

End Progress

Error: 2019-07-08 00:17:34.96

   Code: 0xC004700C

   Source: test ODBC SSIS.Pipeline

   Description: One or more component failed validation.

End Error

Error: 2019-07-08 00:17:34.97

   Code: 0xC0024107

   Source: test ODBC

   Description: There were errors during task validation.

End Error

DTExec: The package execution returned DTSER_FAILURE (1).

Started:  12:17:31 AM

Finished: 12:17:34 AM

Elapsed:  3.328 seconds

************************************

In Visual Studio, test connection is successful and I can also preview data from source. But when i execute,it fails.

Update the "parameter values" and "connection managers" of a project in SSISDB catalog from T-sql

$
0
0

Hi,

We have few SSIS projects that has been deployed to SQL server under SSISDBCatalog

Now, want to update some of the "parameter values" and "connection managers" to different value using T-SQL.

Can you please let me know if we can use some internal tables to update "parameter values" and "connection managers" .

Thanks,

Raksha


Raksha

(Bug) Commas in decimal values (European format), Excel output error in Data Flow

$
0
0

Let me show you briefly what I mean:

17,4,0,39600000000000002,1

When I read from an Excel file source this happens:

17 goes into a column, 4 goes into another column, and here is the problem: 0,39600000000000002 is supposed to go into one column, but due to the fact that the decimals are not US formatted, zero (0) goes into one column and the rest of the number 39600000000000002 goes into another column. This creates a whole lot of output errors with skewed column numbers (error column actually is misaligned from the rest and it throws the error: "the data value cannot be converted for reasons other than sign mismatch or data overflow" 

The only solution was to change the regional format on the SQL server host to US format.

Excel connection manager does not have any customization options that the Flat file connection manager has. 

How can I make the Excel file be read in SSIS while taking something other than a comma as a separator?

Installed SSDT but cannot find SSIS builder

$
0
0

We are upgrading one of our systems to use SQL Server 2017 and we use Integration Services to build SSIS packages and schedule them as jobs in Production.  In the past, when I installed SQL Server 2008r2, everything was there after a long but simple install.  It appears that everything needs to be installed separately with SQL 2017.  

Let me preface this with the fact that before installing SQL Server 2017, I already had Visual Studio 2017 installed on this machine.  I am hoping that this is not causing the issue.  I installed SQL Server 2017, then SSMS, followed by SSDT, the Data tools.  Everything installed successfully but the problem is I cannot find the Data Tools or even any mention of Integration Services on my Windows menu, here is what is listed:

Microsoft SQL Server 2017

Deployment Wizard

Reporting Services Configuration Manager

SQL Server 2017 Configuration Manager

SQL Server 2017 Data Feed Publishing Wizard

SQL Server 2017 Data Profile Viewer

SQL Server 2017 Data Quality Client

SQL Server 2017 Data Quality Server Installer

SQL Server 2017 Database Engine Tuning Advisor

SQL Server 2017 Deployment Wizard

SQL Server 2017 Error and Usage Reporting

SQL Server 2017 Execute Package Utility

SQL Server 2017 Import and Export Data (32-bit)

SQL Server 2017 Import and Export Data (64-bit)

SQL Server 2017 Installation Center (64-bit)

SQL Server 2017 Master Data Services Configuration Manager

SQL Server 2017 Project Conversion Wizard

Microsoft SQL Server Tools 17

               Microsoft SQL Server Management Studio 17

SQL Server Profiler 17


Can someone tell me what I am doing wrong and where the SSIS package builder is located?

Thank you,

Al

(SOLVED) Commas in decimal values (European format), Excel output error in Data Flow

$
0
0

Let me show you briefly what I mean:

17,4,0,39600000000000002,1

When I read from an Excel file source this happens:

17 goes into a column, 4 goes into another column, and here is the problem: 0,39600000000000002 is supposed to go into one column, but due to the fact that the decimals are not US formatted, zero (0) goes into one column and the rest of the number 39600000000000002 goes into another column. This creates a whole lot of output errors with skewed column numbers (error column actually is misaligned from the rest and it throws the error: "the data value cannot be converted for reasons other than sign mismatch or data overflow" 

The only solution was to change the regional format on the SQL server host to US format.

Excel connection manager does not have any customization options that the Flat file connection manager has. 

How can I make the Excel file be read in SSIS while taking something other than a comma as a separator?



MSDTC errors after server rename

$
0
0
Renamed a server (Windows Server 2016 Standard) with an existing SQL Server 2016 instance on it.  Checked @@SERVERNAME to ensure the name is correct.  However, when SSIS packages are run (from SSISDB) with supported transactions, getting the following error:

The SSIS Runtime has failed to enlist the OLE DB connection in a distributed transaction with error 0x8004D00E "The transaction has already been implicitly or explicitly committed or aborted"

Checked DTC services, settings, permissions.  Even uninstalled and reinstalled DTC.

Any assistance is greatly appreciated.  

Microsoft Jet Engine 4.0 Excel Connection Manager ERROR in SSIS

$
0
0

I recently updated my 2012 R2 server from Jet Engine Driver 3.0 to 4.0. Now i get errors whilst reading xls documents from SSIS.

I use another system that automatically creates xls reports and puts them in a network location. I then use SSIS to take the xls files and turn them in to SQL tables. This worked fine with the Jet Engine 3.0

Now with Microsoft Jet engine 4.0 I get the following error message.

SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009.

---TEMPORARY FIX---

If I open the xls file, click save and close the file, the SSIS package will recognise the file and the SSIS package will complete successfully. 

As this is an automated nightly package, I don't want to open, save then close manually each time.

Is there something I can do to make the system see the xls files without me opening and saving?

Kind regards, Kelvin.



Where to find the SSIS log file ?

$
0
0

Hi ,

I have configured SSIS logs for my package in SSIS. I set the Provider type as SSIS log provider for SQL Server.

Where to find the SSIS log file ?

Thanks

Package deployed is not visible in Catalog

$
0
0

Hi Experts,

I am using SQL Server 2017 and created a SSIS package. When I deploy the package, it deploys without any error, but deployed package is not visible in Catalog.

What could be the reason? any idea?

Thanks,


Naveen J V

Integration Services Error Message When Trying to Create News BIDS Project

$
0
0
I get the following error when trying to create a new package
"Visual Studio is unable to load this document:
To design integration services packages in Business Intelligence development studio, Integration Services must be installed on one of these editions of SQL Server 2008....To install integration services, run SQL Server Setup...."
No error number is there to reference.
I have SQL Server 2008 with one instance of Enterprise Eval Edition and one instance of Express loaded.
I have opened up the firewall to allow integration services to access (one suggested solution I saw somewhere) with no luck.
The default Deployment Server Edition in options is set to Enterprise.
Integration Services is running.
Can anyone suggest what I need to do to get this working?

Thanks
Viewing all 24688 articles
Browse latest View live