Hi!

I have an Azure 2016, SQL 2016 2 node always on configuration with SSISDB in the availability group.

My packages work on the primary node, but on the replica I get the following error:

Please create a master key in the database or open the master key in the session before performing this operation. 

I have run the following but my packages still fail

OPEN master Key decryption by password = '<Password>' -- Password used when creating SSISDB
ALTER Master Key ADD encryption by Service Master Key

I have enabled always on support for SSIS on the primary node.

Any idea what I'm missing?

Thanks,

Zoe

This is happening on a shared environment running DataCenter.  We are doing a bulk merge of about 100 plus records.  It is failing in different spots but always the same error.  Sql has no error logs, and we are not seeing locks.  We need some hints as to what this error message really means.  

System.Data.SqlClient.SqlException: Connection Timeout Expired.  The timeout period elapsed during the post-login phase. 
The connection could have timed out while waiting for server to complete the login process and respond; Or it could have timed
out while attempting to create multiple active connections.  The duration spent while attempting to connect
to this server was - [Pre-Login] initialization=1; handshake=1; [Login] initialization=0; authentication=0;
[Post-Login] complete=14000;  ---> System.ComponentModel.Win32Exception: The wait operation timed out

Good day,

We are using SMO to transfer tables over from one server to the other on SQL Server 2016.

For a while now, the transfer succeeds only one out of 3 times on 1 server only, and we always get the same error message, which doesn't say much: An error occurred while transferring data. See inner exception for details.

That same package has been deployed to our 4 environments (Dev, Test, Qa and Prod) and is running everyday. However, we only get that problem in Test.

Our DBAs are not doing much to help us find the reason why that appends. Can you please give me a hint on where to look at? That SSIS package hasn't been updated for a long time, and the built version is the same in all environment.

Here is our .vb script in the package:

Public Sub Main()
    '
    ' Source and Destination Servers
    '
    ' MsgBox(Dts.Variables("User::SourceServer").Value.ToString)
    Dim srvSourceName As String = Dts.Variables("SourceServer").Value.ToString  '"brdsqldev"
    Dim srvDestinationName As String = Dts.Variables("DestinationServer").Value.ToString  '"brdsqldev"
    Dim bt(0) As Byte
    '
    ' Source and Destination Databases
    '
    Dim dbSourceName As String = Dts.Variables("SourceDB").Value.ToString
    Dim dbDestinationName As String = Dts.Variables("DestinationDB").Value.ToString

    Try
        Dts.Log("The Transfer starts", 0, bt)
        Dts.Log("Transfer starts with tables", 0, bt)
        Dts.Log("Transfer starts with tables" & srvSourceName, 0, bt)
        Dts.Log("Transfer starts with tables" & srvDestinationName, 0, bt)
        Dts.Log("Transfer starts with tables" & dbSourceName, 0, bt)
        Dts.Log("Transfer starts with tables" & dbDestinationName, 0, bt)
        ' TableExists()
        Transfer(srvSourceName, srvDestinationName, dbSourceName, dbDestinationName, CType(Dts.Variables.Item("myDataTable").Value, System.Data.DataTable), TransferObjectType.Table)
        ' Transfer(srvSourceName, srvDestinationName, dbSourceName, dbDestinationName, CType(Dts.Variables.Item("myDataViews").Value, System.Data.DataTable), TransferObjectType.View)
        Dts.Log("Transfer done with tables", 0, bt)
        Dts.Log("The Transfer ran successfully", 0, bt)
        Dts.TaskResult = ScriptResults.Success
        'MessageBox.Show("The transfer ran successfully.")

    Catch ex As Exception
        Dts.Events.FireError(99, "", ex.Message.ToString(), "", -1)
        OutPutError(ex)
        Dts.TaskResult = ScriptResults.Failure
        'MessageBox.Show("The transfer was aborted.")
    End Try

End Sub


Private Sub Transfer(ByVal srvSourceName As String, ByVal srvDestinationName As String, ByVal dbSourceName As String, ByVal dbDestinationName As String, ByVal dataTableToTransfer As DataTable, ByVal type As TransferObjectType)
    Try
        Dim srcsrv As Server
        srcsrv = New Server(srvSourceName)

        Dim dbSource As Database
        dbSource = srcsrv.Databases(dbSourceName)

        Dim dessrv As Server
        dessrv = New Server(srvDestinationName)

        Dim dbDestination As Database
        dbDestination = dessrv.Databases(dbDestinationName)

        Dim oleDA As New OleDbDataAdapter
        Dim dt As New DataTable
        Dim row As DataRow
        Dim sMsg As String

        Dim xfr As Transfer

        Dim bt(0) As Byte

        Dts.Log("Transfer Subroutine starts ...", 0, bt)
        xfr = New Transfer(dbSource)

        xfr.CopyAllTables = False
        xfr.Options.WithDependencies = False
        xfr.Options.ContinueScriptingOnError = False

        xfr.CopyAllRoles = False
        xfr.CopyAllLogins = False
        xfr.CopyAllDatabaseTriggers = False
        xfr.CopyAllDefaults = False
        xfr.CopyAllPartitionFunctions = False
        xfr.CopyAllObjects = False
        xfr.CopyAllPartitionFunctions = False
        xfr.CopyAllPartitionSchemes = False
        xfr.CopyAllRules = False
        xfr.CopyAllSchemas = False
        xfr.CopyAllSqlAssemblies = False
        xfr.CopyAllStoredProcedures = False
        xfr.CopyAllSynonyms = False
        xfr.CopyAllUserDefinedAggregates = False
        xfr.CopyAllUserDefinedDataTypes = False
        xfr.CopyAllUserDefinedFunctions = False
        xfr.CopyAllUserDefinedTypes = False
        xfr.CopyAllUsers = False
        xfr.CopyAllViews = False
        xfr.CopyAllXmlSchemaCollections = False
        xfr.CopySchema = True

        xfr.DestinationDatabase = dbDestination.Name
        xfr.DestinationServer = dessrv.Name
        xfr.DestinationLoginSecure = True
        xfr.DropDestinationObjectsFirst = False

        Select Case type
            Case TransferObjectType.Table
                xfr.CopyData = True
            Case TransferObjectType.View
                xfr.CopyData = False
            Case Else
                Dts.Log("Unknown object transfer type. (-99)", -99, bt)
                Dts.TaskResult = ScriptResults.Failure
                'Throw New Exception("Unknown object transfer type.")
        End Select

        dt = dataTableToTransfer
        Dts.Log("Transfer Subroutine just before Row Count...", 0, bt)
        If dt.Rows.Count > 0 Then
            Dts.Log("Transfer Row Count > 0...", 0, bt)
            For Each row In dt.Rows
                Dim tblSourceName As String
                Dim tblSourceSchema As String

                tblSourceSchema = row("transferschema").ToString()
                tblSourceName = row("transferobject").ToString

                Select Case type
                    Case TransferObjectType.Table
                        xfr.ObjectList.Add(dbSource.Tables(tblSourceName.ToString, tblSourceSchema.ToString))
                    Case TransferObjectType.View
                        xfr.ObjectList.Add(dbSource.Views(tblSourceName.ToString, tblSourceSchema.ToString))
                    Case Else
                        Dts.Events.FireError(99, "Transfer Object", "Unknows object type", "", -1)
                        Dts.TaskResult = ScriptResults.Failure
                        'Throw New Exception("Unknown object transfer type.")
                End Select

            Next
            Dts.Events.FireInformation(1, "", "Just before transfering data", "", -1, False)

            xfr.TransferData()

        End If

    Catch ex As InternalSmoErrorException
        Dim bt(0) As Byte
        Dts.Events.FireError(99, "Transfer Objects", ex.Message.ToString(), "", -1)
        OutPutError(ex)
        Dts.TaskResult = ScriptResults.Failure

    End Try

End Sub

Private Sub OutPutError(ex As Exception)
    Dim ErrorLogDir As String
    Dim OutPutFileName As String
    ErrorLogDir = System.IO.Path.GetDirectoryName(Dts.Connections("ExportNightlyTransfer.xml").ConnectionString.ToString())
    OutPutFileName = ErrorLogDir + "\\" + Dts.Variables("PackageName").Value.ToString() + "ErrorReport" + Now.ToString("yyyyMMddHHmmss") + ".txt"
    Using sw As StreamWriter = New StreamWriter(OutPutFileName)
        sw.WriteLine(Now.ToString())
        sw.WriteLine("Package Name: " + Dts.Variables("PackageName").Value.ToString())
        sw.WriteLine("Task Name: " + Dts.Variables("TaskName").Value.ToString())
        sw.WriteLine(ex.Message.ToString())
        sw.WriteLine(ex.GetBaseException.ToString())
        sw.WriteLine(ex.StackTrace.ToString())
    End Using
End Sub

Any idea?

Thanks in advance for your help.

Mylene

Hi all

I need to run a command line on a server with date parameters using C# in SSIS (2015)

The command line example:

D:\TEST >dotnet TEST.dll --fromDateTime "2018-11-21" --toDateTime "2018-11-22"

Can you assist me in the script?

Thanks

Hi,

on my machine I've SQL Server 2017 64-bit and SSIS 2017, SSDT for Visual Studio 2017, Excel 2016 64-bit (Office Professional Plus).

Moreover, I've installed Microsoft Access Database Engine 2016 Redistributable components.

I've created a sample Excel 2016 file to try to read from it.

I've created a SSIS 2017 solution and for the project I've Run64BitRuntime option to True. I've created an Excel connection manager, but when I use it for an Excel source I cannot read data.

I've tried to three different Excel versions for the Excel connection manager, 2007-2010, 2013 and 2016, but without any results.

If I open the advanced editor for the Excel source I can see an error message about Microsoft.ACE.OLEDB.1x.0 is not registered.

Any suggests to me to solve this issue? Thanks

I have gone through all the articles I could find about configuration of MSDTC. I have firewall open for DTC for Domain, Private and Public networks. I still keep getting this error. I am running Visual Studio 2017 on Windows 10.

DTC is running on both local and remote server. I have tested using DTCPing tool and it is successful.

Error: 0xC001402C at BER, Connection manager "BER": The SSIS Runtime has failed to enlist the OLE DB connection in a distributed transaction with error 0x8004D00E "The transaction has already been implicitly or explicitly committed or aborted".

Regarding the Local DTC, below are the properties enabled: Network DTC access
Allow Remote clients
Allow Remote Administration
Allow Inbound
Allow Outbound
Mutual Authentication Required
Enable XA Transactions
Enable SNA LU 6.2 Transactions

Same settings on server running Windows Server 2012 R2

Please help

Copy Database not working as mentioned at MSSQL documentation.

https://docs.microsoft.com/en-us/sql/relational-databases/databases/use-the-copy-database-wizard?view=sql-server-2017

Procedure I followed:

1. Select the Transfer Method: Use the SQL Management Object method

2. Select Databases -> Checked on copy single Database out of list

3. If the destination database already exists: Drop any database on the destination server with the same name, then continue with the database transfer, overwriting existing database files.

4. Select Server objects-> Select related objects: Logins

5. Run immediately

   Integration Services Proxy account: SQL Server Agent Service Account

Complete the Wizard:

Date11/23/2018 5:01:53 PM
LogJob History (CDW_DB-TESTSRV_SAMEER-DBA_2_1)

Step ID1
ServerSAMEER-DBA
Job NameCDW_DB-TESTSRV_SAMEER-DBA_2_1
Step NameCDW_DB-TESTSRV_SAMEER-DBA_2_1_Step
Duration00:00:00
Sql Severity0
Sql Message ID0
Operator Emailed
Operator Net sent
Operator Paged
Retries Attempted0

Message
Executed as user: NT Service\SQLSERVERAGENT. ...01.2 for 64-bit  Copyright (C) 2016 Microsoft. All rights reserved.    Started:  5:01:53 PM  Error: 2018-11-23 17:01:53.36     Code: 0xC001404B     Source: CDW_DB-TESTSRV_SAMEER-DBA_2 Log provider "{F4A600D2-27D6-45E8-99D5-E4BD22F3CB6C}"     Description: The SSIS logging provider has failed to open the log. Error code: 0x80070005.  Access is denied.  End Error  Error: 2018-11-23 17:01:53.36     Code: 0xC001404B     Source: CDW_DB-TESTSRV_SAMEER-DBA_2 Log provider "{F4A600D2-27D6-45E8-99D5-E4BD22F3CB6C}"     Description: The SSIS logging provider has failed to open the log. Error code: 0x80070005.  Access is denied.  End Error  Progress: 2018-11-23 17:01:53.56     Source: DB-TESTSRV_172_18_12_14_Transfer Objects Task      Task just started the execution.: 0% complete  End Progress  Error: 2018-11-23 17:01:53.66     Code: 0x00000000     Source: DB-TESTSRV_172_18_12_14_Transfer Objects Task      Description: Failed to connect to server DB-TESTSRV.  StackTrace:    at Microsoft.SqlServer.Management.Common.ConnectionManager.Connect()    at Microsoft.SqlServer.Dts.Tasks.TransferObjectsTask.TransferObjectsTask.OpenConnection(Server& server, ServerProperty serverProp)  InnerException-->Login failed for user 'BRAINDIGIT\SAMEER-DBA$'.  StackTrace:    at System.Data.SqlClient.SqlInternalConnectionTds..ctor(DbConnectionPoolIdentity identity, SqlConnectionString connectionOptions, SqlCredential credential, Object providerInfo, String newPassword, SecureString newSecurePassword, Boolean redirectedUserInstance, SqlConnectionString userConnectionOptions, SessionData reconnectSessionData, DbConnectionPool pool, String accessToken, Boolean applyTransientFaultHandling, SqlAuthenticationProviderManager sqlAuthProviderManager)     at System.Data.SqlClient.SqlConnectionFactory.CreateConnection(DbConnectionOptions options, DbConnectionPoolKey poolKey, Object poolGroupProviderInfo, DbConnectionPool pool, DbConnection owningConnection, DbConnectionOptions userOptions)     at System.Data.ProviderBase.DbConnectionFactory.CreatePooledConnection(DbConnectionPool pool, DbConnection owningObject, DbConnectionOptions options, DbConnectionPoolKey poolKey, DbConnectionOptions userOptions)     at System.Data.ProviderBase.DbConnectionPool.CreateObject(DbConnection owningObject, DbConnectionOptions userOptions, DbConnectionInternal oldConnection)     at System.Data.ProviderBase.DbConnectionPool.UserCreateRequest(DbConnection owningObject, DbConnectionOptions userOptions, DbConnectionInternal oldConnection)     at System.Data.ProviderBase.DbConnectionPool.TryGetConnection(DbConnection owningObject, UInt32 waitForMultipleObjectsTimeout, Boolean allowCreate, Boolean onlyOneCheckConnection, DbConnectionOptions userOptions, DbConnectionInternal& connection)     at System.Data.ProviderBase.DbConnectionPool.TryGetConnection(DbConnection owningObject, TaskCompletionSource`1 retry, DbConnectionOptions userOptions, DbConnectionInternal& connection)     at System.Data.ProviderBase.DbConnectionFactory.TryGetConnection(DbConnection owningConnection, TaskCompletionSource`1 retry, DbConnectionOptions userOptions, DbConnectionInternal oldConnection, DbConnectionInternal& connection)     at System.Data.ProviderBase.DbConnectionInternal.TryOpenConnectionInternal(DbConnection outerConnection, DbConnectionFactory connectionFactory, TaskCompletionSource`1 retry, DbConnectionOptions userOptions)     at System.Data.SqlClient.SqlConnection.TryOpenInner(TaskCompletionSource`1 retry)     at System.Data.SqlClient.SqlConnection.TryOpen(TaskCompletionSource`1 retry)    at System.Data.SqlClient.SqlConnection.Open()     at Microsoft.SqlServer.Management.Common.ConnectionManager.InternalConnect(WindowsIdentity impersonatedIdentity)     at Microsoft.SqlServer.Management.Common.ConnectionManager.Connect()  End Error  Progress: 2018-11-23 17:01:53.66     Source: DB-TESTSRV_172_18_12_14_Transfer Obj...  The package execution fa...  The step failed.

Hi all,

I have a slowly changing dimension in a dataflow that has been working for months but has now started to consistently give a dead lock error.  The deadlock occurs on 2 update statements within the SCD that update the same table.  What is odd is that this only occurs when the package is executed over night by the sql agent, along with other packages.  In fact this package is the last to run.  If I run the package by itself in visual studio then I dont get any deadlock errors.

The 2 OLE DB commands contain the 2 update statements are involved in the dead lock.

Below is the xml dead lock report:

Hi Guys,

Please I need some assistance, I know we can executing a package using a batch file if the ssis package is in our local file system. I will like to find out if we can do this for a package deployed to Integration Services Catalogs.

Thanks

me

Hi Team,

i am loading the data from oracle to sql server,so i am connecting the source oracle,how to check weather the source connection is closed or not after the package runs fine.

as far i know ssis engine closes the connection automatically once the task is complete.

but i need to know the proof.can anybody help me here.

Thanks,

I set the TypeGuessRows registry value to 0 in this location:

HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Office\14.0\Access Connectivity Engine\Engines\Excel

Is that the correct location where it would be set when creating excel files through SSIS 2012 using the ACE driver like this one:

Provider=Microsoft.ACE.OLEDB.12.0;Data Source=D:\myfile.xlsx;Extended Properties="EXCEL 12.0 XML;HDR=YES;IMEX=1";

I'm still having problems with fields over 255 characters and thought maybe that I had set TypeGuessRows in the wrong location.

Thanks

As part of a larger SSIS package, I'm running a fairly simple data flow with an OLE DB source into a flat file destination to extract data to a text file.
Nothing else happens in this step, but for some reason it's taking over 10 minutes to complete. The rest of the package completes within seconds.
The source is a DB view, with data of only 3000 rows to output (about 800kb), so it's not moving a huge amount of data or anything but seems to only write about 100kb to the file every few minutes.
The view itself runs in under a second when run outside of SSIS so I don't think the view itself is a problem.

Any ideas what I could do to speed up the writing to file in SSIS?
I've seen solutions mentioning updating stats, but the view runs quickly and the data is removed from the DB upon package completion.

Thanks.

Hi,

I am creating a SSIS package for which uses oracle provider for OLEDB.

Where as it's throwing an error when testing the connection. Please find the below error..

Test connection failed because of an error in initializing provider. The 'OraOLEDB.Oracle.1' provider is not registered on the local machine.

SSIS is on server1 and Oracle is on Server2.

Do u i need do anything with TNSNAMES.ORA file?? If yes, in which server??

Thanks

Bhanu