Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

get user list from AD security group and nested group alongwith the nested/parent group

November 18, 2018, 4:26 pm
$
0
0

Hi,

I have already created a thread in https://social.msdn.microsoft.com/Forums/en-US/ca372d9d-3ae6-445a-908b-3e766bd42a9e/output-members-of-ad-group-and-nested-groups-with-path-inside-script-task?forum=csharpgeneral

Please help me with the solution as I dont find anything helpful so far to find the user's group name from which he has been inherited or what group(nested group) he primarily belongs to.This is because some users are added into a security group from another security/distribution group.

↧
Search

SSIS Lookup not matching on equal values of datetime if cache mode is partial or no cache

November 16, 2018, 4:29 pm
$
0
0

We have a Lookup to match incoming records from temp table and filter out duplications before entering the destination table. The temp and destination tables have exactly the same definition. The matching compares 3 columns with type of text, numeric, and datetime.

It works correctly under full cache mode, but will run out of memory when data grows to realistically massive size. The Lookup will load the entire destination table into memory and triggers too much swapping.

For performance tried to change it to partial cache and no cache, and the changes breaks correctness because the equal values on datetime column fails to match and repeats are escaping the filter into destination data table.

The other columns are in text and numeric types, and they seem to be OK. Just for test, if exclude the datetime column the Lookup matches as expected with the rest columns.

I suspect there might be something wrong in collation or other stuff related, I am not sure how to confirm and do not have a solution.

The environment is SQL Server 2016, Visual Studio 2015, and Windows Server 2016. And the matching failure happens in Visual Studio debugging. More information available if needed, and thanks a lot in advance.



↧
↧

Migrated Vs 2008 SSIS package to VS2012 and getting error while opening the Packages

November 15, 2018, 4:06 am
$
0
0

Hello team,

i have done upgraded VS2008 to VS2012, And while opening master packages i am getting below error for all individual packages .and this SSIS packages using config files .

Please let me know what can be done for this .Thanks 

↧

How i need pass ID and name into varibales and execute Procedure

November 19, 2018, 7:00 am
$
0
0


I Need to execute 2 Procedures
Ex : 

Exec usp_Employee @name = 'Employee'

Exec usp_Department @ID = 2,@name = 'Department'

I have a master table where I have records like this 

ID name
1  Employee
2  Department
3  Class

How can I pass this table data into variables send to the Procedure as parameters

The Employee name should go to usp_Employee Procedure as parameter and the ID and Department name should go to usp_Department Procedure as parameter

I have created Execute SQL TASK in that I have placed this Procedures

Exec usp_Employee @name = ?
Exec usp_Department @ID = ?,@name = ?

And used For loop  container but it is not  executing as expected.

How can I loop the master table data into variables and pass it as parameters to those Procedures.

Suggest me

 

↧

how to store oracle connection password in encrpted ssis

November 19, 2018, 9:43 am
$
0
0

Team,

i am facing the issue while i am using oracle as source and i need to store the connection manager password in encrypted format,

because that is restricted from client .i tried many ways using expressions and even in configuration files also it will not store in encrypted format,is there any way to achieve this as it is urgent issue,could anyone help me here.

Thanks,

↧
↧

The SSIS Runtime has failed to enlist the OLE DB connection in a distributed transaction with error 0x8004D024 "The transaction manager has disabled its support for remote/network transactions.".

February 6, 2018, 11:25 pm
$
0
0

Hi All,

Case: I have a SSIS package developed in SS2016, which has got several Sequence containers and dataflow tasks. 

Only one of the sequence containers has TransactionOption : "Required" included with couple of Execute SQL task and a DFT with TransactionOption as "Supported". Also the TransactionOption at the package level as "Supported". Dataflow task transfers data from stage to target in the same database in the same server. Rest other Sequence containers and other objects has TransactionOption as "Supported".

When executed, I am getting the below error on the transaction enabled Sequence container:

The SSIS Runtime has failed to enlist the OLE DB connection in a distributed transaction with error 0x8004D024 "The transaction manager has disabled its support for remote/network transactions.".

Regarding the Local DTC, below are the properties enabled:

Network DTC access
Allow Remote clients
Allow Remote Administration
Allow Inbound
Allow Outbound
No Authentication Required
Enable XA Transactions
Enable SNA LU 6.2 Transactions

DTC Logon Account
NT AUTHORITY\NetworkService

Also please note that the Distributed Transaction Coordinator service is running in the server.

Please suggest.

Thanks in advance,
Regards
Santoshkumar G Shet

↧

SSIS Failed to enlist distributed transaction - transaction implicitly or explicitly committed or aborted (0x8004D00E)

November 19, 2018, 11:21 am
$
0
0

I have gone through all the articles I could find about configuration of MSDTC. I have firewall open for DTC for Domain, Private and Public networks. I still keep getting this error. I am running Visual Studio 2017 on Windows 10.

DTC is running on both local and remote server. I have tested using DTCPing tool and it is successful.

Error: 0xC001402C at BER, Connection manager "BER": The SSIS Runtime has failed to enlist the OLE DB connection in a distributed transaction with error 0x8004D00E "The transaction has already been implicitly or explicitly committed or aborted".

Regarding the Local DTC, below are the properties enabled: Network DTC access
Allow Remote clients
Allow Remote Administration
Allow Inbound
Allow Outbound
Mutual Authentication Required
Enable XA Transactions
Enable SNA LU 6.2 Transactions

Same settings on server running Windows Server 2012 R2

Please help

↧

Accessing data from Amazon Snowflake datawarehouse

November 14, 2018, 12:12 am
$
0
0

Hi Friends - I need to read some data from Amazon Snowflake warehouse and load to SQL server. I am planning to implement it using SSIS. Please provide me the link to install the drivers for it and steps required to integrate the data to SQL server.

Regards..

↧
Search

weird exception message in ssis when debugging

November 8, 2018, 12:20 pm
$
0
0

Hi, I got this error message today when debugging in vs 2010, presumably sql 2012. What does it mean?

the type initializer for system.windows.media.fonts threw an exception (msorclib)

↧
↧

Unable to run a powershell script by SSIS Execution Process Task

November 20, 2018, 12:59 am
$
0
0

Hi!

I am trying to run a Powershell Script in a SSIS package -> Execute Process Task:

Invoke-Command -ComputerName TESTSERVER01 -FilePath "C:\PS_Scripts\createWebservice.ps1"

I tried also to put -ExecutePolicy ByPass at the Begin of obove mentioned command, unfortunately without succsess.

When I run the command directly from PS Command Console, it WORKS fine without any problems.

Details of the Execute Process Task:

Executable: C:\Windows\System32\WindowsPowershell\v1.0\powershell.exe

WorkingDirectory: C:\PS_Scripts

The only one error I get is:

Error: 0xC0029151 at Execute Process Task, Execute Process Task: In Executing ......... The process exit code was "1" while the expected was "0".

Your support will be highly appreciated.

↧

Non-SysAdmins have been denied permission to run DTS Execution job steps without a proxy account. The step failed.

November 15, 2018, 9:14 pm
↧

Error Trying to Run Debug with Visual studio 2017

May 30, 2018, 9:17 am
$
0
0

Hey everyone,  I am having an issue with Visual Studio 2017 and debugging. Currently, we are loading up a test file (TestProj.sln), then running the debug function. 

SSDT did not install properly on this system, so had to use the /layout option.  Not sure if This problem is related or not.  And almost sure that this is not the correct location to place this message, but only place I could find related to it and Visual Studio. 

Anyway,

All appears like it is running and then I get an error message:

TITLE: Microsoft Visual Studio

------------------------------

Failed to start project

------------------------------

ADDITIONAL INFORMATION:

Unable to start debugging.

The debugger is not properly installed.

Run setup to install or repair the debugger. (Microsoft.DataTransformationServices.VsIntegration)

------------------------------

Unable to start program 'DTS'.

The debugger is not properly installed.  Cannot debug the requested type of code. Run setup to install or repair the debugger. (Microsoft Visual Studio Debugger)

------------------------------

BUTTONS:

OK

Below is the logging information that is produced:

===================================

Failed to start project (Microsoft Visual Studio)

===================================

Unable to start debugging.

The debugger is not properly installed.

Run setup to install or repair the debugger. (Microsoft.DataTransformationServices.VsIntegration)

------------------------------

Program Location:

   at Microsoft.DataTransformationServices.Project.DataTransformationsPackageDebugger.LaunchVsDebugger(IVsDebugger iVsDebugger, DataTransformationsProjectConfigurationOptions options)

   at Microsoft.DataTransformationServices.Project.DataTransformationsPackageDebugger.ValidateAndRunDebugger(Int32 flags, IOutputWindow outputWindow, DataTransformationsProjectConfigurationOptions options)

   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchDtsPackage(Int32 launchOptions, ProjectItem startupProjItem, DataTransformationsProjectConfigurationOptions options)

   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchActivePackage(Int32 launchOptions)

   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchDtsPackage(Int32 launchOptions, DataTransformationsProjectConfigurationOptions options)

   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.Launch(Int32 launchOptions, DataTransformationsProjectConfigurationOptions options)

===================================

Unable to start program 'DTS'.

The debugger is not properly installed.  Cannot debug the requested type of code. Run setup to install or repair the debugger. (Microsoft Visual Studio Debugger)

------------------------------

Program Location:

   at System.Runtime.InteropServices.Marshal.ThrowExceptionForHRInternal(Int32 errorCode, IntPtr errorInfo)

   at Microsoft.DataTransformationServices.Project.DataTransformationsPackageDebugger.LaunchVsDebugger(IVsDebugger iVsDebugger, DataTransformationsProjectConfigurationOptions options)

It is Visual Studio 2017 Professional edition

Running on Windows 2008 R2.

I have made sure that all of the debugging options are installed.  Also have done a repair.

Any Ideas?

↧

SSIS master key on Replica

November 20, 2018, 5:22 am
$
0
0

Hi!

I have an Azure 2016, SQL 2016 2 node always on configuration with SSISDB in the availability group.

My packages work on the primary node, but on the replica I get the following error:


Please create a master key in the database or open the master key in the session before performing this operation. 

I have run the following but my packages still fail

OPEN master Key decryption by password = '<Password>' -- Password used when creating SSISDB
ALTER Master Key ADD encryption by Service Master Key

I have enabled always on support for SSIS on the primary node.

Any idea what I'm missing?

Thanks,

Zoe



↧
↧

Importing from Excel 2013-2016 - SSIS 2017

November 20, 2018, 7:23 am
$
0
0

Hi,

on my machine I've SQL Server 2017 64-bit and SSIS 2017, SSDT for Visual Studio 2017, Excel 2016 64-bit (Office Professional Plus).

Moreover, I've installed Microsoft Access Database Engine 2016 Redistributable components.

I've created a sample Excel 2016 file to try to read from it.

I've created a SSIS 2017 solution and for the project I've Run64BitRuntime option to True. I've created an Excel connection manager, but when I use it for an Excel source I cannot read data.

I've tried to three different Excel versions for the Excel connection manager, 2007-2010, 2013 and 2016, but without any results.

If I open the advanced editor for the Excel source I can see an error message about Microsoft.ACE.OLEDB.1x.0 is not registered.

Any suggests to me to solve this issue? Thanks

↧

Throttle SSIS RAM usage

November 20, 2018, 1:35 pm
$
0
0

I have a package with multiple data flows.

We are loading columnstore indexes, so let assume each buffer in each data flow is 2GB. Server has about 20GB RAM available.

When the process starts, all dataflow loads multiple buffers in memory and at least one of the data flows fail with out of memory error.

If I run only single data flow at the time, this data flow will start throttling source component and keep memory usage in check.

Is there any option to force earlier throttling of the source components, so we have no more than 3 buffers per data flow?



↧
Search

get user list from AD security group and nested group alongwith the nested/parent group

November 18, 2018, 4:26 pm
$
0
0

Hi,

I have already created a thread in https://social.msdn.microsoft.com/Forums/en-US/ca372d9d-3ae6-445a-908b-3e766bd42a9e/output-members-of-ad-group-and-nested-groups-with-path-inside-script-task?forum=csharpgeneral

Please help me with the solution as I dont find anything helpful so far to find the user's group name from which he has been inherited or what group(nested group) he primarily belongs to.This is because some users are added into a security group from another security/distribution group.

↧

Losing code

November 20, 2018, 4:01 pm
$
0
0
We have a couple of projects in the integration services catalog, both containing packages that contain vb script tasks. I did an export of them from the integration services catalog into ispac files and tried to pull them into visual studio 2015.    they both pulled in, but when opening the script task we noticed that it was converted to c# and was just a shell.    After that, I pulled the projects directly from the integration services catalog using visual studio and the integration services import project wizard.    after doing this, I was able to open one of them and the script task was vb and was complete, but the other was still a C# shell as before.      The server instance is sql 2016.     We have the code saved in source control, but we are having a prod issue and were wanting to pull the code from prod and verify what is actually running to make sure it was what we thought it was.    Any idea why it's losing the vb script task and converting to a c# shell?       
↧
↧

Help Understanding what ServerPassword and ProxyPassword is

November 20, 2018, 5:06 pm
$
0
0

I am newish to SSIS. I am editing an SSIS package and I was looking around. I stumbled on <g class="gr_ gr_242 gr-alert gr_gramm gr_inline_cards gr_run_anim Grammar multiReplace" data-gr-id="242" id="242">a HTTP</g> Connection Manager Object and I don't understand what the fields ServerPassword and ProxyPassword are used for.

Can someone explain this?

↧

Error when generate the excel file

November 13, 2018, 7:32 am
$
0
0

Hi,

The sql job called the SSIS package to generate the excel file.  It was working fine. 

 I have the link from the application where user can excuse this package on demand and got error  below.  I am not sure why, the same package, it worked when the job call, but not working when excuse it from the web site?

". Connection may not be configured correctly or you may not have the right permissions on this connection.

Thanks

↧

Getting Error while trying to connect Sharepoint list by using OData Source

November 13, 2018, 3:02 am
$
0
0

Hi,

Trying to connect Sharepoint List(O365) but no luck,it's throwing me an error.

TITLE: OData Connection Manager Editor
------------------------------

Test connection failed

------------------------------
ADDITIONAL INFORMATION:

The remote server returned an error: (403) Forbidden. (Microsoft.SqlServer.IntegrationServices.ODataConnectionManager)

I have read the article that you refer to.

whitepages.unlimitedviz.com/2014/03/using-the-odata-source-connector-with-sharepoint-online-authentication/

I followed the advice to click on All and change Microsoft Online Services Authentication to True but this option does not appear on my version which under Security has only:

  • Authentication Type
  • Domain
  • Password
  • User ID

Thanks

Bhanu


↧
Viewing all 24688 articles
Browse latest View live
Search