Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS TransactionOptions in parent and child package

$
0
0

Hi everyone,

I have an SSIS project with 3 packages: One is the parent package and the other 2 are child packages.

I want to implement TransactionOption in the package such that if the package fails, it rollback all the transactions in the parent package.

What I did is I set the TransactionOption in the parent package to Required and Supported for each of the child packages.

However, this approach seems to make the child package to hang.

Any idea on how to achieve this


me


TransactionOption error in SSIS

$
0
0


Hi guys,

I have a package with TransactionOption set to Required. If I run the package the first time it runs successfully, but when I ran it again I get the following error: error code: 0x8004D00E  Description: "The SSIS Runtime has failed to enlist the OLE DB connection in a distributed transaction with error 0x8004D00E "The transaction has already been implicitly or explicitly committed or aborted".

Then if I restart my system and run it again it will work fine, and fail on subsequent attempts.

Can someone help me with this.

Thanks


me

Deploy Project from Dev VM to Prod VM

$
0
0

Hi, as the title suggests, I am trying to deploy my SSIS Project from a Development SQL VM to my new Production VM.  They are on different networks.

Should I be able to connect to the SSISDB catalog on Prod from VS/SSDT running on the Dev VM and deploy the project that way?

I am unable to connect to the Prod SSISDB catalog and don't want to start figuring out the network config issues if this is isn't something I can do.

If it is, am I correct in understanding that I need to open port 135 for traffic for the program MsDtsSrvr.exe ?

I cant seem to find definitive instructions for what I need to do here.

Thanks

User variable NOT updating when package is executed in SSIS Catalog 2016

$
0
0

Hi there!

I am working on upgrading a SSIS 2008 package to SSIS 2016. The package checks if the source file exists or not using a script task and the value is updated in a user variable. The check works fine in SSIS 2008 andin SSDT (VS 2015 Shell). However, it is not updating the variable as expected when I deployed it into SQL 2016 -SSIS catalog.

The user variables I used are:

SourceFileExists - Read and write variable, Boolean type, package scope. values expected True or False

SourceFullPath - Read only variable. Source path includes file name as well.

Visual Basic 2015 script in the script task

Public Sub Main()

    Dts.Variables("User::SourceFileExists").Value = File.Exists(Dts.Variables("User::SourceFullPath").Value)

Dts.TaskResult = ScriptResults.Success
    End Sub

Basically, the default value is not getting overwritten with run time value. User running the package in SSIS and SSIS catalog is same.

Any ideas are appreciated.

Thank you!



"The package contains two objects with the duplicate name of "xxxx" and "xxxx"

$
0
0

Hi all,

I am creating a Data Flow custom component in SSIS, and my input/output columns are dynamically created depending on the value of a custom property of the component.

Then, as soon as I modify this custom property, I make some job in SetComponentProperty(), that I have overrided in my PipelineComponent, to create my input and ouput columns.

After validation, I have the following error message:

Error 3 Validation error. Data Flow Task: DTS.Pipeline: The package contains two objects with the duplicate name of "output column "AMOUNT" (4714)" and "input column "AMOUNT" (4711)". Package.dtsx 0 0 

I create an input column named "AMOUNT" with an ID 4711 and an output column named "AMOUNT" with an ID of 4712.

What is surprising is that when I manualy create the same columns with the default advanced editor of my component, using the menu "Show Advanced Editor...", there is no error !!!

I think that I am doing something wrong but I don't know what...!

Have someone any idea about that?

Here is the code I use to create new input columns:

IDTSInputColumn90 newInputColumn = inputColumns.InputColumnCollection.New();

newInputColumn.Name = virtulaInputColumn.Name;

newInputColumn.LineageID = virtulaInputColumn.LineageID;

newInputColumn.UsageType =

DTSUsageType.UT_READONLY;

newInputColumn.ErrorRowDisposition =

DTSRowDisposition.RD_NotUsed;

The virtulaInputColumn is the linked real input column that I get from IDTSInput90.GetVirtualInput()

 

Here is the code I use to create new output columns:

IDTSOutputColumn90 newOutputColumn = defaultOutput.OutputColumnCollection.New();

newOutputColumn.Name = outputColumn.Alias;

newOutputColumn.SetDataTypeProperties(

DataType.DT_WSTR, 0, 0, 0, 0);

The outputColumn is here one of my objects that I have created from the custom property of my custom component.

Thanks in advance for any help...

David

 

sql 2008 r2 SSIS

$
0
0

Hi All,

i have 2008 RTM edition DB also visual studio 2008 when i create package it says" it has to be standard or enterprise edition".

can someone help on this.Confused with the versions,tried installing 2008 evaluation(enterprise edition).I have installed 2012,2017 for other projects.For the new project not able to open the 2008 r2 packages.

Thanks


priyanka

MySQL Connector Performance

$
0
0

Hi Team,

I am using MySQL 5.1 (32) ODBC driver to connect Aurora MySQL instance. SSDT for Visual Studio 2015.  

My package have these problems.

1. How do I parameterize the ODBC connection information as OLEDB ? . Currently the packages are in Project Deployment Model. I have parameterized the "oledb" server's Server name, Database name as Project Parameters.  Do I need to make the ODBC connection using ConnectionString instead of DSN ? So that I can parameterize the connection string ?

2. I observed couple of times that my odbc source or destination data flow components does not shows the tables information. I have to create a new DSN and have to use that as source or destination. Why is this happening ? 

2. Throughput to MySQL Via. The batch size does not helps on update or inserting the data in to my sql. What is the recommendation for MySQL data connector to improve performance ?

Regards

Madhavan.TR


Madhavan Thasu Ramachandran


Excel Connection manager for Office 365

$
0
0

I have office 365 and am trying to create an Excel connection manager for it.

The goal is to export data from a SQL Server 2014 table into MS Excel.

I am using Microsoft Visual Studio Community 2017 to create and configure the SSIS package.

I am in development environment.

I get the following error message:

TITLE: Microsoft Visual Studio
------------------------------
Could not retrieve the table information for the connection manager 'Excel Connection Manager'.
Failed to connect to the source using the connection manager 'Excel Connection Manager'
------------------------------
BUTTONS:
OK
------------------------------

In my Excel Connection Manager I do not see an Excel Version for Office 365.

The latest version is Excel 2016

This problem is a real difficult issue

Any help would be greatly appreciated

Thanks



Calling Rest API to load data into SQLServer tables via SSIS

$
0
0

Hi All,

I wanted to call REST API to load data into SQL server. My knowledge with API  is very minimal(including c# and python) and done some basic research and it is suggested it can be done via various approach. I would like to know which is the best way to go for it.

Basically calling one API inside another.

1) Call via SSIS package script component (c# code)

2)Via Python script and execute the python script with SSIS package

Many thanks for the help.

Package location in the server

$
0
0

Hi guys, I spent hours trying to locate my packages in the server but I can't find them. I use the catalog, SSISDB. Everything works fine, I deploy the project, I see the packages, I set up agent, etc.

Just...where are the dtsx in the server? I tried ProgramFiles ==> SQLServer==> etc. and ProgramFiles(x86) ==> SQLServer==> etc. but nothing. My SQL version is 2016.

Thanks

Parallel or serial

$
0
0

Hi All,

I have a package in which i have one sequence container. In that i have 15 execute package task and all the 15 tasks except for the first one has precedence containers. My question is are they running in serial or parallel. How can i make them run in parallel. By removing the precedence constrains do they run in parallel?

Thanks

Visual studio 2015 - Error while deploying SSIS package

$
0
0

Hello,

We have an SQL server 2014 Enterprise  and i am trying to deploy as job as simple as just a send email task. When i deploy it to the SQL server it fails with the below error:

failed to load assembly Microsoft.SqlServer.Management.IntegrationServicesEnum. (Microsoft.SqlServer.Management.Sdk.Sfc)

ADDITIONAL INFORMATION:

Could not load file or assembly 'Microsoft.SqlServer.Management.IntegrationServicesEnum, Culture=neutral, PublicKeyToken=89845dcd8080cc91' or one of its dependencies. The system cannot find the file specified. (mscorlib)


SQL server details below:

Microsoft SQL Server Management Studio12.0.4100.1
Microsoft Analysis Services Client Tools12.0.4100.1
Microsoft Data Access Components (MDAC)6.1.7601.17514
Microsoft MSXML3.0 6.0 
Microsoft Internet Explorer9.10.9200.17609
Microsoft .NET Framework4.0.30319.42000
Operating System6.1.7601

VIsual Studio details below:

Microsoft Visual Studio Enterprise 2015
Version 14.0.25420.1 D14REL
Microsoft .NET Framework
Version 4.6.01055
Installed Version: Enterprise

SQL Server Data Tools   14.0.61116.0
Microsoft SQL Server Data Tools

SQL Server Integration Services   
Microsoft SQL Server Integration Services Designer
Version 13.0.1601.5

Any pointers please??

I tried few suggestions online that say to install "SQLSysClrTypes.msi" and "SharedManagementObjects.msi" but no luck.

Package completed but status still shows running

$
0
0

Hi,

I have multiple tasks in my package and when i execute the package i can see the green check marks on all the tasks, but the play sign next to the pause and stop is still greyed out making me think that its still in process. Any ideas?

Thanks

Error while executing SSIS package

$
0
0

Hi All,

Anyone can help on the below, as we are facing currently for the last few days with below errors.  No changes made to SSIS package, but some reason it is coming below error.

Started:  10:06:37 PM  Error: 2018-08-14 22:06:56.69     Code: 0xC0049064    

 Source: Data Flow Task Derived Column [1000]     Description: An error occurred while attempting to perform a type cast.  End Error  Error: 2018-08-14 22:06:56.69     Code: 0xC0209029    

 Source: Data Flow Task Derived Column [1000]     Description: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "component "Derived Column" (1000)" failed because error code 0xC0049064 occurred, and the error row disposition on "output column "END_CORE_MINS_7" (13535)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.  End Error  Error: 2018-08-14 22:06:56.70     Code: 0xC0047022    

 Source: Data Flow Task SSIS.Pipeline     Description: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Derived Column" (1000) failed with error code 0xC0209029 while processing input "Derived Column Input" (1001). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.  End Error  Error: 2018-08-14 22:06:56.75     Code: 0xC02020C4    

 Source: Data Flow Task OLE DB Source [1]     Description: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.  End Error  Error: 2018-08-14 22:06:56.75     Code: 0xC0047038    

 Source: Data Flow Task SSIS.Pipeline     Description: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "OLE DB Source" (1) returned error code 0xC02020C4.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  10:06:37 PM  Finished: 10:06:57 PM  Elapsed:  19.375 seconds.  The package execution failed.  The step failed.

Unable to deploy SSIS after VS 2017 update 15.8.0

$
0
0

I just installed the 15.8.0 update to Visual Studio 2017 and now I am unable to deploy SSIS projects and packages to the SSIS Catalog from within Visual Studio 2017. The Deployment Wizard does still work from the command line, however.

I have repaired SQL Server Data Tools. I have repaired Visual Studio 2017. I have uninstalled and reinstalled SQL Server Integration Services Projects. The end result is the same:

ETA: This error occurs after the "Connect" button is clicked on the "Select Destination" page of the Wizard.

===================================

Could not load file or assembly 'Microsoft.SqlServer.Management.IntegrationServicesEnum, Culture=neutral, PublicKeyToken=89845dcd8080cc91' or one of its dependencies. The parameter is incorrect. (Exception from HRESULT: 0x80070057 (E_INVALIDARG)) (mscorlib)

------------------------------
Program Location:

   at System.Reflection.RuntimeAssembly._nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.RuntimeAssembly.nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.RuntimeAssembly.InternalLoadAssemblyName(AssemblyName assemblyRef, Evidence assemblySecurity, RuntimeAssembly reqAssembly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Microsoft.SqlServer.Management.Sdk.Sfc.ObjectCache.LoadAssembly(String fullName)
   at Microsoft.SqlServer.Management.Sdk.Sfc.ObjectCache.LoadElement(ObjectLoadInfo oli)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Environment.GetServerVersion(Urn urn, Object ci)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Environment.GetObjectInfo(Object ci, RequestObjectInfo req)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Enumerator.GetObjectInfo(Object connectionInfo, RequestObjectInfo requestObjectInfo)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Enumerator.Process(Object connectionInfo, RequestObjectInfo requestObjectInfo)
   at Microsoft.SqlServer.Management.Sdk.Sfc.SfcInstance.GetSupportedResultTypes(ISfcConnection connection, Urn urn)
   at Microsoft.SqlServer.Management.Sdk.Sfc.SfcInstance.Initialize()
   at Microsoft.SqlServer.Management.Sdk.Sfc.SfcInstance.MarkRootAsConnected()
   at Microsoft.SqlServer.Management.IntegrationServices.IntegrationServices..ctor(SqlConnection sqlConnection)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.ServerHelper.ConnectToServer(String server, String username, String password, AuthenticationType authenticationType)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.ServerProjectBrowser.validateServerWorker_DoWork(Object sender, DoWorkEventArgs e)

===================================

The parameter is incorrect. (Exception from HRESULT: 0x80070057 (E_INVALIDARG)) (mscorlib)

------------------------------
Program Location:

   at System.AppDomain.nApplyPolicy(AssemblyName an)
   at System.AppDomain.ApplyPolicy(String assemblyName)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.MatchAssemblyName(AssemblyName reference, AssemblyName definition)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.FindAssembly(String name, IEnumerable`1 probingPaths)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.InnerResolveHandler(String name)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.ResolveHandler(Object sender, ResolveEventArgs args)
   at System.AppDomain.OnAssemblyResolveEvent(RuntimeAssembly assembly, String assemblyFullName)



How to get all input columns of script components checked by default to use the same in code ?

$
0
0

Hi ,

I am working on BIML Script component, where I am taking data from OLEDB Source.

In Script Component I want all the input columns to be checked by default as input.

I have no idea how to proceed for the same.

Below is my code :-

<Bimlxmlns="http://schemas.varigence.com/biml.xsd">

<ContainerName="Load Data Truncate Staging"ConstraintMode="Parallel"DelayValidation="true">

<Tasks>

<DataflowName="Archive Data"DelayValidation="true">

<Transformations>

<OleDbSourceName="Source"ConnectionName="DataStaging"ValidateExternalMetadata="false"LocaleId="None">

<VariableInputVariableName="User.V_Archivequery" />

</OleDbSource>

<RowCountName="Count Source Records"VariableName="User.sourceRecords"/>-->

<ScriptComponentTransformationProjectCoreName="MMd5"Name="MD5_Checksum">

<ScriptComponentProject>

<ScriptComponentProjectProjectCoreName="SC_Example.csproj"Name="ExampleScriptComponent">

<AssemblyReferences>

<AssemblyReferenceAssemblyPath="Microsoft.SqlServer.DTSPipelineWrap" />

<AssemblyReferenceAssemblyPath="Microsoft.SqlServer.DTSRuntimeWrap" />

<AssemblyReferenceAssemblyPath="Microsoft.SqlServer.PipelineHost" />

<AssemblyReferenceAssemblyPath="Microsoft.SqlServer.TxScript" />

<AssemblyReferenceAssemblyPath="System.Windows.Forms.dll" />

<AssemblyReferenceAssemblyPath="System.dll" />

<AssemblyReferenceAssemblyPath="System.AddIn.dll" />

<AssemblyReferenceAssemblyPath="System.Data.dll" />

<AssemblyReferenceAssemblyPath="System.Xml.dll" />

</AssemblyReferences>

<Files>

<FilePath="Properties\AssemblyInfo.cs">

using System.Reflection;

using System.Runtime.CompilerServices;

[assembly: AssemblyTitle("SC_Example.csproj")]

[assembly: AssemblyDescription("")]

[assembly: AssemblyConfiguration("")]

[assembly: AssemblyCompany("Ciber Nederland")]

[assembly: AssemblyProduct("SC_Example.csproj")]

[assembly: AssemblyCopyright("Copyright @ Ciber Nederland 2012")]

[assembly: AssemblyTrademark("")]

[assembly: AssemblyCulture("")]

[assembly: AssemblyVersion("1.0.*")]

</File>

<FilePath="main.cs">

using System;

using System.Data;

using Microsoft.SqlServer.Dts.Pipeline.Wrapper;

using Microsoft.SqlServer.Dts.Runtime.Wrapper;

using System.Security.Cryptography;

using System.Text;

using System.Windows.Forms;

using System.IO;

using System.Reflection;

[Microsoft.SqlServer.Dts.Pipeline.SSISScriptComponentEntryPointAttribute]

public class ScriptMain : UserComponent

{

public override void Input0_ProcessInputRow(Input0Buffer Row)

{

string strColumnsValue = string.Empty;

Type rowType = Row.GetType();

PropertyInfo columnProperty;

MD5 md5 = new MD5CryptoServiceProvider();

Encoder enc = System.Text.Encoding.Unicode.GetEncoder();

foreach(IDTSInputColumn100 Rw in this.ComponentMetaData.InputCollection[0].InputColumnCollection)

{

columnProperty = rowType.GetProperty(Rw.Name);

strColumnsValue += Convert.ToString(columnProperty.GetValue(Row,null));

}

byte[] bbb = new byte[strColumnsValue.Length * 3];

bbb = UnicodeEncoding.Unicode.GetBytes(strColumnsValue);

byte[] hash = md5.ComputeHash(bbb);

String strHash = Convert.ToBase64String(hash);

Row.RowChecksum = strHash;

}

}

</File>

</Files>

<InputBufferName="Input0">

</InputBuffer>

<OutputBuffers>

<OutputBufferName="Output0">

<Columns>

       <ColumnName="RowChecksum"DataType="String"Length="1000"/>

</Columns>

</OutputBuffer>

</OutputBuffers>

</ScriptComponentProject>

</ScriptComponentProject>

</ScriptComponentTransformation>

</Transformations>

</Dataflow>

</Tasks>

</Container>

</Tasks>

</Package>

</Packages>

</Biml>

Please suggest me where i am doing mistake.

Regards,

Vipin jha


Thankx & regards, Vipin jha MCP

The PerformUpgrade method failed.

$
0
0

 I tried using the above code. I keep getting error below. The component is developed using version 13 of dlls (DTS\130) and I did change the SSIS project configuration to point to Sql Server 2016.


[SSIS.Pipeline] Error: The component metadata for "Regex, clsid {4F885D04-B578-47B7-94A0-DE9C7DA25EE2}" could not be upgraded to the newer version of the component. The PerformUpgrade method failed.

No Execute permission for sp_startjob

$
0
0

I have an Access front-end which calls a stored procedure to execute an SSIS job.  This worked fine until about a week ago, now any attempt to run the jobs throws the error:

The EXECUTE permission was denied on the object 'sp_start_job', database 'msdb', schema 'dbo'.

I think this might have arisen as a result of a Windows update, but although I've searched thoroughly all over the internet I can't find a solution that works.  The jobs run normally when invoked via SSMS.

SSIS For each Loop

$
0
0

Please help with the following question,

I have a table with list of source and target table names.

I am trying to automate the SSIs process. All the tables are 1:1 mapping. 

Is this approach correct?

1) Execute SQL task to get source and target table name from table and store in object variable

2) Have a For Each loop to iterate through each of source tables

   2 a) With FOr each have a data flow task to load from source to target

       in the source am using SQl command as I have to do few transformation/conversion.

Is it possible to access the variable name(which stores the source table name) in SQL command of OLEDB source?

Thanks

Ways to check Connections of Network Location, SQL DB and Oracle DB via a script on success continue Package

$
0
0

Good day,

I have multiple connections:  internal/external network windows paths, sql db, oracle db, as400, and linked servers on the sql server

i would like to check if certain network locations are up, if not dont continue else continue to next step of package

The package downloads files from an external location (remote external network) via a windows\\....\test\import\*.xml > moves files to the sql server C: drive > then after insert move to a internal network location

And i have oracle db that might be down but if down move on to next oracle db, i have done the propagate but i want something to check and notify and skip the specific site if oracle or if network issues stop and email

is there a way i can check connections via a script or something so that it stops and sends email as a first step to continue to next. My design:

1. A check for SQL & Local Paths & BPCS Connections (linked servers)

2. A for each Loop container (per site), i want to have 2 checks within loop , 1. to check network locations are up, 2. to check the site oracle db

Please Assist?

Regards


Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>