Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

The Operation Could not be completed (Microsoft.DataTransformationservices.Vsintegration)

October 2, 2018, 12:04 am
$
0
0
===================================

Package Validation Error (Package Validation Error)

===================================

------------------------------
Program Location:

   at Microsoft.DataTransformationServices.Project.DataTransformationsPackageDebugger.ValidateAndRunDebugger(Int32 flags, DataWarehouseProjectManager manager, IOutputWindow outputWindow, DataTransformationsProjectConfigurationOptions options)
   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchDtsPackage(Int32 launchOptions, ProjectItem startupProjItem, DataTransformationsProjectConfigurationOptions options)
   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchDtsPackage(Int32 launchOptions, DataTransformationsProjectConfigurationOptions options)
   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.Launch(Int32 launchOptions, DataTransformationsProjectConfigurationOptions options)

Prabakar

↧
Search

Exception Handling for connection errors-SSIS

September 27, 2018, 6:14 pm
$
0
0

Hi,

   Looking for help to handle unexpected exceptions in SSIS Package. 

The SSIS Package has OLEDB source n destination to extract data and load to a table. I have redirected the errors from destination to a script component which derives error column and description. The code works fine for data errors like truncation error or length of field exceeding limit etc . But when there is connection or network error , the code fails with below msg. And in the data viewer , error column =0 and error code is -1071607685. 

   at Microsoft.SqlServer.Dts.Pipeline.Wrapper.IDTSComponentMetaData130.GetIdentificationStringByID(Int32 lID)
   at ScriptMain.Input0_ProcessInputRow(Input0Buffer Row)
   at UserComponent.Input0_ProcessInput(Input0Buffer Buffer)
   at UserComponent.ProcessInput(Int32 InputID, String InputName, PipelineBuffer Buffer, OutputNameMap OutputMap)
   at Microsoft.SqlServer.Dts.Pipeline.ScriptComponent.ProcessInput(Int32 InputID, PipelineBuffer buffer)
   at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.ProcessInput(Int32 inputID, PipelineBuffer buffer)

Following is the script component code:

 public override void Input0_ProcessInputRow(Input0Buffer Row)
    {
        /*
        * Code derives following fields which is used to populate error table
        * dErrorDetail -- actual error reported  by SSIS
        * dKey  -- Primary Key value of error record
        * dField -- Column Name which caused the error
        */

        if (Row.ErrorCode != 0)
        {
            Row.dErrorDetail = this.ComponentMetaData.GetErrorDescription(Row.ErrorCode);
        }
        Row.dKey = Row.PK1.ToString() + "|" + Row.PK2.ToString() + "|" + Row.PK3.ToString();

        var componentMetaData130 = this.ComponentMetaData as IDTSComponentMetaData130;
        if (componentMetaData130 != null)
        {
            /* Extract only the column name from the string returned ny SSIS
             *  Format of string returned is StepName.Outputs[Derived Column Output].Columns[ColumnName] */
            string CN = componentMetaData130.GetIdentificationStringByID(Row.ErrorColumn);
            string[] parts = CN.Split(new string[] { "Columns[" }, StringSplitOptions.None);
            Row.dField = parts[1].Replace("]", "");

        }
    }

}

↧
↧

SSIS Worker Can't Access Table

September 27, 2018, 12:58 pm
$
0
0

I'm running into an issue with executing SSIS packages in a Master/Worker scenario.

I've successfully configured the master/worker SSIS servers and everything is fine. The worker node appears in the Worker Manager gui and I can see the health status. All keys are good.

When I execute a particular package on the Master SSIS server, it executes just fine with no problem.

If I execute the same package but only using scale out, it fails due to the fact it can't locate a certain table. Both servers are in the same domain and the package is executing using the same environment, but for some reason, the worker server/process can't "see" the table that is indeed there.

Are there some kind of special settings that I'm missing?

I've actually given the service account that is running SSIS on the worker server READ permissions to all the user databases on the master server, so I wouldn't think there would be a problem there.

Any insight is appreciated!

A. M. Robinson

↧

To run a SSIS package outside of SQL Server Data Tools you must install ST_ Script Task of Integration Services or higher.

October 2, 2018, 2:05 am
$
0
0

HI,

I have the following software on my computer.

1. Visual Studio 2015

2. Visual Studio 2013

3. SQL server Data tools for Visual studio 2013

4. Microsoft SQL Server 2014

I have created SSIS Package with just one script task. When I run on SSDT its working fine. No Errors

I am trying to run this same SSIS Package from .Net Application I got the below error.

To run a SSIS package outside of SQL Server Data Tools you must install ST_ImportFolder_And_CheckIfFileExists of Integration Services or higher.

My Code is :

Dim pkgLocation As String
        Dim pkg As New Package
        Dim app As New Application
        Dim pkgResults As DTSExecResult
        '' Dim eventListener As New EventListener()
        pkgLocation =
      "C:\Packages\Sample.dtsx"
        pkg = app.LoadPackage(pkgLocation, Nothing)
        pkgResults = pkg.Execute()
      
        If pkgResults = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Failure Then
            Dim err As String = ""
            For Each local_DtsError As DtsError In pkg.Errors
                Dim [error] As String = local_DtsError.Description.ToString()
                err = err & [error]
            Next
        End If
        If pkgResults = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Success Then
            Dim message As String = "Package Executed Successfully...."
        End If

When I googled it there are lot of answers to these questions. ReInstall VS, Install Integration services etc.. But we already have VS, SSDT for VS 2013. Please clarify what is required exactly..

↧

How to edit an error component?

October 2, 2018, 1:37 am
$
0
0

Hi,

I am using visual studio to develop a ssis package, and I am new to it.

Currently, I know there is an error component, and I know exactly what the error is.

BUT, how can I edit the component to fix the error?

When I double click the component or right click and select Edit, it shows me below.



↧
↧

Tools in SSIS Toolbox Become Unusable with Crosshatch in Circle Icon

September 27, 2018, 1:01 pm
$
0
0

Quite often when I'm using SSIS in Visual Studio, the items in the SSIS Toolbox become unusable. They still appear, but when I click on them to try to drag them, a black circle with a forward slash making it look crossed out appears, and I can't drag the items. Usually it self-resolves in a few seconds to a couple of minutes, but sometimes I have to close and reopen Visual Studio to get the tools to work again. Any suggestions? I'm using Visual Studio Professional 2017 Version 15.5.4 on Windows 10.

Thanks for your help!

↧

Can relative path to configuration file be used?

June 12, 2012, 11:19 am
$
0
0

Can relative path to configuration file be used (it seems to me that absolute path is always saved in the package)?

This is why I would like that:

I store all SSIS packages in Subversion repository, their configuration files as well. Configuration file almost always stored in the same folder where package is.

When someone else checks out folder with the package in the location different from where I had on my development PC the configuration file is not detected (because absolute path is stored and it doesn't exist on the other developer PC). So another developer has to remove this configuration and add it again from where it is now on his local hard drive. Then changed package is saved which will cause new version to be committed. When I get that version from SVN it will no longer match local path on my PC.

How do you work around this inconvenience?

On a related note: another developer may want to change values in configuration file as well. If I later get the latest version of everything from SVN package will no longer work on my PC.


↧

Preserve Formatting in File Links in "Send Mail Task"

October 2, 2018, 6:14 am
$
0
0

I have an SSIS package that runs and sends an email which contains a link to a file saved on a file share. There are spaces in some of the file folders that can't be modified. How can I preserve a link like this so the link is still correct?

\\xxxxx\Public\Claims Management\OrderingFacility\OrderingFacilityReport_2018-10-02.csv

This link breaks between "Claims" and "Management". I have tried putting the entire link between <> but that is not saved. Once I click okay in the Mail section of the Send Mail Task, the <> disappears and the link still breaks. The users know for now they need to copy the entire link as opposed to clicking it. But, I know there has to be a way to get around spaces in file folder names in links.

Thanks in advance for any suggestions.

↧
Search

SSIS package component execution errors

October 2, 2018, 8:57 am
$
0
0

Background:
As part of a migration from server (A) to another(B) (and upgrading from SQL2000 to 2008), I've had to migrate some DTS packages into SSIS.
I've encountered a few problems with this.
Initially the DTS Runtime error requiring a feature pack (that's no longer available on MS website). I've resolved this enough to use the wizard to export the DTS packages into SSIS.
Legacy DTS packages will not run - "SQL Server 2000 DTS Designer componants" install is required, but as I'm moving to SSIS I won't worry about this.

At this time however several SSIS packages will not run manually or open correctly in the BIDS designer.
The errors displaying when attempting to run the task are broadly the same as in designer and as follows;

1. 'The component metadata for "componentname" could not be upgraded to the newer version of the component. The PerformUpgrade method failed'

2."component" could not be created and returned error code 0x80070005. Make sure that the component is registered correctly.

3. The component is missing, not registered, not upgradeable, or missing required interfaces.

4. Component "componentname" failed validation and returned error code 0xC0048021

5. One or more component failed validation

6. There were errors during task validation

If I try to execute the package in BIDS I receive the following;
Error HRESULT E_FAIL has been returned from a call to a COM component

I've been looking into this but it is my first exposure to DTS and SSIS so I'm finding a lot of information a bit confusing.
I've read the errors could be caused by running 32 bit packages in a 64 bit environment. This would seem likely as SQL 2000 would have been a 32 bit environment, however even if I set Run64BitRuntime to False I still receive the same errors, and there is a package that works successfully (migrated in the same way).
All packages are very small and only moving small files.

Could these errors be permissions related as the packages that show errors all take data from a location on a server(C) and export? What does open in the BIDS Designer shows the missing componants as all being the ones that collect/move data from another server.

Any advice on where to start with this?

↧
↧

SSIS Add 20 spaces appended to the end of line automatically

October 2, 2018, 1:42 pm
$
0
0

I have a job in SSIS that need go through each flat files and add 20 spaces appended to the end of line automatically (like a new column with 20 spaces) of each flat file. Each flat file may have different data structures, meaning different number of columns and different length of line for different flat files. 

I know how to go through each file but I don't know how to add 20 spaces appended to the end of line of each flat file. I think it may possible in C#, but I have very little knowledge about C#. If you have some sample code I would be very appreciated. Any other suggestion?

Thank you in advance.

↧

Invoke Child Package in Parallel, Child Package Control - Flow - Issue

October 2, 2018, 5:24 pm
$
0
0

HI All,

I have a master package invokes a set of child packages in parallel a sequence container as below.  The issue here is in child packages the control gives me a wrong completion status. In child package I have sequence containers to have checksum and stage the data.

Though the Checksum DFT - SEQ Container shows completion and started the Stage - Seq Container -DFT, but the checksum DFT still in progress.

I try to set the Precedence Sequence status as "Completion" instead of "Success'. No use. 

But if I run the packages individually it is working normal.

Regards

Madhavan.TR

Madhavan Thasu Ramachandran

↧

running ssis package using dtexec util

October 2, 2018, 7:41 pm
$
0
0

I have an SSIS package which downloads files from azure containers and process them. Package executes fine through visual studio 2017. however when I run package from command line using dtexec util I am getting error in the part of SSIS script task which instantiates cloudstorageaccount class

CloudStorageAccount ca = CloudStorageAccount.Parse(connectionstring);

Error that I receive is "Exception has been thrown by target of invocation".

I am guessing this has to do with version of Microsoft.windowsazure.storage dll reference. there are mutliple copies of dll found in various locations on c drive. I have tried referencing dll in visual studio 2017 folder (dll version is 3.2.0.0) and also one in SQLServer/140/../Binn folder. (dll version is 4.3.0.0)

Any help?


↧

Need to pick and move files in the inner most directory providing only the root folder

October 2, 2018, 10:18 pm
$
0
0

Hi Team, 

I have a requirement where i have a folder structure as shown below. 

folderA-> folderB->folderC->folderD->folderE->folderF-> file.txt

I need to provide only "folderA" in the parameter as the other folder names are subjected to change. Based on the change date of the "folderA" i need to trace all the way to file.txt and pick the files available in this area and move them to a different destination. 

Note: 

Only "folderA" path is fixed. Other nested folder structure is subjected to change. 

Please let me know if you have any implementation steps or code. 

Thanks,

Vikram 


↧
↧

SSIS OLE DB source component fails with DAX query after upgrading to SSAS 14 (2017)

October 3, 2018, 6:25 am
$
0
0

Hi, 

I have weird situation where SSIS  OLE DB Source component fails with DAX query while I want to connect to upgraded SSAS 2017 Instance. However when I connect to the SSAS 2016 (old) instance everything works fine. 

Error what I get while running SSIS package is following: "Error: The expression for variable "DAXquery" failed evaluation. There was an error in the expression."

While trying to parse query in package following "helpful" error appears: "OLE DB error: OLE DB or ODBC error: An unexpected exception occurred."

I created new project to eliminate possible corrupted project instability and figured out that it depends on the DAX query itself, if it gets parse error in SSAS 2017 connector or not (see query examples below).

However both queries work fine in DAX studio connecting SSAS 2017 and 2016 and in SSIS package if connecting to SSAS 2016. If I try to connect in SSIS package to SSAS 2017 , longer query gets parse error...

Any Ideas what might create different behavior in DAX syntax depending on SSAS version?

Simple query - no error___________________________________________________________
EVALUATE  SUMMARIZE('Dim Kuupäev', 'Dim Kuupäev'[KuuAasta])

Query with some filters - gets error in SSAS 2017___________________________________________________

     

DEFINE VAR __DS0FilterTable = 
  FILTER(
    KEEPFILTERS(VALUES('Dim Kuupäev'[Kuupäev])),
    AND(
      'Dim Kuupäev'[Kuupäev] >= DATE(2016, 9, 1),
      'Dim Kuupäev'[Kuupäev] < DATE(2018, 6, 21)
    )
  )
   VAR __DS0FilterTable2 = 
    FILTER(
      KEEPFILTERS(VALUES('Dim Kaubadimensioon'[Kaubadimensioon konfiguratsioon])),
      'Dim Kaubadimensioon'[Kaubadimensioon konfiguratsioon] = "-"
    )

  VAR __DS0FilterTable3 = 
    FILTER(
      KEEPFILTERS(VALUES('Dim Ladu'[Lao kood])),
      NOT(
        OR(
          OR(
            OR(
              OR('Dim Ladu'[Lao kood] = "11", 'Dim Ladu'[Lao kood] = "15"),
              'Dim Ladu'[Lao kood] = "94"
            ),
            'Dim Ladu'[Lao kood] = "95"
          ),
          'Dim Ladu'[Lao kood] = "99"
        )
      )
    )

  VAR __DS0FilterTable4 = 
    FILTER(
      KEEPFILTERS(VALUES('Dim Kaup'[Kauba konteerimisreegel])),
      OR(
        OR(
          OR(
            OR(
              OR(
                OR(
                  'Dim Kaup'[Kauba konteerimisreegel] = "CON",
                  'Dim Kaup'[Kauba konteerimisreegel] = "ELE"
                ),
                'Dim Kaup'[Kauba konteerimisreegel] = "GAR"
              ),
              'Dim Kaup'[Kauba konteerimisreegel] = "HOM"
            ),
            'Dim Kaup'[Kauba konteerimisreegel] = "INT"
          ),
          'Dim Kaup'[Kauba konteerimisreegel] = "MET"
        ),
        'Dim Kaup'[Kauba konteerimisreegel] = "SAN"
      )
    )

EVALUATE

    SUMMARIZECOLUMNS(

       'Dim Kuupäev'[Kuupäev], 'Dim Ladu'[Lao kood], 'Dim Kaup'[Kaubakood]
      ,
      __DS0FilterTable,
          __DS0FilterTable2,
          __DS0FilterTable3,
          __DS0FilterTable4,      

      "Füüsiline_laokogus", 'Fakt Laoseis'[Füüsiline laokogus]
    )

Regards, 

Fred

↧

SSIS 2016 : windows authentication dynamic connection string ?

October 3, 2018, 6:25 am
$
0
0

Hi,

It is possible with SQL Server Native Client 11.0 and windows authentication ( not sql account ), to change the authentication with another account than the one used by the proxy ?

as with this connectionstring ?

Data Source=XXXX;Initial Catalog=YYYYY;User ID=TOTO;Password=PS@mple!;Provider=SQLNCLI11.1;Integrated Security=false;Auto Translate=False;

how to do with another windows account ? another provider ?

Thanks for your help.

Best regards.


Stef

↧
Search

.Xlsx file - unable to process through SSIS VS 2015

January 30, 2017, 12:17 pm
$
0
0

I daily receive a .xlsx file from a client that I need to load into a DW environment.  In attempt to automate the process I chose SSIS to do the job though unsuccessfully. I get the error below in SSIS VS 2015 when I attempt to query (SELECT * FROM [Sheet1$a1:d5]) the file:

Exception fromHRESULT: 0xC020801C

Error at DepositDetail [Connection manager "Excel Connection Manager"]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.

An OLE DB record is available.  Source:"Microsoft Access Database Engine"  Hresult: 0x80004005  Description:"External table is not in the expected format.".

 

Error at Data Flow Task [Excel Source [44]]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

If I open and save the file and try to connect to it, it works with no problem.

I have already installed Microsoft Access database engine 2010 (and set Run64BitRuntime to False in VS) and was able to connect to a test Excel file I created.   

Any help is greatly appreciated!







↧

SSIS OData connection manager continues to give "forbidden" when testing Sharepoint connection

October 3, 2018, 3:01 pm
$
0
0

I have been through a ton of pages and none of the fixes seem to work for me. I did confirm I'm able to connect to the SharePoint Online lists in Power BI.

In SSIS, I am trying to create a new OData connection. For the service document location, I have: https://mycompany.sharepoint.com/mysite/_vti_bin/listdata.svc

I'm not sure what type of authentication I'm supposed to use or if I need to install some additional client. I'm using VS PRO 2017.

When I use Windows Authentication, I get a forbidden error. When I use Microsoft Online Services authentication and type in my email/password, I get a "Could not load file or assembly "Microsoft.SharePoint.Client.Runtime, Version=15.0.0.0.... or one of it's dependencies. The system cannot find the file specified." I just installed the SharePoint online Client Components SDK (https://www.microsoft.com/en-us/download/details.aspx?id=42038), but that didn't seem to make a difference. It seems like that's version 16 though. I can't find 15

↧
↧

SSIS Communication Link Provider exception

September 26, 2018, 10:58 pm
$
0
0

I am getting following error while running the package which extracts data from a table which has 150 Million records.

The other tables which has got similar count are running fine. Its only with this table i am getting the error. Can you please help me to figure out the reason ,

SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "Communication link failure".
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "TCP Provider: An existing connection was forcibly closed by the remote host.

↧

How to transfer data from all table in database to azure data lake destination?

September 27, 2018, 10:09 pm
$
0
0

Suppose I have two tables tbl1 and tbl2, then I want to create a package which will read the data from tbl1 and tbl2 and transfer the data to Azure data lake as two files tbl1.txt and tbl2.txt.

What I have done is created Execute SQL task with query select name from sys.tables which will return table names and loop through that result and store into store variable. But Oledb Source doesn't accept query like "select * from @[user::tablName] (a variable which has a table name)".

Please suggest me a solution. Thanks 

↧

Export data from SQL Server to Azure data lake store.

October 4, 2018, 5:47 am
$
0
0

Hi, I want to export all table data from a database to Azure data lake store. I have created an SSIS package that will use BCP utility. But with BCP, I can export the file on local. I want to export directly to Azure data lake store. Is it possible with BCP utility?

Or any other way.thanks in advance.

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>