Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS Connection Manager not saving changes

$
0
0

Hello!

I have an SSIS issue with a package level connection manager.

I'm using Visual Studio Professional 2012.

The connection manager is a Dynamics CRM Lookup Connection Manager with provider Native OLE DB\SQL Server Native Client 11.0

For this connection manager I am using SQL Server Authentication and am connecting to a database. Lets call this database DB1.

I need to update DB1 to DB2.

I do this, then test the connection. The test result returns successful following this I click 'OK' which then supposedly saves the connection manager updates and applies them to the SSIS package.

However the package is NOT updated and when I re-open the connection manager the old DB1 information is shown.

Does anyone have any idea why this behaviour is occurring as I urgently need to update this connection manager without removing and re-creating it.

Many thanks

Jon K


SSIS connection manager dont store passwords

$
0
0

I am having a strange problem in that when ever I create a connection to an OLE db source and use SQL Server authorization and save the password, the connection manager seems to "forget" the password. That is, when I click the 'save password' check box, and do a test connection, it connects fine. But as soon as I close that connection window, and reopen it, the password box is empty, and the 'save password' box is still checked. Even if I do a test connection at this point, it wont connect because it does not have the password.

Now my main problem is coming when i schedule my packages, because it cant execute the package as it dont store the password for the OLEDB database.

kindly help to complete this task.

Regards

Sudipta Ghosh

Atos Origin India

Error Code: -1073659888 (also known as DTS_E_LOGPROVIDERFAILED)

$
0
0

Hi,

I have a package where I added a "SSIS log provider for SQL Server". The package runs successfully but rarely times I receive and error like the following:

"The SSIS logging provider "SSIS log provider for SQL Server1" failed with error code 0xC0202009 ((null)).  This indicates a logging error attributable to the specified log provider."

This have happened only 2 times and the package runs well now but I couldn't find more information about the cause of this. Does anybody know how this error can happen? Any feedback is very appreciated.

Thanks in advance!

FTP process controlled externally by control table but package needs to know if the file is ready for processing

$
0
0

I have a ftp process setup externally which downloads the file .

The ftp is controlled externally by updating a control table.

So all I do in my package is execute the sql to update the control table to trigger the ftp process to download the file in a file server location.

Now I want to know how can I ensure if the file has been downloaded completely to process the data in the file .

The input file in the ftp location is an .xls. Note this file will be deleted at the end of processing so  no backup is required.

Looking forward for best solution to handle the file.




Latest version of SSDT BI 2015 cannot load SSIS 2014/2012 projects

$
0
0

Hi we just installed latest version of SSDT BI 2015 which has support for loading older version of SSIS Projects (i.e SSIS 2014, 2012) but looks like that feature is not working for us.

We tried to load SSIS 2014 project but custom components failing with below error.

On the side note SSIS 2016 Projects working fine just like before... But lower version project is not (SSIS 2012 or SSIS 2014).

Microsoft Native SSIS components working fine... Its only Zappysys Components not working for some reason.

If someone from SSIS Team wants to take a look ... Please contact Zappysys Support ( support (at) zappysys dot com) and we will be happy to show you how to reproduce.

TITLE: Microsoft Visual Studio
------------------------------

The component could not be added to the Data Flow task.
Could not initialize the component. There is a potential problem in the ProvideComponentProperties method.

------------------------------
ADDITIONAL INFORMATION:

Error at Data Flow Task [ZS HTML Table Source [9]]: System.InvalidCastException: Unable to cast COM object of type 'System.__ComObject' to interface type 'Microsoft.SqlServer.Dts.Pipeline.Wrapper.IDTSComponentMetaData100'. This operation failed because the QueryInterface call on the COM component for the interface with IID '{BE8C48A3-155B-4810-BA5C-BDF68A659E9E}' failed due to the following error: No such interface supported (Exception from HRESULT: 0x80004002 (E_NOINTERFACE)).
   at System.StubHelpers.StubHelpers.GetCOMIPFromRCW(Object objSrc, IntPtr pCPCMD, IntPtr& ppTarget, Boolean& pfNeedsRelease)
   at Microsoft.SqlServer.Dts.Pipeline.Wrapper.IDTSComponentMetaData100.get_OutputCollection()
   at ZappySys.PowerPack.Common.PipelineComponentBase.CreateDefaultOutputs(Boolean useExternalmetaData)
   at ZappySys.PowerPack.Common.PipelineComponentBase.CreateOutputs()
   at ZappySys.PowerPack.Common.PipelineComponentBase.ProvideComponentProperties(String pName, String pDesc, String pContactInfo, Action createInputs, Action createOutputs, Action createCustomProperties, Action createRuntimeConnections)
   at ZappySys.PowerPack.Adapter.HtmlTableSource.HtmlTableSource.ProvideComponentProperties()
   at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostProvideComponentProperties(IDTSManagedComponentWrapper100 wrapper)


------------------------------

Unable to cast COM object of type 'System.__ComObject' to interface type 'Microsoft.SqlServer.Dts.Pipeline.Wrapper.IDTSComponentMetaData100'. This operation failed because the QueryInterface call on the COM component for the interface with IID '{BE8C48A3-155B-4810-BA5C-BDF68A659E9E}' failed due to the following error: No such interface supported (Exception from HRESULT: 0x80004002 (E_NOINTERFACE)). (Microsoft.SqlServer.DTSPipelineWrap)

------------------------------
BUTTONS:

OK
------------------------------




Custom logging in Active task SSIS

$
0
0

I am facing two issues in my SSIS package. The SSIS package I have has an active task that formats an excel sheet as per my requirement and saves it as a different file, modified.xlsx. This file is then used in my data flow task to process and upload data to database tables. This package works perfectly in my local system, but when I created a scheduled job on my SQL server to run this package it fails with the generic error message "Microsoft (R) SQL Server Execute Package Utility  Version 11.0.5058.0 for 32-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  6:00:20 AM  Error: 2016-04-07 06:00:23.39     Code: 0x00000001     Source: Script Task      Description: Exception has been thrown by the target of an invocation.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  6:00:20 AM  Finished: 6:00:23 AM  Elapsed:  3.156 seconds.  The package execution failed. The step failed.."
I have set the steps to use 32 bit runtime.

To get a more detailed error message i tried to set up logging for the active task. I configured logging to write log entries for events to a CSV file as in the below screen shot. enter image description here

I enabled logging for package and checked individuals tasks as well. In active tasks, I added Dts.Log("",0,bytes); to keep track of any exception if any also to log each steps.

public void Main()
        {
            LogMessages("");

            LogMessages("Update Bug package execution started at :: " + DateTime.Now.ToLongTimeString());
            LogMessages("Loading package configuration values to local variables.");

            FileName = Convert.ToString(Dts.Variables["User::ExcelFileName"].Value);
            SourceFileLocation = Convert.ToString(Dts.Variables["User::SourceFileLoc"].Value);

            SourceFileName = Path.Combine(SourceFileLocation, FileName);
            saveLoc = Path.Combine(SourceFileLocation, "ModifiedExcel.xlsx");


            var excel = new Excel.Application();
            var workbook = excel.Workbooks.Open(SourceFileName);
            try
            {

                foreach (Excel.Worksheet tempSheet in workbook.Worksheets)
                {
                    LogMessages("For loop to check sheet names");
                    if (((Excel.Worksheet)(tempSheet)).Name.Contains("Test"))
                    {
                        if (File.Exists(saveLoc))
                        {
                            File.Delete(saveLoc);
                        }

                        //File.Create(saveLoc);
                        tempSheet.Select();
                        workbook.SaveAs(saveLoc);
                    }

                    System.Runtime.InteropServices.Marshal.ReleaseComObject(tempSheet);
                }

                workbook.Save();
                workbook.Close();
                excel.Quit();
                LogMessages("Quit Excel sheet");

                System.Runtime.InteropServices.Marshal.ReleaseComObject(workbook);
                System.Runtime.InteropServices.Marshal.ReleaseComObject(excel);
                LogMessages("Release excel objects");
            }
            catch(Exception ex)
            {
                LogMessages("Exception: " + ex.InnerException);
                System.Runtime.InteropServices.Marshal.ReleaseComObject(workbook);
                System.Runtime.InteropServices.Marshal.ReleaseComObject(excel);
            }


            Dts.TaskResult = (int)ScriptResults.Success;
        }

        #region ScriptResults declaration
        /// <summary>
        /// This enum provides a convenient shorthand within the scope of this class for setting the
        /// result of the script.
        ///
        /// This code was generated automatically.
        /// </summary>
        enum ScriptResults
        {
            Success = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Success,
            Failure = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Failure
        };
        #endregion

        #region Log messages to package log files/table.
        public void LogMessages(string strLogMsg)
        {
            Dts.Log(strLogMsg, 0, bytes);
        }
        #endregion

But when i run the package the log file is not updated. The log file just contains the following :

Fields: event,computer,operator,source,sourceid,executionid,starttime,endtime,datacode,databytes,message

Can someone please help me understand what I am missing here for logging? Also, what could be the issue for the job to fail in SQL server?


How to deploy to SSIS 2012 from Visual Studio 2015

$
0
0

I have the latest SSDT BI for VS 2015, which clearly states "This release supports SQL Server 2016 through SQL Server 2005, and provides the design environment for adding features that are new in SQL Server 2016."

Is there anything specific I need to do to actually deploy from Visual Studio 2015 + SSDT BI into my SQL Server 2012?

When I try to deploy a package from Visual Studio, I get error:

Could not find stored procedure 'SSISDB.catalog.deploy_packages'. (Microsoft SQL Server, Error: 2812)

When I try from SSMS 2012 to "Import Packages..." my package fails with this message:

The package failed to load due to error 0xC0010014 "One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.". This occurs when CPackage::LoadFromXML fails.

In the xml report, the error message details say "<Message>Could not find stored procedure 'SSISDB.catalog.deploy_packages'.</Message>"

When I look at my DB Schema, indeed there is no such stored procedure.

So: How can I get my package deployed?

UPDATE: I tried deploying the project. This worked to get the project into MSSQL via Visual Studio 2015 "Deploy" menu item, however the project fails validation with error message: 

Error: Package migration from version 8 to version 6 failed with error 0xC001700A "The version number in the package is not valid. The version number cannot be greater than current version number.".

By the way, all these errors are coming from following the steps in SSIS Tutorial "Lesson 6: Using Parameters with the Project Deployment Model".

Thanks in advance!


When will SSDT-BI for VS2013 support SSIS 2012?

$
0
0

Hi

When will SSDT-BI for VS2013 support SSIS 2012?

Of a bit more elaborate: If you would like to develop packages for SSIS 2012 (that is SQL 2012) using VS 2013, when can you then expect an update to SSDT-BI for VS2013 that allow this?

Thanks

Michael


SCD keeps entering record for employee no longer active

$
0
0

Hi guys,

I am reporting off EPM and have a SCD resource dimension. The slow change is to track when an employee was active in a certain team. adding a new record when they change teams and updateing the TeamEndDate of the old record to the date they moved.

TeamEndDate of the new record is NULL

The problem is, when a resource leaves. their current record updates but then a new open ended record is inserted with the most resent team info.

how do control this?

i have a ResourceIsActive field  coming from EPM.

I am     using SSIS SCD task/wizard

cheers

Ian


Text Column Modified to NVARCHAR(100) in the DIMENSION table in Sql Server 2008 and SSIS 2008

$
0
0

previously the TXT_ columns were VARCHAR datatype now there are records which need to have NVARCHAR data to store UTF-16 .

Update the Table definition will do , but there around 100 SSIS packages which need to be refresh with the new datatype DT_WSTR ,what is the best and easiest way to do it .

Any good resource on all the Provider available with OLE DB Connection

$
0
0

Hi All,

Recently i was doing some work with OLE DB Connection. And there were so many provider available there. I though of knowing about all of them, but very little or no information is available on internet( Or may be i am not good with search engine). 

Like for e.g. we have Microsoft Jet 4.0 and Microsoft Access 12.0 ... provider. But, both are used while reading the information from excel sheets, so what is difference between them. I have just mention above as example.

How to write Case statement in Derived Column

$
0
0

Hello,

As i am new to BDIS, i am learning new things and i got stuck in one query where, I am trying to calculate Total Salary of employees , which includes Salary of Employees plus Commission in percentage. I would like to check in case statement for employees where commission is Null then i need Salary to be updated in TotalSalary Column and where Commission is present then (Salary*Commission)+Salary  values needs to be updated in TotalSalary Column.

Regards,

Mehul

SSIS - Why can't an Execute Process Task run VBS in [Win 2008 + SQL 2012] though it can in [Win 2003 + SQL 2008]?

$
0
0

Hi Experts,

I'm trying to migrate an legacy ETL system from [Win 2003 R2 x64 SP2 + SQL Server 2008 (10.0.4000)] to [Win 2008 R2 Datacenter SP1 + SQL Server 2012 (11.0.5058)].

Most of the SSIS packages works fine in the new env but an Execute Process Task failed with the error "The specified executable is not a valid application for this OS platform".

I've found that wrapping .vbs with .bat and executing .bat from SSIS works, but I would like to know what causes this difference between the two environment and if possible, avoid the modification of SSIS packages as there are so many.

I would greatly appreciate your help!

N

SSIS Integration with SalesForce

$
0
0

Good Morning All,

I want to load data from and to Salesforce. I looked online for plugin's and there are 3rd party. Does MS provide any kind of plug in for salesforce ? Please need advice. I have 2008,2010 and 2012 visual studio versions (BIDS). Please advice

Thanks


SV

Import a .xls file to load into SQL database Via SSIS package.

$
0
0

Microsoft Visual Studio 2008 (version 9)

I created a SSIS package were I import a .xls file to load into SQL database. 

So I created a connection with the following properties:

(connectionString : Provider=Microsoft.Jet.OLEDB.4.0;Data Source=\\fld6Filer\BRDProduction_SurveyFiles$\Incoming\TestingSurveyFiles\MyleneTestingFiles\CriticalList\CriticalList.xls;Extended Properties="EXCEL 8.0;HDR=YES";)

So far so good, everything is working as planned!

However, I want to make that connection dynamic by reading the value from a sql table and assigning to to the ConnectionString.   So I added the following lines of code in a script task:

String InputFileName = Dts.Variables["FileName"].Value.ToString();

Dts.Connections["CriticalListExcelFile"].ConnectionString ="Provider=Microsoft.Jet.OLEDB.4.0;Data Source="+ InputFileName +";Extended Properties=\""+"EXCEL 08.0;HDR=YES"+ "\""+ ";";

The value is being passed without any problem.  But when I get to the part in the data flow where I actually import the file…

I get the following errors:

[Source - Excel File [1]] Error: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "CriticalListExcelFile" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

[SSIS.Pipeline] Error: component "Source - Excel File" (1) failed validation and returned error code 0xC020801C.

[SSIS.Pipeline] Error: One or more component failed validation.

Error: There were errors during task validation.

Please note that I do have the DelayValidation set to True.

Can somebody help me with that?  I did found some tips on the web like changing theRun64BitRuntime to False under the debug options…  but I can’t find where to go!!  Help!!! 


Mylene Chalut


Can SCD Transformation be used for Fact Table Load

$
0
0

Hi Experts,

Sorry for my silly questions about the basic. I am very new to MS-Bi world and I have been given a task to build a package for Dimension and Fact Table load for a particular DW. 

I understand so fat I need to SCD (Slowly Changing Dimension ) for Dimension data load however can the same SCD trasformation be used for Fact table load? If not what is the way to load the fact tables.

ssis truncation error

$
0
0

Hello,

I am trying to import data from csv to a sql server table (2008 R2 SE edition of sqlserver) with an ssis package. The data I am trying to import is from a website form that gets saved to a csv file. Here is the table DDL:

CREATE TABLE [dbo].[FormData](
	[ID] [int] IDENTITY(1,1) NOT NULL,
	[CreatedAt] [datetime] NULL,
	[FirstName] [nvarchar](60) NULL,
	[LastName] [nvarchar](60) NULL,
	[Title] [nvarchar](60) NULL,
	[BusinessName] [nvarchar](60) NULL,
	[TypeOfBusiness] [nvarchar](60) NULL,
	[EmailAddress] [nvarchar](60) NULL,
	[PhoneNumber] [nvarchar](24) NULL,
	[PhoneExtension] [nvarchar](20) NULL,
	[TypeOfInquiry] [nvarchar](60) NULL,
	[YourInterests] [nvarchar](4000) NULL,
 CONSTRAINT [PK_FormData] PRIMARY KEY CLUSTERED
(
	[ID] ASC
)WITH (PAD_INDEX  = OFF, STATISTICS_NORECOMPUTE  = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS  = ON, ALLOW_PAGE_LOCKS  = ON) ON [PRIMARY]
) ON [PRIMARY] TEXTIMAGE_ON [PRIMARY]

GO

ALTER TABLE [dbo].[FormData] ADD  CONSTRAINT [DF_CreateDate_GetdateValue]  DEFAULT (getdate()) FOR [CreatedAt]
GO
 

My ssis package does the inserts from csv to table without errors if all fields have values in the csv file. However if someone doesnt have a phoneextension and fill out the form and submit without entering data for this field then my ssis package fails with the following error:

[Flat File Source [1]] Error: Data conversion failed. The data conversion for column ""Phone Extension"" returned status value 4 and status text "Text was truncated or one or more characters had no match in the target code page.".


[Flat File Source [1]] Error: The "output column ""Phone Extension"" (118)" failed because truncation occurred, and the truncation row disposition on "output column ""Phone Extension"" (118)" specifies failure on truncation. A truncation error occurred on the specified object of the specified component.

I am providing with sample data below for which the insert failed:

Createdat,First,Last,"Company Name","Type of Organization","Enter Email",Phone,"What's Your Interest?",Title,"Phone Extension"
"2016-04-12 00:51:39",Ben,Charles,"Thai Massage",Business,newoilmassage@yahoo.com,"(123) 222-4444","Want to send out general messages to massage lovers daily",,,,,

I am converting data according the column sizes in the table and they are all DT_WSTR except for date as the date uses a default constraint

Mapping is as shown:

First-->FirstName, Lasr-->LastName, companyname-->businessName,Typeoforganization-->Typeofbusiness,enteremail-->emailaddress,Phone-->phonenumber,What's Your Interest?-->yourinterests,Title-->title,"Phone Extension"-->phoneextension

A csv file with successfull insert looks like this:

Createdat,First,Last,"Company Name","Type of Organization","Enter Email",Phone,"Phone Extension","What's Your Interest?",Title
"2016-04-11 18:21:59",Adams,Chris,testdata,Business,test@test.com,"(123) 456-7890",1111,"this is just for test",,,,

How can I fix this error and let inserts run normally?

Thanks a ton


Is it possible to trigger an Email when a Project execution takes greater than a defined threshold?

$
0
0

Please kindly respond -

I have a client question that I need to research and respond.  We have a project that runs nightly to feed a downstream CRM Dynamics (SaaS) application.  The nightly job consumes data from the source database, performs a series of ETLs and creates output files for loading into the CRM Dynamics (SaaS) platform.  The issue is that the client occasionally has made major updates to the source data which subsequently affects the volume of update transactions being submitted through to the ETLs and on to the CRM platform; the performance of the ETL and CRM Dynamics are thus affected negatively by the volumes.
We have a daily email trigger within the SSIS Event handlers that initiates off of the Start of the ETL process and one at the Completion of the ETL process; likewise we have a daily email triggers that initiate based on the start of the daily CRM Dynamics upload and the Completion of the CRM Dynamics upload.  When all goes as planned this works well...

But when the client occasionally initiates major volumes and the SSIS projects run for greater time periods, the question is can we somehow trigger an email based on the Execution time of the project?  Say that the job runs for xx,xxx seconds or runs past 08:00 AM ET (or a set threshold).  If this condition is met, then trigger a warning email that could contain a similar message as " 'WARNING' SSIS Project exceeding expected execution time."


joemac

(SSIS) Data Flow Task – export SQL to excel file. Problem with the relational table

$
0
0
I'm looking for a solution / tutorial following case. In the MS SQL database I have two tables: Invoice and related table InvoiceItem. I need to export data to excel.

My problem is the structure of the export excel file. ( 1, 2, 3 … line number in the file excel)

  1. First record from table “invoice” (A1, B1, C1, D1), First related records from table “InvoiceItem” (E1, F1, G1)

  2. Empty cels (A2, B2, C2, D2), Second related records from table “invoice item” (E2, F2 , G2)

  3. Empty cels (A3, B3, C3, D3), Third related records from table “invoice item” (E3, F 3, G3)

  4. empty row

  5. Second record from table “invoice” (A5, B5, C5, D5), First related records from table “InvoiceItem” (E5, F5 , G5)

  6. Empty cels (A6, B6, C6, D6), Second related records from table “invoice item” (E6, F6, G6)

  7. Empty cels (A6, B6, C6, D6), Third related records from table “invoice item” (E6, F6, G6)

  8. Empty cels (A6, B6, C6, D6), Fourth related records from table “invoice item” (E6, F6, G6)

  9. empty row

  10. … … ...

  11. empty row

  12. Last record from table “invoice” (Ax, Bx, Cx, Dx), First related records from table “InvoiceItem” (Ex, Fx , Gx)

  13. Empty cels (Axx, Bxx, Cxx, Dxx), Second related records from table “invoice item” (Exx, Fxx , Gxx)

  14. empty row

I want to create an SSISFlow Task to export SQL tables to excel.Does anyone know of a good example ?


How to fix invalid character in the given encoding

$
0
0

I get the below error on the SSIS XML Source. Can anyone help me to resolve the issue please.

[Customer Master [2]] Error: The Customer Master was unable to process the XML data. Invalid character in the given encoding. Line 55979, position 10.

Is there anyway to resolve this issue with out deleting the character. Note the data is mostly English but may contain the odd non English character as the data is from a company with locations world wide.

Thanks for your help.

Dean

 

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>