Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS and Visual Studio Versions

$
0
0

Hi all

we are looking for renew our development environment for SSIS.

Actually we have SQL Server 2008 Enterprise R2 SP1, Visual Sutdio 2008 without any source code versioning software.

I was thinking to update it to Visual Studio 2012 with TFS 2012.

What is not clear for me is if SSIS packages developed under Visual Studio 2012 (SQL Server Data Tools - Business Intelligence for Visual Studio 2012) can be run under SQL Server 2008 R2 SP1.

Also I would like to know if SSIS packages can be versined with TFS like a cs file.

best regards

-g


Gian Paolo Santopaolo - softwarelab.it -thedarksideof.net
Disclaimer: This post is provided "AS IS" with no warranties, and confer no rights.


Calling SOAP request in webservice from Script task in SSIS

$
0
0

Hi all,

I hope someone can help me with my challenge..

I'm new to SSIS and have some troubles with webservices, which I can't seem to solve yet.

I'm using Visual Studio 2010 Shell.

I have an (external) webservice which should give me back a XML file with results (and or a PDF file).

I have the correct url with a WSDL.

I tried to use to Webservice task in SSIS, but I got the error "The selected web method contains unsupported arguments". After some searching I found an alternative in using a Script task.

Unfortunaly I can't get it to work.
I get the following error:

"Exception has been thrown by the target of an invocation

   at System.RuntimeMethodHandle._InvokeMethodFast(IRuntimeMethodInfo method, Object target, Object[] arguments, SignatureStruct& sig, MethodAttributes methodAttributes, RuntimeType typeOwner)
   at System.RuntimeMethodHandle.InvokeMethodFast(IRuntimeMethodInfo method, Object target, Object[] arguments, Signature sig, MethodAttributes methodAttributes, RuntimeType typeOwner)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture, Boolean skipVisibilityChecks)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at System.RuntimeType.InvokeMember(String name, BindingFlags bindingFlags, Binder binder, Object target, Object[] providedArgs, ParameterModifier[] modifiers, CultureInfo culture, String[] namedParams)
   at Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTATaskScriptingEngine.ExecuteScript()"

My Visual Basic script 2010 looks like this:

"

#Region "Help:  Introduction to the script task"
'The Script Task allows you to perform virtually any operation that can be accomplished in
'a .Net application within the context of an Integration Services control flow. 

'Expand the other regions which have "Help" prefixes for examples of specific ways to use
'Integration Services features within this script task.
#End Region


#Region "Imports"
Imports System
Imports System.Data
Imports System.Math
Imports Microsoft.SqlServer.Dts.Runtime

Imports System.Net
Imports System.IO
Imports System.Text
Imports System.ComponentModel
Imports System.Diagnostics
Imports System.Web
Imports System.Web.Services
Imports System.Web.Services.Protocols
Imports System.Xml.Serialization
Imports System.Xml


#End Region

'ScriptMain is the entry point class of the script.  Do not change the name, attributes,
'or parent of this class.
<Microsoft.SqlServer.Dts.Tasks.ScriptTask.SSISScriptTaskEntryPointAttribute()> _<System.CLSCompliantAttribute(False)> _
Partial Public Class ScriptMain
    Inherits Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTARTScriptObjectModelBase


#Region "Help:  Using Integration Services variables and parameters in a script"
    'To use a variable in this script, first ensure that the variable has been added to 
    'either the list contained in the ReadOnlyVariables property or the list contained in 
    'the ReadWriteVariables property of this script task, according to whether or not your
    'code needs to write to the variable.  To add the variable, save this script, close this instance of
    'Visual Studio, and update the ReadOnlyVariables and 
    'ReadWriteVariables properties in the Script Transformation Editor window.
    'To use a parameter in this script, follow the same steps. Parameters are always read-only.

    'Example of reading from a variable:
    ' startTime = Dts.Variables("System::StartTime").Value

    'Example of writing to a variable:
    ' Dts.Variables("User::myStringVariable").Value = "new value"

    'Example of reading from a package parameter:
    ' batchId = Dts.Variables("$Package::batchId").Value

    'Example of reading from a project parameter:
    ' batchId = Dts.Variables("$Project::batchId").Value

    'Example of reading from a sensitive project parameter:
    ' batchId = Dts.Variables("$Project::batchId").GetSensitiveValue()
#End Region

#Region "Help:  Firing Integration Services events from a script"
    'This script task can fire events for logging purposes.

    'Example of firing an error event:
    ' Dts.Events.FireError(18, "Process Values", "Bad value", "", 0)

    'Example of firing an information event:
    ' Dts.Events.FireInformation(3, "Process Values", "Processing has started", "", 0, fireAgain)

    'Example of firing a warning event:
    ' Dts.Events.FireWarning(14, "Process Values", "No values received for input", "", 0)
#End Region

#Region "Help:  Using Integration Services connection managers in a script"
    'Some types of connection managers can be used in this script task.  See the topic 
    '"Working with Connection Managers Programatically" for details.

    'Example of using an ADO.Net connection manager:
    ' Dim rawConnection As Object = Dts.Connections("Sales DB").AcquireConnection(Dts.Transaction)
    ' Dim myADONETConnection As SqlConnection = CType(rawConnection, SqlConnection)
    ' <Use the connection in some code here, then release the connection>
    ' Dts.Connections("Sales DB").ReleaseConnection(rawConnection)

    'Example of using a File connection manager
    ' Dim rawConnection As Object = Dts.Connections("Prices.zip").AcquireConnection(Dts.Transaction)
    ' Dim filePath As String = CType(rawConnection, String)
    ' <Use the connection in some code here, then release the connection>
    ' Dts.Connections("Prices.zip").ReleaseConnection(rawConnection)
#End Region

    'This method is called when this script task executes in the control flow.
    'Before returning from this method, set the value of Dts.TaskResult to indicate success or failure.
    'To open Help, press F1.

    Public Sub Main()

        Dim Request As String = ""
        Dim gebruiker As String = "xx"
        Dim wachtwoord As String = "xx"
        Dim plaats As String = "xx"
        Dim bedrijf As String = "xx"
        Dim rechtsvorm As String = "xx"
        Dim sYear As String = "2012"
        Dim KVKnummer As String = ""
        Dim sbi As String = "xx"
        Dim sString As String = "xx"
        Dim Format As String = "FinanXML"
        Dim benchmarkID As String = "470"
        Dim scale As String = "1"
        Dim delivery As String = "false"

        Request = Request & "<?xml version='1.0' encoding='utf-8'?>"
        Request = Request & "<soapenv:Envelope xmlns:soapenv='http://schemas.xmlsoap.org/soap/envelope/' xmlns:ben='http://benchmark.webservice.finconnect.finan.nl/'>"
        Request = Request & "<soapenv:Header/>"
        Request = Request & "<soapenv:Body>"
        Request = Request & "<ben:findActiveBenchmarks>"
        Request = Request & "<year>" & sYear & "</year>"
        Request = Request & "<sbi>" & sbi & "</sbi>"
        Request = Request & "</ben:findActiveBenchmarks>"
        Request = Request & "</soapenv:Body>"
        Request = Request & "</soapenv:Envelope>"


        'Create xmlhttp object 
        Dim xmlhttp As Object = CreateObject("Microsoft.XMLHTTP")
        Call xmlhttp.open("POST", "https://benchmarkplatform.sra.nl/finconnect/benchmark", False)
        Call xmlhttp.setRequestHeader("Content-Type", "text/xml")
        Call xmlhttp.setRequestHeader("SOAPAction", "")
        Call xmlhttp.send(Request)


        Call MsgBox(xmlhttp.responsetext)

        Dim resultaat As String
        resultaat = xmlhttp.responseText
        resultaat = Replace(resultaat, "&gt;", ">")
        resultaat = Replace(resultaat, "&lt;", "<")
        resultaat = Replace(resultaat, "&quot;", """")

        Call MsgBox(resultaat)

        Dts.TaskResult = ScriptResults.Success

    End Sub

#Region "ScriptResults declaration"
    'This enum provides a convenient shorthand within the scope of this class for setting the
    'result of the script.

    'This code was generated automatically.
    Enum ScriptResults
        Success = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Success
        Failure = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Failure
    End Enum

#End Region

End Class

Can some one help me? What am I doing wrong?

FYI: I already added a Service reference tot de WSDL in the script project.




SSIS configuration Not Working With SQL agent Job

$
0
0

Hi,

I have created an SSIS configuration table in SQL Server where in I store all connection strings. This configuration is enabled within my package. To make even the DB where I store connection strings, I have an environment varibale. I thus have 2 configurations in the following order:

1. env variable: Points to the DB where in my connection strings would be stored.

2. SQl Server configuration:where I actually, store the connection strings.

However , when I try to execute the package, it seems the SQL Server agent does not read from the Configuration tables at all.

Can someone let me know how to enable this from within SQL Server agent? I do not store connection strings in a file, so I can't add any files within the configuration tab.

Please let me know as to how do I enable configurations stored within SQL tables from SQL Server Agent jobs. I am using SQL Server 2008.

Modify SSIS Package

$
0
0
I have a SSIS package on a 2005 server that I'd like to modify. Unfortunately, BIDS/Visual Studio 2005 isn't installed on that machine so I can't RDP to it and open it there to modify directly. I do have BIDS/Visual Studio 2005 installed on my laptop. What/How would you recommend to have this package modified? Should I export it from the server modify it on my laptop and then import it back to the server. Alternatively, I read a little something doing this remotely, but given the SSIS newbie that I am, didn't quite understand the significance of the protection level that's mentioned in this discussion (http://social.technet.microsoft.com/Forums/sqlserver/en-US/2989f8c8-b1c5-470a-9902-eceb04ea8f78/modify-ssis-package?forum=sqlintegrationservices). Any help / suggestion based on real-world experiences would be much appreciated. Thanks.

SSIS 2008 R2 Error Handling

$
0
0

Greetings!

I have a Parent Package that calls several child packages that must be executed in sequence:

Parent Package A calls Child1, Child2, Child3.  Each Child package has a precedence constraint of on success.

My goal is to have the parent package stop executing if any one of the child packages fail, as well as send me an email with the error message.  I know that the Event Handler OnError will handle the send mail task, however because we are "Handling" the error,  the parent package will continue to execute. 

Is there a way to send the email and fail the package in the event handler, or is it better to just create the send mail tasks for each child package using the ON FAILURE precedence constraint?

Package giving error when executed through bat file

$
0
0

The packages successfully execute in SQL Server Data Tools but when I use DTEXEC to execute it gives me the following error:

"To run a SSIS package outside of SQL Server Data Tools you must install Send Mail Task of Integration Services or higher .

I tried 5 different packages and all of them showed similar error except the send mail task is replaced by different other tasks of those packages.

SSIS package do not use Configuration file when Executing

$
0
0

I have SQL Server 2012 SSIS package on package deployment model.

SSIS package is working correctly on development environment, but I cannot make it running on test environment.

1) I have clicked SSIS->Package configurations->Enable package configuration
2) SSIS->Package configurations->Add->Create XML configuration file
3) Build
4) /deployment folder shows correctly files
5) Manifest, packages and config files are moved to test environment
6) I clicked manifest and deployed to file system
7) I got package files and configuration files
8) I have tried to execute package from SQL Server Job and tried also run from BAT.

I have tried with this BAT: dtexec /F "C:\TEST\SSIS.dtsx" /Conf "C:\TEST\SSIS_Config.dtsConfig" > Import_SSIS_LOG

I got errors, because SSIS package is using OLE DB Connection ServerName from the package.
It should use config file. Config file is correctly formed including servername of test environment, but package is not using it.

I have to say that I have seen this before, but still don't understand.

WHY PACKAGE IS NOT USING CONFIGURATION FILE?

Should I do something different in Visual Studio or where?

Please let me know if you need more info.


Kenny_I

General access denied error while using import data in SSMS

$
0
0

I am using SQL Server Management Studio with the following version information below:

Microsoft SQL Server Management Studio 10.50.4000.0 Microsoft Data Access Components (MDAC)3.85.1132 Microsoft MSXML 2.63.04.05.06.0 Microsoft Internet Explorer 6.0.2900.5512 Microsoft .NET Framework 2.0.50727.3053 Operating System 5.1.2600

When i try to use Task->Import Data.. (even before selecting data source) i get error like shown below

The SQL server engine is 2008 R2 and the user is sysadmin. Also this error is occuring on all instances of SQL (both local and network) instances.

What i tried so far

I tried giving full permissions for the user on the SQL server installation folder. But that didn't help.

I checked the process monitor for process DTSWizard.exe(used for import in sql) has about 160,000 events. Then i searched for "denied" in those. I got a registry entry showing "ACCESS DENIED" .Same is shown below.

Now i searched for that particular registry. But that registry entry was not there in the PC having problem.

Then i searched same registry entry in some other PC where there is no error for SQL import data. but in other PC also i didnt get same registry. But in these PC there where no ACCESS DENIED error in process monitor.

Now by using the process monitor events and access denied registry how can i trace the problem?

So what might be the reason for this error? If you want any more information please write me.



SSIS tries to insert NULL value into a destination column ignored in the mapping.

$
0
0

Hello everyone,

 

I am having a little problem with a simple package and I do not know if this is a known issue or that I am missing something.

 

I have a data flow task, a simple one, with an oledb source pulling data, using a select statement, from a sql server 2005 instance, and an ole db destination pointing to a table in a sql server 2000 instance. Both intances are standard edition. The table in the destination has a column which allow null values and has also a default constraint (getdate()), and this column is not present in the source. When I map the columns in the destination, I leave this column as "ignore", not being mapped to any column from the source. The problem is that when I execute the task, SSIS is trying to insert NULL value into this column, so the package fail with the error "can not insert NULL value into column myColumn". I wonder why is it trying to insert NULL value if the column is not mapped to any column from the source.

 

Is this a known issue or I am nissing something in the settings?

 

If the destination table has rowversion or identity columns, there is no problem ar all. I ignore those columns in the mapping and SQL Server feeds them as expected.

 

Thanks in advance,

Alejandro Mesa

 

Error Message: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020

$
0
0

I have a data flow in SSIS (2008 R2) that has an OLE DB Source --> Script Component (Transformation via Visual Basic) --> OLE DB Destination. The query, when ran in SSMS, brings in a little over 2.6 million records from the DB source. (just to give you an idea).

At about 17,600 records the package fails with the follow error message:

Error Message: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020

Data Flow Task - Concatenate Service Request Notes  Error Code:  -1073450952  Error Message:  SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "OLE DB Source - INT_FCT_SERVICE_NOTE Internal" (1) returned error code 0xC02020C4.  

Data Flow Task - Concatenate Service Request Notes  Error Code:  -1073450910  Error Message:  System.Runtime.InteropServices.COMException (0x80004005): Error HRESULT E_FAIL has been returned from a call to a COM component.

   at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.HandleUserException(Exception e)

   at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.ProcessInput(Int32 inputID, PipelineBuffer buffer)

   at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostProcessInput(IDTSManagedComponentWrapper100 wrapper, Int32 inputID, IDTSBuffer100 pDTSBuffer, IntPtr bufferWirePacket)

Now, the current Default Buffer Max Rows = 1000 and Default Buffer Size = 10485760


Could anyone be of assistance?



How to import a dynamic excel sheet to a dynamic database table.

$
0
0

I am not a developer, but am looking at what is possible in SQL server as I am planning an implementation strategy.

My requirement is as follows:

I receive an excel sheet and I do not know what are the columns or the number of columns in the sheet.

I need to load this sheet data into a dynamic table in SQL server - named based on input excel sheet. The column names should get created from the header row. This should be achieved just by providing excel sheet name & location.

Thanks

SSIS 2012: SSIS Error Code "Excel Connection Manager" failed with error code 0xC0202009.

$
0
0

Hi,

This is kind of weird issue that I am experiencing with excel connection manager in SSIS 2012. This issue occurs sometimes but when I close and re-open SSDT (SQL Server Data Tools - newer BIDS) then this issues goes off temporarily.

Just FYI, through SSDT environment I executed the package successfully with both settings Run64bit runtime setting to Yes and No when error does not occur.

So far I have installed http://www.microsoft.com/en-us/download/details.aspx?id=13255 (Microsoft Access Database Engine 2010 Redistributable).

I still remember for older versions of SQL Server (2005 & 2008) that I have executed Excel connection SSIS packages with Run64bit runtime = false i.e. in 32-bit mode. As far as I know I think Excel 64-bit issue has been resolved with SQL Server 2012 release.

*****************************************************************

Here is the detail of error message:

TITLE: Package Validation Error
------------------------------
Package Validation Error
------------------------------
ADDITIONAL INFORMATION:
Error at Data Flow Task [Excel Source [2]]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection

Manager" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

Error at Data Flow Task [SSIS.Pipeline]: Excel Source failed validation and returned error code 0xC020801C.

Error at Data Flow Task [SSIS.Pipeline]: One or more component failed validation.

Error at Data Flow Task: There were errors during task validation.

Error at Package [Connection manager "Excel Connection Manager"]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft Access Database Engine"  Hresult: 0x80004005  Description: "Unspecified error".

 (Microsoft.DataTransformationServices.VsIntegration)
****************************************************************

Here are my environment details:

SQL Server 2012 {Microsoft SQL Server 2012 (SP1) - 11.0.3368.0 (X64) } , Excel 2010 (32-bit). I am developing SSIS code on Virtual desktops with Windows 7 32-bit OS.

Also it occurred to me that since Virtual Desktops are on Shared Infrastructure, the source files and SSIS packages (code) can be on Shared drives for e.g. \\<Corpnet>\userdata\<Corp_Users_Grp>\<Username>\Visual Studio 2010\Projects\Integration Services Project2\Integration Services Project2\Package.dtsx.

Does this kind of Shared drives have any impact to give this issue?

Thanks in advance!

Ketan

P.S.: I had look at this forum question --> http://social.msdn.microsoft.com/Forums/sqlserver/en-US/903bbe1d-e070-4c43-9d3b-0a5193550029/64bit-error-in-excel-connection-manager-in-ssis

SSIS error working with Server 2012

$
0
0

Hi,

I have a class library that creates, delete, update ssis packages programatically.

What could be the reason for an error message that I get in front of the server 2012. Against a server 2008 It works good.


Unable to cast COM object of type 'System.__ComObject' to interface type 'Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSExecutables100'. This operation failed because the QueryInterface call on the COM component for the interface with IID '{0FAC005E-5ABD-4D1E-9B21-18F3DE622B24}' failed due to the following error: No such interface supported (Exception from HRESULT: 0x80004002 (E_NOINTERFACE)).

thanks

Split Column in two different types (Data flow Task

$
0
0

I am currently workin on a SSIS Project where i try to get data coming out of SharePoint and Store it into a SQL Server DB. The following is an example of how the Table will look like in the end:

| TableID | Employee | Status* | PlannedAmount*| DateCol |

now the data (only speaking of the column that i Need help on now) i get is in the following form:

| PlannedValue |     (DT_WSTR datatype)

now the above column can either have a Money (money) type value (say 200 or 400, etc.) or it can be of a textual (varchar(50)) type value("To be authorized" or "not planned yet", etc.).

So what i essentialy Need to do is split the Column i get from SharePoint into two new Columns namely: * Status and PlannedAmount.

My question: Has anybody ever done this ?, if so what is the best way to do it ?

Thanks a lot in advance! :)


SSIS and MS Excel - what are the requirements for the server where I generate a new excel file?

$
0
0

To create excel files form a package, what do I need installed on the server?  A full MS Office install or something else?


component is missing, not registered, not upgradeable

$
0
0

Hi,

I got the error:

"Error: 0xC0048021 at Data Flow Task, OLE DB Source [1]: The component is missing, not registered, not upgradeable, or missing required interfaces. The contact information for this component is "OLE DB Source;Microsoft Corporation; Microsoft SqlServer v10; (C) Microsoft Corporation; All Rights Reserved; http://www.microsoft.com/sql/support;7"."

This apears in any destination or source connection

Getting COM Component error while opening SSIS Script task.

$
0
0

Hi All,

While click on EDIT SCRIPT Button in script task it's not opening the script editing window.

Getting below error message:

"Error HRESULT E_FAIL has been returned from a call to a COM component. (EnvDTE)"

We have added ADODB reference in script task.

Thanks in advance, please give some suggestion.

 

need ideas on merging 2 databases

$
0
0

Hi,

I need to merge two databases into one, the common table between the two is the names tables, now my issue is that each database contains duplicate entries .for eg there are multiple entries for the name john doe.. I want only one of this entry to come in the final database, also there are entries where the name may be misspelled like john deo, I want to remove these entries also in the final database. Any ideas on how I can accomplish this task

SSIS 2008 Logging - SSIS Log Provider for SQL Server

$
0
0

Simple SSIS package - copies a table from Server A to Server B.

Everything works except logging using SSIS Log Provider for SQL Server. Selecting the similar events to usingSSIS Log Provider for Text Files does generates a file on the server.

I specified server B on the configuration for SSIS Log Provider for SQL Server.

Logged on with a username with sysadmin rights on Server B. Executed the package using that login and nothing is written to msdb..sysssislog

any ideas what's going on or what am I doing wrong?

 


use destination table values in source to get data

$
0
0

I have a requirement to get data from source table to destination table. Source is oracle say tablename - 'orasource' fielnames=empid, empname and destination table name is 'sqldest' and field name are empid, empname.

My requirement - I want to fetch only those rows from source based on destination table 'sqldest' and field name is empid. How do I do this?


Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>