Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

ForEach Variable mapping number 1 to variable "" cannot be applied error!

$
0
0

Hi, I've read some other threads but I still can't seem to figure this out.  I have a table with columns-->

 

FName    varchar(25)

MName   varchar(25)

LName    varchar(25)

 

I have set up an object variable and 3 string variables

In my execute sql task I have result set to Full result set, Ole DB connection and my select statement

In the result set tab I have the result name set to 0 and mapped to the object variable

In my package I have a foreachloop that has a send mail task in it that loops through the recordset and fires off an email

I have the foreachloop enumerator set to ADO and the object source variable set to my object and selected Rows in first table option.

I then map all my variables starting with index 0.

 

I keep getting this error:

 

Error: The type of the value being assigned to variable "User::First_Name" differs from the current variable type. Variables may not change type during execution. Variable types are strict, except for variables of type Object.

 

I did this about a year ago and didn't get this error but I'm not sure how to fix it.  I changed my table columns to nvarchar, char, text and still keep getting the error.

 

I guess I need to figure out which data type works with string or use a cast in my execute sql task?

 

thanks.


Logging the conditions within a conditional split transformation (SQL Server 2012 and 2016)

$
0
0

Hi,

I'm struggling to find out how we can store the conditions inside a conditional split transformation when we run a package. I need a snapshot of the expressions (the whole expressions, not only parameters inside them).

The closest we have got is when an error triggered the SSIS logging and stored the context in the table event_message_context, but we can't figure out how to trigger this logging without an error. We don't need it specifically to come from the built-in logging, we can surely use a script task if you have any suggestions. We run both SQL server 2012 and 2016.

Thanks

Migrating a Database to a New Server

$
0
0

Good afternoon, all -

I have a question that is related to one I had yesterday on copying a database from one server to another. Now, please bear with me, because I am by no means a pro at SSMS. Pretty much everything I know is from trial and error.

Anyway, I'm almost done with migrating the databases I've been asked to move by using Import on the new server, selecting the old server as the source and the new server as the destination. When it gets to the part where you select the tables you want moved, I click the first box at the very top to select all the tables. Then, I go through and uncheck the few views that end up being selected; I'll handle those differently.

This has been working fine, except for a couple of databases that don't already have a presence on the new server. I was advised yesterday that I should use Backup/Restore to get those over, but there are permission issues that take this away as an option.

The hitch in my gitalong that I have now is that some of the databases have some functionality that was coded into the CREATE statements that initiated the table. For instance, a Load_Date value might be populated by default with GETDATE() and this is provided for in the CREATE, not as a part of an ETL process.

As a result, the import process I'm using is importing only the DATA, not any of these default coding shortcuts, so what it populates the new table with is not the code to create, say, a Load_Date, but the current Load_Date value in the table at the time of importing.

Now, I'm tasked to migrate about eight or so databases, but they have a few hundred tables among them. And, the tables that have these coded default values are very few among them, but no one knows exactly which tables they are, without searching through them.

As I understand the import process, if the table exists on the destination, it will maintain the table structure - including any default coding - and will just place the source data into the existing table without harming those defaults. So, I figure I need to determine which tables have the default scripts, right-click those to select Script Database as CREATE and use that to make the table in the destination database. Then, I use Import to move the data over from the source table to the newly made destination table to populate it, and the default code is maintained.

All well and good.

But, I don't want to slosh through all the hundreds of tables to search out the very few that have this default coding.

So, after all that, is there any fast way to find those few tables that have default code? Then, I can handle manually setting up that handful of tables and populating them separately, while using Import on the rest.

Thanx for any help, it is REALLY appreciated!

Error from SSIS OLE DB source (preview works but not running the package)

$
0
0

Hi,

I am having an issue with one of my packages that is having an OLE DB source. The source is working in VS in design mode so that I can view the preview of data in the source but when I try to run the package, still in VS, I get the following error message.

[SRC_MDS_V_FictiveItems [426]] Error: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "MDS OLEDB" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

I also have a different problem with the same package in my production environment but the error message there is different. It says that the data is trying to insert duplicates in my destination table but not duplicates exists in the source.

DFT_MSD2DW_FictiveItem:Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "The statement has been terminated.".
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "Violation of UNIQUE KEY constraint 'cont_LocalItemKey_Unique'. Cannot insert duplicate key in object 'dbo.dLocalItem'. The duplicate key value is (PR_DENMARK_AS_1030536).".

Grateful for all clues I can get!

//Patrick


Oracle column with Timestamp(6) data type extract using ssis

$
0
0

Hi All,

I am trying to pull an oracle table data into sql server using SSIS. I have a package variable that holds the source query that needs to be fired in the oracle db.I have a data flow task with oledb source(oracle) and oledb destination(sql server).

The oledb source query(variable) is as follows

Select A,B,C From TABLE TT  Where C in (Select coalesce(ab,cd) as c From Table T2 Where Last_Upd_Dt >= '2018-09-24 12:00:00')

The column Last_Upd_Dt  is a TimeStamp(6) with default value of LocalTimeStamp in the source oracle DB

My question is in what format should my input parameter value be so that I dont have to convert the Last_Upd_Dt  column to TO_DATE(), TO_CHAR() etc 

If I run that query using SSIS I get ORA-01843: not a valid month

SSIS List Adaptors for SharePoint 2013

$
0
0

Was wondering if anyone is using the SSIS SharePoint List Adapters with SharePoint 2013 ?  We are interested in using them, but wasn't able to get information on support for SharePoint 2013 and the api's used (ASMX vs WCF web services). 

https://sqlsrvintegrationsrv.codeplex.com/documentation

https://msdn.microsoft.com/en-us/library/hh368261.aspx

Thank you in advance for any help. 

Tom


Tom H.

Error handlers

$
0
0

I have created a sql task in control flow. Also, I have created one more sql task  in event handler as specified in below url...I'm looking for help. Please let me know how to handle...

http://www.techbrothersit.com/2014/08/ssis-how-to-email-error-messages-from.html

Issue - I have two cases

case1 - When I give "select 1/0" in sql task in control flow  - In this case am getting right.

case2 - When I give wrong SP name in sql task in control flow, am getting below error

"[Execute SQL Task] Error: Executing the query "EXEC msdb.dbo.sp_send_dbmail
 @profile_name = 'Test-..." failed with the following error: "Incorrect syntax near 'dbo'.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly." Here is script that is added in sql task   

"EXEC msdb.dbo.sp_send_dbmail
 @profile_name = '"+ @[User::MailProfile] +"',
@recipients = '"+ @[User::Recipients] +"',"
+"
 @body = "+"'Hi All,"+"
Error Information is below
Error Code:" + (DT_STR,50,1252)@[System::ErrorCode] +"
Task Name:"+ @[System::SourceName] +"
Error Description:" + @[System::ErrorDescription] +
"Thank you
IT Team"
+"',
@subject = '"+  @[System::PackageName] + " failed in  "+ @[User::EnvironemntName]+"'"


Issue with Analysis Services Processing Task after a SSIS project deployment - SSIS 2016

$
0
0

Hi,

I'm working with SQL Server 2016, SSIS 2016, SSAS Tabular 2016 and SSDT for VSTO 2015.

I've created a SSIS 2016 project with a package having some Analysis Services Processing tasks to process some dimension and fact tables of a SSAS Tabular model.

In the dev environment, I've worked with a dev tabular model with a different name respect to the prod tabular model.

I've deployed the SSIS project (having project parameters) on the SSIS catalog of the prod environment; obviously, I've created an environment, the related variables and mapped them with the project parameters of the SSIS solution.

Moreover, I've created a job to launch the deployed SSIS project. When it is executed the package to process the tabular model, I've obtained an errore because the package trying to find the dev tabular model and not the prod tabular model.

To solve this issue, I've tried to change the ProcessingCommands property for each Analysis Services Processing task (forcing the change in the code) but without any results.

I've solved the issue recreating each Analysis Services Processing task to point the prod tabular model.

For me, this task type has a bug, because it has to continue to function when deployed on the SSIS catalog.

Any suggests to me about this subject, please?


Microsoft.SqlServer.IntegrationServices.Designer.Model.IClipboardService

$
0
0

Hello,

I am trying to get hold of the following Microsoft.SqlServer.IntegrationServices.Designer.Model.IClipboardService, however I am not able to find the assembly, and what installs it. Any clue greatly aprecciated!

Thanks


SSIS Package dont run SQL Server 2016

$
0
0

HI All,

I had migrated my SSIS packages from SQL 2008 with winnow 2002 to following server. After all changes in SSIS packages when I run from Visual Studio its running fine but when I deploy and run from SSIS it gives parser NULL error .i also try to run DTExec.exe from run but nothing comes up. My SQL server is not in C drive its in F drive . i also made RUn64 bit false in visual studio.

SQL Server:

Microsoft SQL Server 2016 (SP1) (KB3182545) - 13.0.4001.0 (X64)   Oct 28 2016 18:17:30   Copyright (c) Microsoft Corporation  Enterprise Edition: Core-based Licensing (64-bit) on Windows Server 2012 R2 Standard 6.3 <X64> (Build 9600: ) (Hypervisor)

Window :- Window server 2012 R2


SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80040E21

$
0
0

Am importing data from execl using ssis package . 1st i got data type miss matching issue, that time am took a data conversion transformation. but again Am getting bellow error messages while executing the package.

[OLE DB Destination [495]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E21.
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80040E21  Description: "Multiple-step OLE DB operation generated errors. Check each OLE DB status value, if available. No work was done.".

[OLE DB Destination [435]] Warning: Truncation may occur due to inserting data from data flow column "DOC_PRF" with a length of 50 to database column "DOC_PRF" with a length of 2.

[OLE DB Destination [495]] Error: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "OLE DB Destination.Inputs[OLE DB Destination Input]" failed because error code 0xC020907B occurred, and the error row disposition on "OLE DB Destination.Inputs[OLE DB Destination Input]" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.


[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  
The ProcessInput method on component "OLE DB Destination" (495) failed with error code 0xC0209029 while processing input "OLE DB Destination Input" (508). The identified component returned an error from the ProcessInput method. 
The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.



Thanks Bala Narasimha

Call Rest API -write to db - generate xml file ASYNCHRONOUSLY

$
0
0

I am working on a data integration project. The requirement is as follows

1) Call a rest api(GET) to get all the organizations GET /organizations

2) For eachorganization get all the networks GET /organizations/[organizationId]/networks

3) Foreach network get all the devices GET /networks/[networkId]/devices

Store all this to data in DB and create and XML file for each organization with its related network and devices. 

I know how to achieve this sequentially using Script Component in SSIS. During the initial stages this wont be a problem but as the data grows  performance will be an issue. I have limited knowledge when it comes to parallel/asynchronous programming.

Can some please help me with an efficient design solution with some samplepseudocode.

Ideally I would want to do this using SSIS but I open for any suggestions(for ex a console app)

ISServerExec.exe consuming all memory and SSIS job failing quickly

$
0
0

SQL 2016 SP2.. 32GB memory, 28GB assigned to SQL Server 

Im getting following error when running SSIS package. 

Event 2004, Ressource-Exhaustion-Detector
Windows successfully diagnosed a low virtual memory condition. 
The following programs consumed the most virtual memory: ISServerExec.exe (7008) consumed 38500085760 bytes, ISServerExec.exe (11176) consumed 2817409024 bytes, and sqlservr.exe (2460) consumed 623489024 bytes.
----

The error comes very quickly within seconds, i am monitoring through task/resource monitor and through perfmon. 

My package is truncating tables and re-populating, but before that there is a VBscript called start monitoring that does the following

' Microsoft SQL Server Integration Services Script Task
' Write scripts using Microsoft Visual Basic
' The ScriptMain class is the entry point of the Script Task.

Imports System
Imports System.Data
Imports System.Math
Imports Microsoft.SqlServer.Dts.Runtime

<Microsoft.SqlServer.Dts.Tasks.ScriptTask.SSISScriptTaskEntryPointAttribute> _
<System.CLSCompliantAttribute(False)> _
Partial Public Class ScriptMain
Inherits Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTARTScriptObjectModelBase

Enum ScriptResults
Success = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Success
Failure = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Failure
End Enum

' The execution engine calls this method when the task executes.
' To access the object model, use the Dts object. Connections, variables, events,
' and logging features are available as static members of the Dts class.
' Before returning from this method, set the value of Dts.TaskResult to indicate success or failure.

' To open Code and Text Editor Help, press F1.
' To open Object Browser, press Ctrl+Alt+J.

Public Sub Main()

        'v_DBServer_Log_Name,v_job_id
        'v_job_execution_id

        Dim monitor As SDIS.SSIS.Library.Monitoring = New SDIS.SSIS.Library.Monitoring()
        Dts.Variables("v_job_execution_id").Value = monitor.StartJob(Dts.Variables("v_DBServer_Log_Name").Value.ToString(), _
                         CType(Dts.Variables("v_job_id").Value, Integer))

        '
' Add your code here
'
Dts.TaskResult = ScriptResults.Success
End Sub

End Class

Could it be the vbscript thats maxing out the memory? how can i test or prove it is or isnt? 

I am running sp_whoisactive and i can see the truncate/re-populates are working and not taking up alot of memory, but all i can see is ISServerExec.exe rising very very fast and job failing within 15 seconds or so.. 

thanks 


ilikefondue

Dynamically updating SSAS connection though expression not working after latest 2016 SSIS update

$
0
0

Hi,

I have a package that is loading our data warehouse and the last task is to process our cube. Since we have two prod SSAS Servers, I have a for each loop container that is processing each server. We have the connection strings in a table in our database.

  1. Retrieve connection strings from database
  2. Assign the result set to a object data type
  3. In the For Each Loop Container, loop through the object type variable and also map the value to a string variable
  4. I have an expression in the package level connection for SSAS to take the value from the string variable.

This was working fine, until the the latest SSIS update. It seems like this patch broke that piece and now its not updating the default connection string.

I have read articles about this issue being reported for SSIS 2012 in the past. I'm wondering if microsoft reintroduced this bug again in SSIS 2016.

Getting Error at the time of Package Deployment

$
0
0

Hi Guys,

We are using SQL Server 2016 EE (SP1-CU8). We also developed some SSIS package in Visual Studio 2015. At the time of package deployment, we are getting below error. 

Connection Timeout Expired.  The timeout period elapsed while attempting to consume the pre-login handshake acknowledgement.  This could be because the pre-login handshake failed or the server was unable to respond back in time.  The duration spent while attempting to connect to this server was - [Pre-Login] initialization=18380; handshake=14498;  (Microsoft SQL Server, Error: -2)

If you have any idea, please suggest.

Thanks

Dhanush


SSIS package is not Running after deployment

$
0
0

Hi,

I have Window :- Window server 2012 R2 and SQL 2016 64 bit. My SSIS packages are running fine by visual studio but not running when I deploy to SSIS and run by right click run package .its says fail to launch execute package utility .

DTExec.exe also don't show any thing when I run this using RUN

SSIS Package with DB2 Connection failed on Scheduling with SQL Agent job using Proxy

$
0
0

Hello,

I am having a SSIS package, which has source as DB2 and Destination as SQL Server. When I deployed the test project on the SSIS server and executed the SSIS package from SSISDB, the package is running successfully. However, when I am trying to run the same package from a SQL agent job, the package is failing with the below error:

1. DFT_DB2_Load:Error: DB2 ODBC Source failed validation and returned error code 0x80004005

2. DFT_DB2_Load:Error: The AcquireConnection methos call to the connection manager DB2_ODBC failed with error code 0xC0014009

DB2 driver version: 11.01

SSIS Server is on SQL Server 2014.

The job was configured to run using a proxy account. Any input on this, will be helpful. Thanks.

Microsoft DB2 OLE DB Provider Error 0x80040E00

$
0
0

Hello,

i have a strange issue using Microsoft OLEDB provider for DB2, I was migrating SSIS 2008 to SSIS 2012 the dataflow task with OLEDB Source which have error output configured are throwing error in 2012 where as works fine in 2008.

Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E00.
An OLE DB record is available.  Source: "Microsoft DB2 OLE DB Provider"  Hresult: 0x80040E00  Description: "Accessor is invalid.".

When i remove the error output everything executes fine, does anyone encountered this before? 

Thanks,

naveej

HDFS File Source and Quote Identifiers

$
0
0

Hi all, I'm trying to load a file .csv that has a column with a text containing commas. The text is between double quotes, but on the HDFS File Source there are no properties about quote identifiers, it is possible to set only the column delimiter.

This is weird.

I know that I can copy the file locally and use a flat file connection, but I would rather not do it...

Data getting truncated

$
0
0

Good Morning,

In my SSIS Package i am loading data from a sql server table to a flat file. In the sample below i am posting only two column out of 10 total columns and i am facing issues with the one of the two columns "name". When i load into a pipedelimited flat files only the first letter of the "name"column are getting loaded. In the below case in the flat file i see the values (D,I,F,K) in the flat file instead of (Diversified,International,FMD,Key). 

What i  tried so far, on the source advance editor i changed the column name to (DT_STR) from 1 to 50. I added a dataviewer and it shows the first letter of the word as well. Am i missing something here, please suggest.

Thanks

create table sample (id uniqueidentifier,name varchar)
insert into sample values ('5BB8427F-D7BD-4760-B4A7-3CF0C4EECC5D','Diversified',
'37BB5BC3-384C-4885-B117-42A9311A0216','International',
'9557DD54-6F8F-487B-97DF-F123DFEE7C08','FMD',
'0B087D16-09AF-4874-A57C-F93AB36AD4E9','Key')


SV

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>