Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SQL command from variable source oracle generic error

$
0
0
Hi.

I'm creating sql code for importing data from oracle dynamic and store this code in ssis variable. In source in data flow task i put SQL command from variable and everything works fine, BUT if i get error on source (retrieving date from oracle is managed through views and sometimes views have problems) in ssis i'm getting generic error:

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "Oracle Core source" (1943) returned error code 0xC0202009.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

If i'm using hardcoded sql code in source in data flow task then i'm getting full error (in this case it was ORA-01427: single-row subquery returns more than one row).

Is there any way to get nice, clear error description if i'm using SQL command from variable in source from oracle in  data flow task?

Tnx in advance

How to recognize two instances of SSIS job.

$
0
0

Hi All,

We are executing SSIS jobs through autosys as calling them through batch files. All the other jobs are working fine however one of the job is duplicating the data from multiple instances, job runs perfect when we execute it manually no duplicate happens but it is happening when execute it through autosys. We tried to dig out after adding system variables to find the machine name/user name etc but it couldn't help.

Please help me is there any way to identify the jobs name and the location where it is getting executing simultaneously at same time?  or any other suggestion would be great help...

Thanks,

Khalid 

SSIS 2008: Error while editing script task

$
0
0

Hi All,

I'm getting error while trying to open a script task in a package. I have seen some forums says to uninstall sql server. But, I have reinstalled SQL Server and VS many times b4 itself due to an error with tfs. Somehow, it's working fine now. So, I don't want to uninstall and reinstall again.  VS team system 2008 is installed in my system.

TITLE: Microsoft Visual Studio
------------------------------

Cannot show Visual Studio 2008 Tools for Applications editor.

------------------------------
ADDITIONAL INFORMATION:

Could not load file or assembly 'VSTADTEProvider.Interop, Version=9.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. The system cannot find the file specified. (Microsoft.SqlServer.VSTAScriptingLib)

Please suggest.

Thanks,

Julie





Convert AS400 V7.1 DB2 database to SQL 2008\12 using SSIS

$
0
0

Is there a way to copy and convert a AS400 V7.1 DB2 database to SQL server 2008\12 using SSIS.

I tried using SSMA but is seems SSMA will not work with an AS400 database.

Any info or help with this would be greatly apriciated.

Justin Raper



SSIS package unable to run

$
0
0

I have a database server (Server1) which is running SQL server 2000.

I have another "Archive" server (Server2) which is running SQL server 2014. The job of this archive server (Server 2) is to basically transfer all data, from audit tables, from primary/production server (Server1 : source) to "Archive Server"(Server2 : Destination).

It is done via executing a SSIS package that enables the data transfer. 

I assume we can automate the process and setup SQL server agent to run the package automatically at our desire.

But the package execution fails and I get the following error:

Message
Executed as user: NT Service\SQLAgent$SQLSERVER. Microsoft (R) SQL Server Execute Package Utility  Version 12.0.2000.8 for 64-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  11:05:11 a.m.  Error: 2016-08-23 11:05:12.08     Code: 0xC0016016     Source: AuditTransferTask      Description: Failed to decrypt protected XML node "DTS:Password" with error 0x8009000B "Key not valid for use in specified state.". You may not be authorized to access this information. This error occurs when there is a cryptographic error. Verify that the correct key is available.  End Error  Error: 2016-08-23 11:05:12.39     Code: 0xC0202009     Source: AuditTransferTask Connection manager "SourceDb"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0" Hresult: 0x80004005  Description: "Client unable to establish connection".  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "SQL Server Native Client 11.0 does not support connections to SQL Server 2000 or earlier versions.".  End Error  Error: 2016-08-23 11:05:12.39     Code: 0xC020801C     Source: Transfer from Source to Destination Accumulator_Audit [1]    Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "SourceDb" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.  End Error  Error: 2016-08-23 11:05:12.39     Code: 0xC0047017     Source: Transfer from Source to Destination SSIS.Pipeline     Description: Accumulator_Audit failed validation and returned error code 0xC020801C.  End Error  Error: 2016-08-23 11:05:12.39     Code: 0xC004700C     Source: Transfer from Source to Destination SSIS.Pipeline     Description: One or more component failed validation.  End Error  Error: 2016-08-23 11:05:12.39     Code: 0xC0024107     Source: Transfer from Source to Destination      Description: There were errors during task validation.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  11:05:11 a.m.  Finished: 11:05:12 a.m.  Elapsed:  1.015 seconds.  The package execution failed.  The step failed.

Please help.

Moving from SQL Server Replication to SSIS ETL

$
0
0

We are currently using replication to copy data from an OLTP database to a data warehouse. The problem is, whenever the application developers make a change to the db schema in Entity Framework, we have to take the affected objects out of replication, let the application deployment make the changes to the schema and then place the objects back into replication. We want to automate this process through Octopus Deploy, but scripting replication seems to be a real pain in the ... I looked into scripting the replication steps and it seems nearly impossible to do that. So I figured I would write an SSIS package to replace replication, create a SQL job to execute the package and then script the disable/enable of the package around the deployment step.

I've run into a bit of a problem however. The last time the package ran (in staging, _not_ in production, we still have replication running in production) it ran for just a little over 26 hours. It completed and everything moved around just fine, but 26 hours is far too long. So, I rewrote 4 of the biggest offending tables so that they use stored procedures for the inserts and updates and are now pushing those changes to staging in hopes that it will speed up the package. I was having SSIS performing all the checks, inserts and updates, but now the stored procedures are doing that.

Is there a better, faster way of doing this? Or, am I on the right track with the stored procedures?

How to migrate SQL Agent jobs that call SSIS packages

$
0
0
I need to migrate SQL Agent jobs from ServerA to ServerB.  Some Agent jobs call an SSIS package.  I migrate jobs using the Transfer Jobs Task in a new SSIS package.  I migrate/import SSIS packages from ServerA to ServerB by right clicking on the MSDB node on the target server and selecting Import.  How do I change the migrated Agent jobs and corresponding SSIS packages so they now point to ServerB instead of ServerA?  If I edit the job step properties of the migrated Agent jobs, there are several tabs including General and Data Sources.  I can change the server name on the General tab.  Also, looks like I can edit the connection strings of the Connection Managers that are listed in the Data Sources tab.  Does it matter that there are GUIDs in the connection strings?  I.e., are those GUIDs somehow bound to the source server?  Is there anywhere else I need to change the server name, or is there a better approach?  Bottom line is I don't want to have to open migrated SSIS packages, change the connection managers, save, and reimport.  Thanks.

Get user name from SharePoint Online list in SSIS package

$
0
0

I'm building a database in SQL Server to build reports based on SharePoint Online sites. On the sites I have several columns refering to users, such as "Assigned to", "Owner" and that kind of person column. When reading those lists in OData source, I get the actual value which is the ID of the user in the site however I cannot find a way to get the user name.

In a REST query I know I can use $expand to get those values but that does not seems to work inside SSIS.

Is there a way I can retrieve the list of users of a given site so I can join them with my lists?

Thanks in advance.


Rene Alvarez


Protocol Error in TDS Stream in SSIS

$
0
0

Hi Team,

While executing the SSIS package we get the below error message and we don't use Linked server inside the package to pull data from the server. This happens intermittently and for only one package out of the several packages in the solution. Can anybody please suggest me what needs to be looked at to fix this error.

SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80004005  Description:"Protocol error in TDS stream".  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80004005  Description: "Protocol error in TDS stream".  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80004005  Description: "Protocol error in TDS stream". 

SQL Server 2016 Installation - VS2015 crashes when trying to migrate SSIS 2008 R2 packages

$
0
0

Hi,

I have followed the order of product installation below:

1) SQL Server Developer 2016
 2) Visual Studio 2015 Enterprise
 3) SSMS 2016

 I noticed several disturbing things:

 - SQL Server setup installed "Microsoft Visual Studio Tools For Applications"
 => SQL Server setup installed VSTA even though no VS installation exists


- SQL Server 2014 Express LocalDB was installed by VS setup
 - SQL Server 2016 LocalDB was installed by VS setup
 => I'm using SQL Server 2016 Developer edition I dont want any "Express / LocalDB" edition to be installed (especially one of past version like 2014).
 => VS setup don't let us choose to install them or not
 => VS setup did not detect the existing SQL Server installation

- SSMS setup installed "Microsoft Visual Studio 2015 Shell (Isolated)"
 => SSMS setup did not detect the existing VS 2015 installation
 => SSMS setup installed a separate Visual Studio 2015 Shell
 => several different installations of Visual Studio 2015 exist locally which is quite ugly and might cause problem with update / service pack

I've tested,  I'm experiencing several Visual Studio 2015 crashes when trying to migrate SSIS 2008 R2 packages.

Any idea to solve those crashes with SSIS 2008 R2 migration?

Thanks in advance.

Cheers.

Missing locale data in Windows Informix Client Tools SDK ODBC install?

$
0
0

Hi all

I'm attempting to use an ODBC connection from a Windows 2012R2 server  to an Informix server using the clientsdk.4.10.TC6DE.WIN install.

However, when I try to test my ODBC connection, I get the following error:

'Test connection was NOT successful.[Informix][Informix ODBC Driver][Informix]Unable to load locale categories.'

If the locale data was correctly installed, where should it be? I don't see a gls folder in my INFORMIXDIR.

setnet32 seems to have the correct locale values, and matches what is in the registry.

Does anyone have any ideas on how I might resolve this issue? Am I installing the correct driver? I'm using clientsdk.4.10.TC4DE.WIN on Windows Server 2008 machines without any problems.

I want to use the driver with SSIS so I'm installing the 32 bit version.

Thanks in advance.

SSIS package execution

$
0
0

I have got myself confused !

I'm running VS2013 on my local machine with SQL2014. I can run the package from VS without an issue and likewise from DTEXEC on my local machine no issues. The package inserts data to table in a SQL2014 table on a different server.

All well and good so far.

The problem occurs when I try and execute the package from a TSQL query on SQL2008R2 I keep getting a version error

Looking through the forums It suggests the version of DTEXEC is the problem.

TSQL on SQL2008R2

EXEC

master..xp_cmdshell'DTExec /File "\\SVR1\DTSX\Package.dtsx" /Set \package.variables[User::LedgerKey];"918D0383-449D-4926-B106-02F309DB2BF9"'

The error I get is

   Description: Package migration from version 8 to version 3 failed with error 0xC001700A "The version number in the package is not valid. The version number cannot be greater than current version number.".

Is there a way to do this, without using a SQL agent job. If so how?


Dont ask me .. i dont know

SSIS 2012 - Attunity 2.0 - Progress 9.1D compatibility problem?

$
0
0

Hello all.

I'm having a problem with one of my SSIS drivers (Progress 9.1D) since installing Oracle Data Tools And Attunity 2.0.

The problem is, when I try to 'Preview' the data in the ODBC source task (connected to a source via the Progress 9.1D driver) I get the error:

"Unable to cast COM object of type 'Micorosoft.Sqlserver.Dts.Pipeline.Wrapper.CManagedComponentWrapperClass' to interface
 type 'Attunity.IntegrationServices.DataFlowUI.ODBCUI.IAttunityConnectionODBC'. This operation failed because the QueryInterface
 call on the COM component for the interface with IID '{AD1F8A0A-7C00-4310-9FCC-D208D8980655}' failed due to the following error:
 No such interface supported (Exception from HRESULT: 0x80004002 (E_NOINTERFACE))."

Anyone know what this means or how I might get rid of it?

Attunity seems to work fine.

Thanks in advance,

Robert

Image of error

How is the file size of utf 8 format csv file decided if it has 10 columns with 100 records of nvarchar values

$
0
0

I am just trying to estimate how a file size is decided with the content in a CSV file.

LF and , as delimiters

How is the  file size of utf 8  format csv file decided if it has 10 columns with 100 records of nvarchar values.

Can the file size in MB predicted with these defined constraints ? Or I need to know something more?




Send Mail task related or Send mail using script task

$
0
0

Hi,

I need to send mail using script task or send mail task. I am very much new to this task. Can any body guide me send mail task and also can anybody send me sample code for sending mail using script task.

Thanks in advance

P


Smash126


SSIS runs successfully but table does NOT updated

$
0
0

All,

I have one SSIS package which has 5 different Execute SQL task (Running in Sequential execution) and Send Mail Task at the end.

Each execute SQL task runs separate Stored Procedure which updates 5 separate tables.

Once those are completed successfully then Developers get an email.

This Package is running fine when I run manually.

Last 6 months we scheduled to run this package through SQL Agent.

Just today I got an issue that one of the table did not get updated.

Developers received success email and I checked dbo.sysssislog table i can see that particular step took 2 hours to execute but back end table does NOT updated as per stored procedure.

P.S I am using SQL 2014

Thanks in advance

Thanks

Fredyyy

Change Connection information

$
0
0

Hello All,

I am newbie to SSIS. We have several packages (stored into MSDB database) that were created using "Import/Export Data" of SQL Server 2005. I was able to export them from SQL Server 2005 to file system and then imported them into SQL Server 2014. Now I have to manually change the Connection Manager's SourceConnectionOLEDB and DestinationConnectionOLEDB values when I execute these packages because they are pointing to the SQL Server 2005 server. How do I save the new connection values (data source = <SQL Server 2014 Server Name>) into these packages? My plan is to schedule a job and execute these packages thru it. I am only familiar with SQL Server management studio.

Thanks in advance...

KP

fuzzy components or something else?

$
0
0

Hi.  We run 2012 enterprise.  I've never used fuzzy lookups or groupings before.  All of the data is US based. 

I'm faced on every row coming into my etl with the following challenge...1) is last name A equal to or similar enough to last name B to mark them as possibly the same on this row, 2) pretty much the same with A's and B's addresses.  By possibly I am suggesting that perhaps I'd be able to tweak how strict the rules are based on the results I see.

I don't really know at this point if both addresses go thru some sort of US mail address standardization software but have to assume for now that the answer is no.

I read some older documentation on the fuzzy components and thought immediately that this isn't really a set type of comparison (an input set against some other input set/index) as much as it is a case by case decision with one column being compared against another.

Can the community suggest a direction.  Perhaps a white paper that addresses more closely my particular challenge?

My gut says a soundex variation could be a good approach to the last name part of the challenge.

Save job into semi-delimited

$
0
0

Hi guys,

I create job where I put this query. Its working.

SELECT T0.U_Scid as 'id', T3.U_Boarding as 'start', T3.U_Boarding as 'end', T5.U_Partner as 'room_id', T1.Name as 'status', T0.U_CardName as 'customer', T0.U_ShipName as 'name_ship', T5.U_Type as 'equipment', T3.U_Port as 'port', T3.U_ETA as 'ETA', T3.U_ETD as 'ETD', T0.U_Scid as 'service_id', T2.Name as 'service_classification', T5.U_Type as 'equipment' FROM [XXX].[dbo].[@COR_SC_EQUIP] T5,[XXX].[dbo].[@COR_SC_GENERAL] T3,

[XXX].[dbo].[@COR_SC_HEADER] T0 INNER JOIN [XXX].[dbo].[OSCS] T1 on T0.U_Status = T1.statusID INNER JOIN [XXX].[dbo].[OSCO] T2 on T0.U_Classifi = T2.originID WHERE T3.U_ScID = T0.U_ScID AND T5.U_ScID = T0.U_SciD AND T3.U_Boarding > '2016-01-01 00:00:00.000'

ORDER BY T3.U_ScID

Then I choose advanced in job steps..and choose to save as test.csv.  And when I open test.csv, I have data in this format: 217775      2016-07-21 00:00:00.000                                2016-07-21 00:00:00.000                      66    and not comma delimited. Should I change type  from Transact-SQL into something else? So when I want to import it into database it will be in right format.

Thank you so much for your advice                 

PS: Of course when I run sql I am able to copy table with header and save it into EXCEL and import it easily into another database.

Procedure with Insert and Update Data From One Table to Another Table

$
0
0
I am trying to make a procedure for this case:
I have two tables Person with Company, CustomerNbr, StartDate, EndDate, EmployeeID and the same one but without historical data.
1 situation is when Historical.CustomerNbr = T.CustomerNbr but Historical.EmployeeID <> T.EmployeeID 
  then put Historical.EndDate =  T.StartDate
  and enter new record T.Company, T.CustomerNbr, T.StartDate, T.EndDate, T.EmployeeID
2 situation is when Historical.CustomerNbr is null 
  then and enter new record T.Company, T.CustomerNbr, T.StartDate, T.EndDate, T.EmployeeID
Viewing all 24688 articles
Browse latest View live


Latest Images

<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>