Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Change Data Capture: Experiencing Delay

$
0
0

Hello Community,

I am experiencing an anomaly with Change Data Capture that is turning up empty with online searches.  Essentially, I am attempting to change data, and then immediately call the fn_cdc_get_all_changes_* function to get the changes I just made.

The issue I am running into is that the changes are not immediately available when I make that call.  I have to sleep the current thread 3.5-5 seconds before the changes are registered with SQL Server.

This seems very abnormal to me, so I wanted to check in with the forums here to see if maybe someone can shed some light on the matter.  Is CDC scheduled, perhaps?  I'd like to see if there's a "force refresh" mechanism that I can call to ensure CDC is caught up before I make the call.

Thank you for any assistance you can provide!

Michael


Expression help in SSIS!!!

$
0
0

Hi,

I have the below expression:

ISNULL(@[User::PROCESS_DATE]) || TRIM (@[User::PROCESS_DATE]) == "" ? "1900-01-01" : (@[User::PROCESS_DATE]) == SUBSTRING(@[User::PROCESS_DATE],1,4) + "-" + SUBSTRING(@[User::PROCESS_DATE],5,2) + "-" + "1"

i get the following error:

The data types "DT_WSTR" and "DT_BOOL" are incompatible for the conditional operator

The variable Process_date is char(6) and the destination column is datetime..

 

Deploy SSIS Package with Oracle ADO.Net Connectin

$
0
0

Hi ,

     I'm trying to deploy my SSIS package with Connection to Oracle Data base ,I'm getting the below error .

Description: ADO NET Source has failed to acquire the connection {ABC807A0-C8CB-4052-BEE5-A3B100798C2D} with the following error message:

"ERROR [28000] [Oracle][ODBC][Ora]ORA-01005: null password given; logon denied  

  ERROR [IM006] [Microsoft][ODBC Driver Manager] Driver's SQLSetConnectAttr failed

  ERROR [28000] [Oracle][ODBC][Ora]ORA-01005: null password given; logon denied  ".  End Error 

Error: 2014-03-10 13:27:31.25     Code: 0xC0047017  

Can anyone guide me on this ,Thanks in Advance .


Anita

Precompiled script failed to load on SP4

$
0
0

We have an environment that is using SSIS 2005 packages that are executed on remote servers. The remote servers have SQL Server 2005 with Integration Services installed. SQL Server has been patched with:

  • GDR 5057 for SQL Server Tools and Workstation Components 2005 (64-bit) ENU (KB2494120)
  • GDR 5057 for SQL Server Integration Services 2005 (64-bit) ENU (KB2494120)
  • Service Pack 4 for SQL Server Tools and Workstation Components 2005 (64-bit) (KB2463332)
  • Service Pack 4 for SQL Server Integration Services 2005 (64-bit) (KB2463332)

When we run our set of packages there are certain packages with script tasks that get the following error and fail:

  • Precompiled script failed to load. The computer that is running the Script Task does not have a compiler capable of recompiling the script. To recompile the script, see the Microsoft Knowledge Base article, KB931846 (http://go.microsoft.com/fwlink/?LinkId=81885).

While it is possible to open and recompile the package, this is not practical for multiple packages running on multiple servers when we don't know which package or server combination will experience the issue. Also over time, as we make changes to the packages this issue tends to re-occur randomly.

We have tried all of the resolutions listed in KB931846 but none of them work because we already have SP4 applied. We have tried a number of other patches that have been listed in various KB's but all to no avail.

How do we patch this so that it no longer happens?

Datepart (to get 2 digit number for the month)

$
0
0

I want to build a string that contains today's date (without the time).

 

For example, if select GETDATE() returns 2008-04-28 14:18:34.180, I want to end up with either

 

(1) 2008-04-28

or

(2) 20080428. (I always want the month to be represented by a 2 digit number)

 

Is there a datepart parameter that will give me (1) in one shot? I don't think so, since datepart returns an integer and (1) is not in the form of an integer.

 

So, I was trying to build (2) by using the yyyy, mm, and dd parameters to extract out the appropriate parts and casting them to a string and contatentating them. However, when I do the month portion, (using mm) it gives me the integer that represents the month, and this number can be 1 or 2 digits depending on the month. I always want it to be a 2 digit number. For example, if I'm in Apr, I want to end up with "04", not "4". This would also apply to the day portion. (although the date that I'm writing this post is on the 28th so I'm not certain what GETDATE() will return on dates that are 1 digit.)

 

The only way I can get the single digit month to write out as a 2 digit month is by doing a LEN() function on the string and if it is a length 1, then concatenate a "0" in front of it. I started doing this and the expression became too crazy, so I wanted to first check to see if someone can come up with something cleaner.

 

Thanks for looking.

SSIS Expression: Set Boolean variable from table count(*)

$
0
0

I'm having difficulty adding an expression to a boolean variable that will set the variable based on a table count.  I get an error that DT_WSTR and DT_BOOL are incompatible.  Please help.  I've tried various things and am now blue in face.

@[User::TargetExists] is my boolean variable and part of the error says I can't use the + to concatenate the boolean to build the expression

"Select "+@[User::TargetExists]+" = Case When Count(*) > 0 Then 1 Else 0 End
From @[User::DataDestinationTable]"

Lookup transformation having NULL values in output

$
0
0

Hi,

I have source and lookup data like this -

i/p to lookup transformation

Id        StartDate      Name
1545   2013-06-01   ABC
45607 2013-06-01   XYZ

Lookup query data

Id        StartDate
821     2013-06-01
45607 2014-02-27

I used lookup operation as "Ignore failure". Joined lookup data on Id column and replced StartDate value from it. I am getting o/p like

Id StartDate Name
1545 NULL  ABC
45607 2014-02-27  XYZ

I wanted StartDate should retain old value in case of no match. i.e. expecting output as

Id        StartDate     Name
1545   2013-06-01  ABC
45607 2014-02-27  XYZ

What needs to be done to achieve above expected o/p? Thanks in avance


LineageID of an input column has an another value in runtime

$
0
0

Hi all,

I upgraded my own data flow transformation component to SQL 2012. My component has one input and one asynchronous output.

I found the following unexplained behavior: a value of the LineageID of an input column at the runtime differs from a value which is currently set (and I can check it in designtime using Advanced Editor). E.g. component's input has only one column with the name "Address" and its LineageID equals 10. But during debugging component at the runtime I see that input contains only one column with the name "Address" but itsLineageID equals 11. How is it possible?

So somebody could explain me what is it or give me an advice how to avoid this behavior. And in general how is it possible at all that LineageID for the same column has different values in the design time and the runtime?

PS. Versions of this component for SQL 2005 and 2008 work without such problem.

Igor


SSIS SharePointListAdapter error while exporting a SharePoint List from SharePoint 2007

$
0
0

Greetings,

I'm trying to export List from SharePoint 2007 into SQL Server table, using SSIS  SharePointListSource component (installed from https://sqlsrvintegrationsrv.codeplex.com/releases/view/17652)

But in component editor I'm getting this error :

Error at Data Flow Task [SharePoint List Source [13]]: Microsoft.Samples.SqlServer.SSIS.SharePointUtility.SharePointUnhandledException: Unspecified SharePoint Error.  A possible reason might be you are trying to retrieve too many items at a time (Batch size) ---> System.ServiceModel.FaultException: Exception of type 'Microsoft.SharePoint.SoapServer.SoapServerException' was thrown.

Server stack trace: 
   at System.ServiceModel.Channels.ServiceChannel.HandleReply(ProxyOperationRuntime operation, ProxyRpc rpc)
   at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
   at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
   at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]: 
   at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
   at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData msgData, Int32 type)
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ViewsService.ViewsSoap.GetViewCollection(GetViewCollectionRequest request)
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ViewsService.ViewsSoapClient.ViewsService_ViewsSoap_GetViewCollection(GetViewCollectionRequest request)
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ViewsService.ViewsSoapClient.GetViewCollection(String listName)
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ViewsAdapter.GetSharePointListViews(String listName)
   --- End of inner exception stack trace ---
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ViewsAdapter.GetSharePointListViews(String listName)
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ViewsAdapter.GetViewList(String listName)
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.LookupViewName(String listName, String viewName)
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListServiceUtility.GetFields(Uri sharepointUri, NetworkCredential credentials, String listName, String viewName)
   at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.GetAccessibleSharePointColumns(String sharepointUrl, String listName, String viewName)
   at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.CreateExternalMetaDataColumns(IDTSOutput100 output, String sharepointUrl, String listName, String viewName, Dictionary`2 existingColumnData)
   at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.LoadDataSourceInformation(IDTSOutput100 output, Dictionary`2 existingColumnData)
   at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.ReinitializeMetaData()
   at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostReinitializeMetaData(IDTSManagedComponentWrapper100 wrapper)

Increased Batch Size from default 1000 to 32000, still that error.

Thought, this was List size problem, but small lists still do not export.

Also, the same lists perfectly export from SharePoint 2010 using the very same component.

Any solutions for this error ?

Thanks in advance

How to create a package without BIDS in Microsoft SQL Server Management Studio

$
0
0

I have inherited some SSIS packages that I found I can edit by opening the .dtsx file in my local copy of Microsoft SQL Server management studio.  I then get Control Flow tab, Data Flow tab etc.  I can add or change or delete any of the control or data flows.  I have found that if I use the same path to the local file where the packages are stored that exists on the server, I can edit the dtsx file on my local machine and copy the dtsx file to the server into the same directory structure and sucessfully execute the package on the SQL 2008 server.

I have VS 2010 installed.  I have read that I have to install VS 2008 to use BIDS from within VS.  However, this has not worked out very well.  Since I can basically create a new package by deleteing all of the control and data flows from an existing package, I am in pretty good shape.  However, I would just like to know if there is a way to create a new dtsx file from within Microsoft SQL Server management studio.  Also one thing I have not been able to change is the event handler name or package exploration name....it is just an annoyance since it does not cause any problems, just would like to be able to rename it.   

Sharepoint List source in SSIS

$
0
0

Hi All,

I am working in SSIS. I have created a package in which we are using share point list on UAT . UAT alredy had sharepoint list adapters installed. Now i have deployed my package to production but the package failed. On production i need to instal sharepoint list adapters. I am using sql server 2005.

Could anyone please help me with the link from where i can instal SharePointListAdaptersSetupForSqlServer2005.

I have tried on net but not finding anyone. Please can you help me??? Actually installation will be done by DBA team but i need to give him set up file for 2005 only.

Please help..


Abhishek

Execute Process Task - How to output command?

$
0
0

Hello everyone,

I'm currently running an SSIS package that reaches out to a remove SFTP server and pulls files to my local server.  I've recently run into a problem where it's not properly pulling a list of the files on the remote server (so that I can pull them each one at a time and log the transfer).  Part of the solution is utilizing an execute process task object to call the SFTP client (in this case WinSCP) and issue a command to connect to the remote server and request a list of the files in the remote folder:

Executable

C:\WinSCP\WinSCP.com

Arguments

/command "open sftp://user:password@ftp.remote.com:10022/folder" "option confirm off" "ls files*.csv" "exit"

The arguments line is put together via an expression, the file group query (ls files*.csv) changes to different types of files as I loop through them to get grouped lists (ls files*.txt, ls files*.gz, etc.).  Now what I'm trying to look for is a way to have the actual command executed outputted to the output window, variable, or file so that I can see what's actually being put together via expression.  I imagine this is just an option somewhere that I can toggle on but I haven't been able to find it in BIDS.  Any help is appreciated.

Thanks,

Glen

Need your help to fix error

$
0
0

Hi Experts

I'm trying to combine some columns outputs into 1 derived column and using the below expression:

Expression:

(ISNULL(addressline1) ? " " : addressline1 + "\n") + (ISNULL(addressline2) ? " " : addressline2 + "\n") + city + postalcode + StateProvinceCode

but I'm getting the below error when I execute my package:

----------------------

When I execute my package without addressline2 column then its working fine. See below

Expression:

(ISNULL(addressline1) ? " " : addressline1 + "\n") + city + postalcode + StateProvinceCode

In addition, if someone expain the below part of the expression then I really appreciate it:

Expression:

(

ISNULL(addressline1) ? " " : addressline1 + "\n")

Thanks in advance

Regards

Muz 


Has anyone used SSIS to push or pull data from the cloud?

$
0
0
Need some architecture kind of help. I have used SSIS extensively to pull data from our ERP systems (hosted within our datacenter) to build our DW system. The question I have is if anyone has used SSIS to push data from a hosted solution (from within your company's datacenter) into the cloud. Any links, comments that would help understand how this works from a "cloud" perspective is greatly appreciated. TIA

Jagannathan Santhanam

SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005. An OLE DB record is available

$
0
0

Hi,

I have deployed a package over the MSDB and associated that with a Job, When I ran the Job I got the below error,

Executed as user: UTG\GPSSQLService. Microsoft (R) SQL Server Execute Package Utility Version 10.50.2500.0 for 32-bit Copyright (C) Microsoft Corporation 2010. All rights reserved. Started: 10:42:25 PM Error: 2014-03-20 22:42:26.61 Code: 0xC0202009 Source: UTG_REPORT Connection manager "qora003.sio" Description: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005. An OLE DB record is available. Source: "Microsoft OLE DB Provider for Oracle" Hresult: 0x80004005 Description: "Oracle client and networking components were not found. These components are supplied by Oracle Corporation and are part of the Oracle Version 7.3.3 or later client software installation. Provider is unable to function until these components are installed.". End Error Error: 2014-03-20 22:42:26.61 Code: 0xC020801C Source: Data Flow Task OLE DB Source [1] Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "qora003.sio" failed with error code 0xC0202009. There may be error messages posted before this with more information on why the AcquireConnection method call failed. End Error Error: 2014-03-20 22:42:26.61 Code: 0xC0047017 Source: Data Flow Task SSIS.Pipeline Description: component "OLE DB Source" (1) failed validation and returned error code 0xC020801C. End Error Error: 2014-03-20 22:42:26.61 Code: 0xC004700C Source: Data Flow Task SSIS.Pipeline Description: One or more component failed validation. End Error Error: 2014-03-20 22:42:26.61 Code: 0xC0024107 Source: Data Flow Task Description: There were errors during task validation. End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 10:42:25 PM Finished: 10:42:26 PM Elapsed: 1.248 seconds. The package execution failed. The step failed.

As Per Me this error is taking place due to Oracle client but Oracle client is already installed there on the Server from where we are running this Job.

Your help towards resolution will be appreciable.

Thanks


Regards, Ashish Tripathi


SSIS Package only runs when user is logged

$
0
0

I am working in a SSIS package that runs perfectly in visual studio but from the sql agent it hangs. The package is used to move data from an access file into sql server. The access file have link tables that are sharepoint lists.

The job is setup with a proxy account. If I am logged into the server with the account that is use in the proxy and the job is executed it runs fine but if I am not logged in the server it hangs. Is when trying to query the link tables that are sharepoint list.

Please any advise.

Came across % operator

$
0
0

Hi

I know it looks like a silly question but I appreciate if someone explain it. I came across the following query during study and unable to understand it properly specifically where clause. Thanks in advance

The query is :

select CustomerID, AccountNumber from Sales.Customer where CustomerID % 7 <> 0;
Regards

Muz

In SSIS, insert if new and update if exists .

$
0
0
QuestionHi, I got this problems when i tried to run package : insert if new and update if exists to separate database (New record and change record) . Both updating records and new record were updated to database (new record ), instead of 1 to change record and 1 to new record . My conditions (Conditional Split ) :
  1. New records : Isnull (App_ID) != Isnull (Lkp.App_ID)
  2. Change records : (Is null (App_ID) == Isnull(Lkp.App_ID)) && (Isnull(Customer_name) != Isnull(Lkp.Customer_name) || Isnull(CPC_Center) != Isnull(Lkp.CPC_Center))

Pls help me to slove it .

Many thanks,

Hong

Extract "lineageId and Name" from sysssispackages Using XQuery

$
0
0

Hi All,

can someone help me, how to Extract "lineageId and Name" from sysssispackages?

Below query gives me the XML structure of SSIS package but need to pull only those 2 values from that

SELECT  
       Package= CAST(CAST(packagedata AS VARBINARY(MAX)) AS XML) 
    FROM      [msdb].[dbo].[sysssispackages]
    
 

Thanks


Role of left input and right input in merge join

$
0
0

Hi All

I really appreciate if someone explain me the difference between left input and right input in Merge Join.

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>