Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

LookUp ETL Design

August 14, 2012, 7:24 am
$
0
0

Hi, 

I have a sql query which contains sourceid, consumerfirstname, consumerlastname, emailaddress, addressline1, addressline2, city, state, zipcode 

I need to populate AddressInstance table upon looking up key values in two different tables ( consumer and address ). The addressinstance table does contain foriegnkeys referencing the consumer and address tables. 

I have already populated the consumer table and the address table . 

I would want to know how can I better design my package to populate the addressinstance table .

I tried with the following approach but it is NOT efficient at all. Takes very long time:

1. I have my source query as oledb source in the data flow task . The source query contains ( sourceid, consumerfirstname,  consumerlastname,emailaddress, addressline1, addressline2, city, state, zipcode )

2. I used the Multicast transformation to use 2 look ups on the same query: The first lookup to get the consumerkey from the consumer table based on the consumerfirstname, consumerlastname, sourceid, emailaddress. The second lookup to get the address key from the address table based on the addressline1, addressline2, city, state, zipcode match. 

3. In this way the 2 lookups work in parallel. I am not sure if this is the right approach as it took a massive amount of time for 130000 records. Please suggest a  better approach to design the package so that I can populate the addressintance table ( consumerkey and addresskey - looking up key values in consumer and address table.

Thanks 

EVA05

↧
Search

DataTools SSIS Package Sort By Name doesn't work

August 14, 2012, 11:29 am
$
0
0

The sort by name option in DataTools/SSIS 2012 does not appear to work correctly any more.

For example:

Initially the sort by name option works:

But after doing a Save-All/Close Solution/Re-open - it's back at the state in the first screen shot.

I first noticed this in a very large solution and thought that TFS may have something to do with it, however this test package I have created and in the screenshots above is not included in any version control.

Even if I create the packages in the order I want, say creating A Package, then B Package, then C Package, and on and on, it'll be sorted in order when I save, but when I re-open the solution it's in the reverse order of what it was previously. So, it appears that the sort by name is NOT working, and that while the sort order used in the IDE is created datetime ascending, the sort order when you re-open a solution is created datetime descending.

All in all, it makes it rather difficult to have any sort order within an SSIS solution in 2012.

↧
↧

multiply with the qty value(with multiple dots like 1.1.1.1)

August 14, 2012, 11:43 am
$
0
0

Hi Gurus,

I have  a requirement to calculate "Result" column as below: Here, we are multiplying by taking the Item# by an integer. lets take ex:  for (1,1.1,1.2) the qty is 5 for Item# 1. So, for each qty in like 1.1,1.2 we multiply by 5  so we get 10,5 resp.  in the result column. How can I do this in SSIS . Please help me with this.

Item# qty     Result
1         5           5
1.1       2           (2*5)=10
1.2       1           (1*5)=5
1.2.1     2           (2*1*5) =10
1.2.2     3           (3*2*1*5)=30     
2         3           3
2.1       1           (1*3)=3
2.2       2           (2*3)=6
2.3       2           (2*3)=6
2.3.1     1           (1*2*3)=6
2.3.1.1   2       (2*1*2*3)=12

It's been answered by SSISJoost here before but now I got a requirement with the extra dots  like upto 7 dots. (such that I cannot convert to int. like in this post)

Please help me with this.

↧

SSIS SMS TASK

August 14, 2012, 5:50 am
↧

Service.Model calls within SSIS Script Task: "no endpoint element matching this contract could be found"

August 14, 2012, 2:59 pm
$
0
0

Techies--

I am using mssql2008 r2;bids vs2008 in an attempt to access a vendor's wcf service through a script task.  Before moving to SSIS, I tested the methods I planned to use with a simple C# console client app. The core service is the same in both the SSIS script task and the test app.  I changed the contract name in the app.config file to look like: 

contract = "ST_namefoscript999zz99999999s9ss9blahblah22x.csproj.RemoteVendorService.IRemoveVendorService"

Say this isn't so: http://www.sqldevelop.org/sql-server-integration-services/import-data-from-wcf-service-with-no-conrol-of-the-wcf-code-4491.shtml

These bindings from this vendor also happen to be custom--so, manually assiging values as suggested in the link above for http bindings may not be the complete answer.

Is the service.model portion of the app.config file in SSIS/script task ignored?

↧
↧

Unable to find an entry point named 'DTSSKUIsWKGorUnder' in DLL 'dts'.

January 6, 2011, 6:04 pm
$
0
0

Hello,

 

I'm having trouble with the SQL 2008 Package Installation Wizard. When I try and deploy the packages using the wizard (I have about a dozen and want to save time by using the wizard), I get the following error:

===================================

Unexpected error occurred. (Package Installation Wizard)

===================================

Unable to find an entry point named 'DTSSKUIsWKGorUnder' in DLL 'dts'. (DTSInstall)

------------------------------
Program Location:

at Microsoft.SqlServer.Dts.Deployment.NativeMethods.DTSSKUIsWKGorUnder()
at Microsoft.SqlServer.Dts.Deployment.PackageInstallationWizardForm..ctor()
at Microsoft.SqlServer.Dts.Deployment.PackageInstaller.Main(String[] args)

Dave SQL Developer
↧

Moving Data From one SQL Server to Another in SSIS???

July 27, 2012, 8:08 am
$
0
0

Hello every one,

I have scenario where I need to move one SQL Server As A Tables to another SQL Server As B, both are on different remote systems. When I am trying to configure OLEDB source  for server A, I do not see the Databases under that server which I have provided?? 

Any suggestions on this..

Thanks

Please Help People When they need..!!

↧

Error while fetching data from DB2 using Microsoft OLE DB Provider for DB2

August 7, 2012, 10:28 pm
$
0
0

Hi,

I am using Microsoft OLE DB Provider for DB2 Version 2 for connecting to DB2 from SSIS. I am able yo connect, however I get following errors while fetching data from DB2. 

1.DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80040E14. An OLE DB record is available. Source: "Microsoft DB2 OLE DB Provider" Hresult: 0x80040E14 Description: "An internal network library error has occurred. The requested command encountered an implementation-specific error condition on the target system. SQLSTATE: HY000, SQLCODE: -270".

2.OLE DB Source" (5198) failed the pre-execute phase and returned error code 0xC0202009.

Can you please help me asap ?

Thanks

Yogesh Saravate.

↧
Search

Having An Row Count Inside SSIS without Row Number Transformation

August 6, 2012, 12:04 pm
$
0
0

Hi all ,

I had this issue of creating a column which shows how many entries have been made in the table .

I have got answer and thought it might help you.

Shaik ,Rasool

↧
↧

Error Updating NTEXT Column in SharePoint List Using SP List Destination

July 31, 2012, 12:05 pm
$
0
0

I am getting an error when I try to update (or insert) data into a SharePoint List Multi-Row field. The field's property is set to NTEXT. I have tried changing the datatype of the data being written to that field from WSTR to NTEXT and everything in between, but it always throws an error. If I omit sending data to those columns, my task runs fine.

[SharePoint List Destination [653]] Error: System.ServiceModel.ProtocolException: The remote server returned an unexpected response: (400) Bad Request. ---> System.Net.WebException: The remote server returned an error: (400) Bad Request. at System.Net.HttpWebRequest.GetResponse() at System.ServiceModel.Channels.HttpChannelFactory.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout) --- End of inner exception stack trace --- Server stack trace: at System.ServiceModel.Channels.HttpChannelUtilities.ValidateRequestReplyResponse(HttpWebRequest request, HttpWebResponse response, HttpChannelFactory factory, WebException responseException, ChannelBinding channelBinding) at System.ServiceModel.Channels.HttpChannelFactory.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout) at System.ServiceModel.Channels.RequestChannel.Request(Message message, TimeSpan timeout) at System.ServiceModel.Dispatcher.RequestChannelBinder.Request(Message message, TimeSpan timeout) at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout) at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs) at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation) at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message) Exception rethrown at [0]: at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg) at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type) at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListsService.ListsSoap.UpdateListItems(UpdateListItemsRequest request) at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListsService.ListsSoapClient.ListsService_ListsSoap_UpdateListItems(UpdateListItemsRequest request) at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListsService.ListsSoapClient.UpdateListItems(String listName, XElement updates) at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.ExecuteSharePointUpdateBatch(String listName, String viewId, XElement batchXml, Int16 batchSize) at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListServiceUtility.UpdateListItems(Uri sharepointUri, NetworkCredential credentials, String listName, String viewName, IEnumerable`1 fieldValueList, Int16 batchSize) at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListDestination.ProcessInput(Int32 inputID, PipelineBuffer buffer) at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostProcessInput(IDTSManagedComponentWrapper100 wrapper, Int32 inputID, IDTSBuffer100 pDTSBuffer, IntPtr bufferWirePacket)

How do you update SharePoint Lists NTEXT Columns using SSIS?

Thanks,

Lee

↧

SSIS custom data source component - buffer overflow handling

August 14, 2012, 8:27 am
$
0
0
Developing a SQL Server Integration Services Custom Data Source Data Flow Component. 

SSIS has a maximum buffer size and row limit to "chunk" work based on buffer size. 

This requires a source component to recognize when the buffer is full, and then suspend until another buffer is available and resume loading from the source to the new buffer.

What I don't see covered anywhere is:
 - how to effectively deal with a full buffer 
    > calculate the size, count rows and ensure closing the buffer before overflow (except that I can't see how to get the max size or max rows from the parent data flow task)
    > wait for a buffer overflow exception and rewind to the last row/bytes written to resume with a new buffer.
 - how to store the "bytes/rows to skip" information for the component to pick up the next time it's invoked by SSIS.

Neil Thomson

↧

Converting DTS Packages to Stored Procedures

August 14, 2012, 5:15 pm
$
0
0

Hi,

I have DTS packages and i need to convert those DTS packages to Stored Procedures in SQL Server 2008 R2.

Some one please help me...how to do this process.

Regards, shiva

↧

multiply with the qty value.

July 25, 2012, 8:58 am
$
0
0

Hi Gurus,

I have  a requirement to calculate "Result" column as below: Here, we are multiplying by taking the Item# by an integer. lets take ex:  for (1,1.1,1.2) the qty is 5 for Item# 1. So, for each qty in like 1.1,1.2 we multiply by 5  so we get 10,5 resp.  in the result column. How can I do this in SSIS . Please help me with this.

Item# qty     Result
1          5           5 
1.1       2         10
1.2       1           5
2          3           3
2.1       1           3
2.2       2           6
2.3       2           6

↧
↧

DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER Error

August 14, 2012, 8:07 pm
$
0
0

Hi,

I am getting an error  DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager  failed with error code 0xC0209303.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

 This job used to run fine till last month and nothing ( job nor the database permissions changed after that ) . I try to create new table and update it still it does not work

Any help would be greatly appreciated

Thanks,

shek

↧

Dynamic SQL Command in ODBC connecting to Oracle RDB

August 14, 2012, 7:37 pm
$
0
0

Hello -- I need your help, I need to extract data from Oracle RDB (via ODBC) but the SQL Command needs to be dynamic.  We need to compute the Date based on the set parameter in the SQL Database.

Hope you can help me on this concern.


Btw... we're using SSIS 2008
↧
Search

how we insert data into excel if the size of the dat exceeds?

August 14, 2012, 8:54 pm
$
0
0

could you please any one provide solution for this problem....

using ssis, i am loading the data from flat file(text file)  to Excel destination.

source has two columns: empid   empdata(nearly 2,50,000)

i got the error that size exceeds for inserting that data because each cell having the capacity of 32,765 in excel 2007.

Am also used excel 2010 also ,same problem repeted?

please provide a solution foe me...

↧

Problem Executing "Execute SQL Task" in SSIS with LDAP

August 14, 2012, 5:59 am
$
0
0

Hi All,

I am in the middle to developing a SSIS 2005 package that reading some data from the LDAP server.

I having problem to read the LDAP data. I am using some sample public server that provided by http://www.ldapadministrator.com/. I able to view with the LDAP browser but fail to read with SSIS.

I tried all the methods in the link below

http://social.technet.microsoft.com/wiki/contents/articles/processing-active-directory-information-in-ssis.aspx?CommentPosted=true#commentmessage

but i still fail. Please help if anyone encounter the same issue. I have no idea where to look into now, because from the connection manager when i do the test connection it always show success >.<"

↧
↧

How to use Cache Transform in SSIS

August 8, 2012, 5:18 am
$
0
0

Hi,

I am using "Cache Transform" in my SSIS Package to prevent duplicate records to insert in sql table from excel search by Name.

can you help me that how to set "Cache Transform" for this

↧

Error: 0xC002F304 at WMI Data Reader Task, WMI Data Reader Task: An error occurred with the following error message: "Invalid class ".

August 14, 2012, 7:39 am
$
0
0

Hi,

When i am trying to connect to to my remote server using the WMI Data Reader Task i am receiving the below mentioned error:

Error: 0xC002F304 at WMI Data Reader Task, WMI Data Reader Task: An error occurred with the following error message: "Invalid class ".

The query i use is SELECT FreeSpace, DeviceId, Size, SystemName, Description FROM Win32_LlogicalDisk, please find below the screenshot of my WMI Data Reader task:

Ramasubramanian S

↧

Folder locked

August 8, 2012, 9:38 pm
$
0
0

Hi,

we have 14 packages. we are developing looging functionality  log provider for text files.once deploy the all packges into server we face faceing following issue.

issue:

 first package generate the text file  next package trying to generate the file in same folder with diffrent name geting error "Folder is locked".

how can we come out from this problem..

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>