Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Logging the conditions within a conditional split transformation (SQL Server 2012 and 2016)

September 25, 2018, 11:57 am
$
0
0

Hi,

I'm struggling to find out how we can store the conditions inside a conditional split transformation when we run a package. I need a snapshot of the expressions (the whole expressions, not only parameters inside them).

The closest we have got is when an error triggered the SSIS logging and stored the context in the table event_message_context, but we can't figure out how to trigger this logging without an error. We don't need it specifically to come from the built-in logging, we can surely use a script task if you have any suggestions. We run both SQL server 2012 and 2016.

Thanks

↧
Search

SSIS Error : Connection is busy with results for another command

October 11, 2018, 1:51 am
$
0
0

SQL SERVER 2017 Enterprise Edition | Windows server 2016

While execution of SSIS packages via sql job  one of the child package failed with below mentioned error 

Extract and load XXXX.DTSX : Error SSIS error code DTS_E_OLEDBERROR. AN OLE DB error has occurred. Error COde :0x80004005.

An OLE DB record is avaliable. Source "Microsoft SQL Server Native CLient 11.0" Hresult : 0x80004005

Description :  "umspecified Error"

An OLE DB record is avaliable. Source "Microsoft SQL Server Native CLient 11.0" Hresult : 0x80004005

Description "connection is busy with results for another command"


↧
↧

Grouping in SSIS and derive columns

October 9, 2018, 3:04 am
$
0
0

Hi All, 

I'm deriving some columns as shown below as inputs: 

Input: 
c1 c2 c3 c4 c5 
1  2  3  4  5
1  3  6  7  8 
1  2  3  9  4 
4  5  6  9  7  
1  1  3  3  2  
4  5  6  5  2 

I want output something like this: 

output: 
c1 c2 c3 c4 
1  2  3  4:5&&9:4
4  5  6  9:7&&5:2   

When c1, c2, c3 are same, combine contents of c4 and c5 with a ":" in between and "&&" separation when there are more rows grouped based on c1, c2 and c3. 

Please le me know if you have any inputs to achieve this in SSIS. 

Thanks,

Vikram  

↧

Microsoft.SQLServer.ManagedDTS - Package fails in managed code but works running dtexec

March 18, 2013, 3:55 pm
$
0
0

Hi All,

Long time reader-  first time poster - and I'm stuck! :(

I have a .Net 4.5 framework application built in VS 2012 that runs SSIS packages on SQL Server 2008 R2 enterprise. It is a console based app and is designed to be run locally on the SSIS server.

I am using Microsoft.SQLServer.ManagedDTS version 10.50.1600.1 and have confirmed that this is the version being referenced by my project on my dev machine and is the same installed in the GAC on the SSIS server.

The tool successfully starts and runs a number of different packages, however it fails when it hits a package that has the Partition Processing destination component and gives the error:

        Component "component "Partition Processing1" (49)" could not be created and returned error code 0xC1000002. Make sure that the component is registered correctly.

        Data Flow Task

        The component is missing, not registered, not upgradeable, or missing required interfaces. The contact information for this component is "".

Now here is the kicker - if I run the same package using dtsexec on the same machine (integration services) it works!

My feeling is this has *something* to do with this component being an enterprise edition component and the referenced assembly of Microsoft.SQLserver.Dts.Runtime not being the correct version.

Any ideas would be greatly appreciated

Thanks Sean

↧

SSIS Package : Attaching file with SSIS by matching filename in Folder with value in SQL table.

October 11, 2018, 6:54 am
$
0
0

Hello Everyone,
I am new to SSIS packages, Could you please help me with the below scenario:

I have a SQL query which gives me the CustomerID, Email, First name, last name

Query: Select distinct Customerid, Email, FirstName, LastName from CustomrData. 

The above query returns the data : 

CustomerIDEmailFirstNameLastName
84740 pauldaryl@gmail.compaulDarryl
106170 RickNegan@hotmail.comRickNegan
119520  FlorenceMicheal@aol.comFlorenceMicheal

and then I have pdf attachments in afolder A where filenames are like

CustomerRefer_90_84740
Mailingletter_89_106170
HoldingRequest_12_119520

I want to match each Customer ID with filename's last characters after second '_' and then email that particular pdf to a corresponding email address. (Example: 'CustomerRefer_90_84740' pdf should be emailed to pauldaryl@gmail.com). Once the PDF is emailed to the customer, the corresponding PDF should be moved to another folder B.

I should set up this SSIS package as job daily. Someone, please help it would be grateful. Thanks

↧
↧

Unable to transfer data from sage100 crm to SQL server database

October 11, 2018, 8:01 am
$
0
0

Hi all,

I have an important requirement of transferring data from sage100 crm -> SQL server 2017 -> Dynamics 365 for visualizations. I am able to retrieve the resultset in linked servers but not in the specific database outside of linked server. So far I tried the following and haven't succeeded since last week.

1. Created ODBC driver for sage100 as given in their documentation by the given link:

https://sagecity.na.sage.com/support_communities/sage100_erp/f/sage-100-technical-and-installation-discussions/69119/64-bit-odbc-connection-to-mas-4-5-installation

However I can view tables in linked server objects not their schemas. I tried to use SSIS for mapping but it's not working.

2. I tried to use the import wizard as specified in this link:

https://sagecity.na.sage.com/support_communities/sage100_erp/f/sage-100-technical-and-installation-discussions/84037/how-to-copy-tables-from-sage-2014-to-a-new-database-on-sql-server-2008-r2

I get the same error as specified in this link and realized that the datatype isn't matching with the one in SQL. For example, when I checked out the mapping for Date column name in the import wizard, I found out datatype as '23' which is very weird. 

I tried asking the sage community forums too but no one has replied yet.

Can someone help me on this?

Thanks.

↧

How do we convert SQL Server Data Type [timestamp] and [uniqueidentifier] in a SSIS Data Pump

October 11, 2018, 9:19 am
$
0
0

So our source data has a data column type defined as [timestamp] and looks kind of cryptique; for example 0x00000000001F655E

We also have a data column defined with data type [uniqueidentifier] which sure looks like a GUID; for example F59B9A47-0F43-493D-8850-A4094AA57B6D

How do we convert these in SSIS using a Data Flow Task and a Data Conversion Task?

Interesting enough, when I pulled the Azure Database using VSTS and Git, the local database table column with the [timestamp] format is defined as [rowversion] but if I look at that same local database table in SQL Server Management Studio, it is defined as [timestamp]. Is this some sort of Visual Studio issue?

Thanks for your review and am hopeful for a reply.

↧

SSIS : Microsoft OLE DB Provider for SQL Server - Connection is busy with results for another command

October 10, 2008, 7:11 am
$
0
0

Hi,

 

I am working on a SSIS package which has two data flow tasks enlisted in a single transaction. I am not using MS DTC and trying to use SQL Native transaction (BEGIN & COMMIT Transaction in two different EXECUTE SQL tasks). The package is being used to load data from a feed and its records should go in two separate tables - one is a parent table (Book) and another one is Child table (Book Traders). 


The package is something like this:

 

(has OLE DB Connection Manager with RetainSameConnection = true)

 

1. Script Task : Set Package parameters, Verify connections etc.

2. Sequence Container:
   a. Execute SQL Task : Begin Transaction
   b. Data Flow Task 1: Reads from feed file. Stuff the data in Book Table. Puts traders info in a raw file.

   c. Data Flow Task 2: Raw file created in previous data flow task is read and identity values (Book IDs) created during data flow task 1 are fetched using Lookup. Conditional Split helps in identifying which trader rows to insert, update or delete.

   d. Execute SQL Task : (if trancount > 1 Commit Transaction)

 

(On Error, if transaction count > 1 ROLLBACK Tran)

 

Whenever I try to run the package, second data flow task (to populate Trader records, it fails with "Microsoft OLE DB Provider for SQL Server"  Hresult: 0x80004005  Description: "Connection is busy with results for another command"

 

How can i resolve this issue? I have even tried to make my connection to use MARS. (As far as i understand, MARS with OLEDB should be avoided though). But still i am getting same problem.

 

Ashish Sharma

 

↧
Search

Protocol Error in TDS Stream in SSIS

September 6, 2016, 6:32 am
$
0
0

Hi Team,

While executing the SSIS package we get the below error message and we don't use Linked server inside the package to pull data from the server. This happens intermittently and for only one package out of the several packages in the solution. Can anybody please suggest me what needs to be looked at to fix this error.

SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80004005  Description:"Protocol error in TDS stream".  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80004005  Description: "Protocol error in TDS stream".  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80004005  Description: "Protocol error in TDS stream". 

↧
↧

SQL Server Import and Export Wizard seemed to fail on a Synonym

October 11, 2018, 11:53 am
$
0
0

Got this error message when attempting to use the SQL Server Import and Export Wizard in SSIS

===================================

Could not connect source component.

Error 0xc0202009: Source 77 - TimeZoneByZip [162]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E37.


Error 0xc02020e8: Source 77 - TimeZoneByZip [162]: Opening a rowset for "[dbo].[TimeZoneByZip]" failed. Check that the object exists in the database.
 (SQL Server Import and Export Wizard)

===================================

Exception from HRESULT: 0xC02020E8 (Microsoft.SqlServer.DTSPipelineWrap)

------------------------------
Program Location:

   at Microsoft.SqlServer.Dts.Pipeline.Wrapper.CManagedComponentWrapperClass.ReinitializeMetaData()
   at Microsoft.SqlServer.Dts.DtsWizard.Execute.SetSourceConnection(Exception& ex, TransformInfo ti)

The "[dbo].[TimeZoneByZip]" is a Synonym and exists in my Destination Database (localdb)

Is this an issue with trying to Import and Export a Synonym? How can I get around this?

Thanks for your review and am hopeful for a reply.

↧

SSIS package job

October 11, 2018, 2:08 pm
$
0
0

Hi,

I have created a package which import data from server A  to server B.  I would like to create a job which runs every month and move the data from server A to Server B.Right now package is using my windows authentication.

My question is if I gave the package to the administrator of server B, who doesn't have permission to server A can he create a job?

What kind of permission I need to set in the package so that they can create job?

Can I push the data from server A to server B,since I have the permission to both server?


Any help will be appreciated.

simam

↧

[Package Configuration Wizard][SQL Server Connection Issue]

October 11, 2018, 5:46 pm
$
0
0

Hi,

In my SSIS package used XML file for my OLEDB connection and loaded the configurations with Package Configuration Wizard which works fine, the problem raises when likes to use this connection for further configurations from this database connection as it is not available in the connections drop down when SQL Sever selecting from Configuration Type.

Please share your thoughts if anyone face the similar problems.

Many Thanks,

Muhammad Yasir



↧

Attunity oracle connector Version 5.0 not working for SSIS 2.0

October 11, 2018, 7:51 pm
$
0
0

Hi,

I had recently upgraded SSDT to 15.8.2 as well as SSIS to 2.0.  However, my packages that contain the Oracle Source are not longer being loaded. Error as below, any ideas?

Severity Code Description Project File Line Suppression State
Error Validation error. WF_PCD_POLICYCLAUSESDTL: WF_PCD_POLICYCLAUSESDTL: The component metadata for "Oracle Source, clsid {ADD1F766-6414-4995-AF01-83C5B7AFC90C}" could not be upgraded to the newer version of the component. The PerformUpgrade method failed. EG Extract - MGA.dtsx 0

Kind regards

Coby

↧
↧

ErrorColumn Could not be tracked when ADO.NET Destination is used. SSIS v2016.

October 12, 2018, 1:26 am
$
0
0

Hi All,

I was attempting to capture error details (ErrorColumn, ErrorDescription) when the package fails to insert data in an SQL Server 2016 table accessed via an ADO.NET Destination. It always returns the ErrorColumn = 0.

The same works well when used a OLEDB Connection for the same SQL Server 2016 table using the standard script task and simple code available online. It returns the ErrorColumn ID correctly.

I understand the usage of OLEDB destination produces the expected result but the constraint at my end is to use a ADO.NET  Destination only.

Could the ADO.NET connection be modified\configured such that it captures the error column correctly.

Please share your inputs.

↧

DBCC command to reseed identity of table inside Execute SQL Task in SSIS

October 12, 2018, 5:27 am
$
0
0

I have a situation in which a fact table is loaded every day.

There are two SSIS packages that load this table.

1) Package1_FullLoad.dtsx - runs every Sunday, with a full refresh

2) Package2_DailyLoad.dtsx - runs on all days except Sundays, deleting and loading the data for the past 14 days alone.

Now, the full load package (Package1_FullLoad.dtsx) has an Execute SQL Task, truncates all the rows from the fact table.

Then the Data Flow loads the fact table from scratch.

In this case the identity value of the fact table starts from 1 and increments by 1, and this is fine, no issue.

However, for the daily load package (Package2_DailyLoad.dtsx), after the DELETE statement (which deletes data for the past 14 days alone), in the Execute SQL Task, I set this code:

DBCC CHECKIDENT('dbo.FactTable', RESEED,1)
DBCC CHECKIDENT('dbo.FactTable', RESEED)

Then I run the data flow to load the data, which inserts only data corresponding to the past 14 days.

Say there are 10 rows in the fact table after the full load (take as an example to illustrate the situation better), and 3 are deleted today and 5 are to be inserted today (insertion and deletion to be done by the daily load package today), the new identity value must start from 8 and end at 12. Instead I see the new identity value starting at 11 and ending at 15.

I do not see any impact in this DBCC code in SSIS Execute SQL Task.

This DBCC code works fine in the SSMS on the database side.

Any idea on how to fix this issue?



↧
Search

SSIS and uknown number of records in Excel. How do I skeep empty one?

October 12, 2018, 6:57 am
$
0
0

We get excel files with known structure but the number of records changes.

I can load the data from excel just fine but I get many empty records.

I really cannot enforce this on marketing so I have to figure out how I can do this.

When I did this in Pentaho and just had to select "Ignore Empty lines" and that is it.

The data is going into staging table and I could filter it there but excel could have a million of empty records

Any ideas?

↧

Trigger the ssis job when source / application tables updated.

October 12, 2018, 10:03 am
$
0
0

Hi ,

I need to trigger a job when my source / application tables gets updated. for each update the job should run. I am new to this concept please send me the possible code.

↧
↧

I aclled the ssis job through triggers when my source data updated.

October 12, 2018, 10:06 am
$
0
0

I have used below code to trigger the job for each update in source.

how can I check update on multiple tables at a time

For eg below is for reference.

CREATE TRIGGER TriggerName

ON TableName1, TableName2,TableName3
AFTER INSERT, UPDATE, DELETE 
AS
EXEC msdb..sp_start_job  -- msdb..sp_stop_job
@job_name = 'JobName';
GO

↧

how to maintain the queue while executing the ssis package.

October 12, 2018, 10:12 am
$
0
0

Hi,

I have a job which I am calling through trigger when my source data is updated. when my job is executing for the updates for        the next immediate update the job should be queue unless the first job gets executed.

↧

Populating Sharepoint list with data from SQL table

October 12, 2018, 12:45 pm
$
0
0
I have an OData source, but not a destination option in SSIS. I need to have a Sharepoint list get loaded nightly from a SQL database. Is SSIS the right tool to use? Can I do it directly from Sharepoint? What's the best way to go about this?
↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>