Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Checkpoint - Always run initial task

$
0
0

With newer versions of SSIS, has anyone figured out a way to configure an SSIS package to always run an initial task on restart?  I have played with PreValidation,PreExecution event handlers on the package, failing the initial task, but continuing, hoping checkpoint would recognize the initial failure and run that, skip by successful steps, etc. 

I'm guessing I could copy and paste the task as a pre-execution Event handler on every step in the package, but hoping there is a more simplistic method?


Connecting the Sharepoint List using SharePoint List source in SSIS however list accessible via browser, not works in SSIS

$
0
0

I want to import the SharePoint list data into SQL server DB.  Using SharePoint List source item  in SSIS can connect to the Share point List , but am when try to enter the site url and refresh the connection am able to get below error message.

Error at Data Flow Task [SharePoint List Source [1]]: System.ServiceModel.Security.MessageSecurityException: The HTTP request was forbidden with client authentication scheme 'Ntlm'. ---> System.Net.WebException: The remote server returned an error: (403) Forbidden.
   at System.Net.HttpWebRequest.GetResponse()
   at System.ServiceModel.Channels.HttpChannelFactory`1.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout)
   --- End of

https://social.msdn.microsoft.com/Forums/sqlserver/en-US/59863e39-d4f1-49fb-962e-9c9e431f8e76/connecting-the-sharepoint-list-on-office-365-to-sharepoint-list-source-in-ssms?forum=sharepointdevelopment

Elegant way for allow Integration Services

$
0
0

Hi,

This issue is related to https://social.msdn.microsoft.com/Forums/silverlight/en-US/a90b957b-c58f-4beb-b8b2-5723c4489fa1/is-instance-does-not-work-after-fresh-installation?forum=sqlintegrationservices

From my SSMS local box I got this message.
'RPC server is unavailable".

Googling I've discovered that turning off my firewall at domain level works the connection remotely from any domain machine.

But I wonder, is there some elegant solution avoiding to open the firewall?

Thanks for your support and time,

How to load .DAT file data into SQL server?

$
0
0

Hi,

 I have .DAT file. I have to load data from .DAT file into SQL server using SSIS. Please give me the solution.


Using a variable for Excel Openrowset sheet range

$
0
0

Hello, Please I have excel files that I receive with different sheet names, and the record I want to use starts from a specific range like sheet1$A3:DH4

I was able to get the sheetname as a variable using scripttask, so my question is how can I dynamically populate this range value using the sheetname. Thanks

Easy Access to Data Type of Existing Columns in Data Conversion Task

$
0
0
I have a number of Unicode fields that I need to convert to non-unicode with Data Conversion Task but I don't see the Data Type as an additional column next to the column name in the designer. It will be handy to have it there so it is easy to select the columns required with a specific data type. 

Invalid Character Value For Cast Spefication on SSIS 2012

$
0
0

Hi,

We're trying to upgrade our SSIS 2005 packages to 2012 and I encountered a casting/invalid character issue in Data Flow Task.

This table will get populated by a pipe-delimited file

CREATE TABLE [dbo].[STKORD]
(
[Catalogue] [varchar] (255) COLLATE Latin1_General_CI_AS NULL,
[Title] [varchar] (255) COLLATE Latin1_General_CI_AS NULL,
[Total Stk Avail] [int] NULL,
[Stk on Order] [int] NULL,
[Rank] [varchar] (255) COLLATE Latin1_General_CI_AS NULL,
[QOH] [int] NULL,
[Allocated] [int] NULL,
[Reserved] [int] NULL,
[BackOrd] [int] NULL,
[WIP] [int] NULL,
[Cleared] [int] NULL,
[Held] [int] NULL
) ON [PRIMARY]
GO

Data Flow

This used to be working in 2005 but not in 2012.

Now my question is, does 2005 handle casting better over 2012? Which forces me to add a Data Conversion task in 2012?

Many thanks.


SSIS Loop Condition For or For Each loop

$
0
0

Hello..

I have a scenario where i have a table like below and trying to use for loop untill the Status is Y and want to assign the date to variable when the first instance of Y occurred (ordering the data on date desc) really appreciate any help!

DateStatus
11/28/2016Y
11/29/2016Y
11/30/2016N
12/1/2016N
12/2/2016N


Using Attunity Drivers 3.0 in Visual Studio 2015 Preview

$
0
0

Hi,

We currently use Attunity SSIS Connectors v2.0 for Oracle with SQL Server 2012 Integration services within the Visual Studio 2012 IDE.

We are moving to SQL 2014 and want to leverage Visual Studio 2015 SSDT as this now includes all the BI projects (SSIS, SSAS, SSRS) + SSDT and integrated with Visual Team Services. We are testing the dev tools prior to the upgrade.

I have installed the version 3.0 Attunity SSIS Connectors for Oracle (both 32bit and 64bit) which states that is works for VS 2013+, but the Connection type is not available within my Visual Studio 2015 SSIS project.

So my question is - are the Attunity SSIS Connectors v3.0 for Oracle supposed to be compatible with VS 2015, and if not, is there expected to be an update in the future?

Kind Regards,

James

The provider 'SQLNCLI11' is not registered.

$
0
0

I am getting following error while importing data from azure DW <g class="gr_ gr_18 gr-alert gr_spell gr_run_anim ContextualSpelling ins-del multiReplace" data-gr-id="18" id="18">intodimensional</g> model of tabularProject.

Failed to save modifications to the server. <g class="gr_ gr_28 gr-alert gr_gramm gr_run_anim Grammar multiReplace" data-gr-id="28" id="28">Error</g> returned: 'The provider 'SQLNCLI11' is not registered.



Technical Details:

RootActivityId: a57f17e8-30cd-4cfe-93b1-db3c1115a079

Date (UTC): 11/29/2016 12:28:59 PM

The following system error occurred:  Class not registered 

A connection could not be made to the data source with the Name of '<datasoursename>'.

Please help.


Execute rowcount query and pass value as variable in a control flow

$
0
0

I know there is an abundance of information out there regarding what i am trying to do, and i have tried many of them with no luck.  I am sure it is something simple i am missing.  As usual, suggestions are gratefully welcomed !

I am using INTERSECT to find the duplicated between 2 tables.  I am obtaining the @@ROWCOUNT and assigning it to a column.  The query is such:

USE edgp
GO

SELECT @@RowCount as RCD1
FROM
(
 SELECT
   [txpid]
  ,[txpname]
  ,[txpadd1]
  ,[txpadd2]
  ,[txpcity]
  ,[txpst]
  ,[txpzip]
  ,[txphone]
  ,[txp_contac]
  ,[txpdba]
  ,[txp_begin]
  ,[phyadd1]
  ,[phyadd2]
  ,[phycity]
  ,[physt]
  ,[phyzip]
  ,[naic]
  ,[naic_desc]
  ,[Month]
 FROM edgp.DBO.EconDev_NewBusinessLicenses_Geocoded
 INTERSECT
 SELECT
   [txpid]
  ,[txpname]
  ,[txpadd1]
  ,[txpadd2]
  ,[txpcity]
  ,[txpst]
  ,[txpzip]
  ,[txphone]
  ,[txp_contac]
  ,[txpdba]
  ,[txp_begin]
  ,[phyadd1]
  ,[phyadd2]
  ,[phycity]
  ,[physt]
  ,[phyzip]
  ,[naic]
  ,[naic_desc]
  ,[Month]
 FROM edgp.DBO.EconDev_NewBusinessLicenses_2016
) D;

SELECT @@RowCount as [RCD]

The control flow is very simple, if duplicates exist, do not merge and exit.  If all values are unique, merge to the master data set.

I have set the execute SQL task general section as such:

Result set, i have created a variable User::RowCountDuplicate as int32 with value 0 (zero).  I have tried the value 0 and RCD as the Result Name, neither worked.

Based on the @@ROWCOUNT, i have set up constraint and expression:

When executing, this is the output I get:

SSIS package "C:\Users\oliver\documents\visual studio 2010\projects\NBL\NBL\Merge.dtsx" starting.
Error: 0x0 at Execute INTERSECT to detect duplicates before merging, want to avoid multi-merges of same dataset: No result rowset is associated with the execution of this query.
Error: 0xC002F309 at Execute INTERSECT to detect duplicates before merging, want to avoid multi-merges of same dataset, Execute SQL Task: An error occurred while assigning a value to variable "RowCountDuplicate": "Exception from HRESULT: 0xC0015005".

I think that covers it.  Again, I appreciate the help !


Issue on lookup column mapping

$
0
0

Hi,

    On mapping columns in available column into look column showing error

Cannot map the input column, 'ROWNUMBER_SL_NO', to the lookup column, 'ROW_SLNO', because the data types do not match.

for the both column datatype is int in db, also showing this error

can  any one help me

thanks in advance

Warning_1_Validation warning. Data Flow Task: {ADCB80C9-E3E8-451C-81CE-D6FE2FBF453E}: Truncation may occur due to inserting data from data flow column "PRP_PST_TAG" with a length of 9 to database column "PRP_PST_TAG" with a length of 3. _DWH_TO_BSI_DAILY

$
0
0

Hi,

There is a SSIS package by which data is beng pulled from a table or oracle database to a table of SQL server database. But today application table change some column in Oracle table for which SSIS package is throwing following error-

Warning1 Validation warning. Data Flow Task: {ADCB80C9-E3E8-451C-81CE-D6FE2FBF453E}: Truncation may occur due to inserting data from data flow column "PRP_PST_TAG" with a length of 9 to database column "PRP_PST_TAG" with a length of 3.  DWH_TO_BSI_DAILY.dtsx00

There are 25 column in the table and it is showing 22 warning which mens 22 of the column type was changed.

It has a associated job in SQL server agent which is showing below error-

Executed as user: GRAMEENPHONE\gpdba. Microsoft (R) SQL Server Execute Package Utility  Version 11.0.5058.0 for 64-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  4:33:27 PM  Error: 2016-11-27 16:50:06.26    Code: 0xC0202009     Source: Data Flow Task OLE DB Destination [2]     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E21.  An OLE DB record is available.  Source:"Microsoft SQL Server Native Client 11.0"  Hresult: 0x80040E21  Description: "Multiple-step OLE DB operation generated errors. Check each OLE DB status value, if available. No work was done.".  End Error  Error: 2016-11-27 16:50:06.26     Code: 0xC020901C     Source: Data Flow Task OLE DB Destination [2]     Description: There was an error with OLE DB Destination.Inputs[OLE DB Destination Input].Columns[PRP_PST_TAG] on OLE DB Destination.Inputs[OLE DB Destination Input]. The column status returned was: "The value could not be converted because of a potential loss of data.".  End Error  Error: 2016-11-27 16:50:06.26     Code: 0xC0209029     Source: Data Flow Task OLE DB Destination [2]     Description: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "OLE DB Destination.Inputs[OLE DB Destination Input]" failed because error code 0xC0209077 occurred, and the error row disposition on"OLE DB Destination.Inputs[OLE DB Destination Input]" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure. End Error  Error: 2016-11-27 16:50:06.26     Code: 0xC0047022     Source: Data Flow Task SSIS.Pipeline     Description: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "OLE DB Destination" (2) failed with error code 0xC0209029 while processing input "OLE DB Destination Input" (15). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.  End Error  Error: 2016-11-27 16:50:06.28     Code: 0xC02020C4     Source: Data Flow Task OLE DB Source [69]     Description: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.  End Error  Error: 2016-11-27 16:50:06.30     Code: 0xC0047038     Source: Data Flow Task SSIS.Pipeline     Description: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on OLE DB Source returned error code 0xC02020C4.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  4:33:27 PM  Finished: 4:50:06 PM  Elapsed:  998.734 seconds.  The package execution failed.  The step failed.

Can you tell me how to fix it? Do I have to recompile the SSIS pakage? If so, how to recompile SSIS package?

SSIS for Moving Data Between Oracle Servers and Encryption

$
0
0

Hi,

We are using SQL Server 2012 SSIS for doing ETL operations where the the Source and Destination Databases are both Oracle (to be more accurate we are moving data between two different schemas on the same Oracle DB).

As the data being transferred contains PHI information - we need to ensure it is encrypted - what approaches are available to ensure that the data is encrypted during the transfer using SSIS?

Regards,

Vikram

The component "Oracle Source" cannot run on installed Standard Edition of Integration Services. It requires Enterprise Edition or higher.

$
0
0

Hi Guys,

I'm using Oracle Attunity (Source & DEstination) in SSIS. In BIDS it is running fine. But When I've deployed in SQL agent. I'm getting the below problem. Please help me at the earliest.

Error: 2013-08-03 07:18:18.28
   Code: 0xC00470FE
   Source: ATG to Martini SSIS.Pipeline
   Description: SSIS Error Code DTS_E_PRODUCTLEVELTOLOW.  The component "ATG CusID's" (1) cannot run on installed Standard Edition of Integration Services. It requires Enterprise Edition or higher.
End Error

Server Version

Microsoft SQL Server Management Studio                        10.50.4000.0
Microsoft Analysis Services Client Tools                        10.50.4000.0
Microsoft Data Access Components (MDAC)                        6.1.7601.17514
Microsoft MSXML                        3.0 6.0
Microsoft Internet Explorer                        9.0.8112.16421
Microsoft .NET Framework                        2.0.50727.5472
Operating System                        6.1.7601



Need to export the SQL table data to XML file using SSIS

$
0
0

Hi All,

I am having a task where I need to pull the data of different tables to XML files, and the connection we are using here is Oracle (TOAD). I need to do this task using SSIS. I have came across many of the blogs but did not get the exact solution for it. Can someone help me in this?

Thanks in Advance..


Aparanjit

Problem in installing integration services for sql server 2008 R2

$
0
0
I tried to install Sql server 2008 R2. While installing it is not showing the option for enabling integration services and analysis services. I installed Visual studio 2012 separately but for deployment its not working. How to fix it???

SSIS catalog

$
0
0

here we are using cluster for SQL server 2012. 

We deploy SSIS catalog. So still need to startup "integration services" to deploy the SSIS package, or run package ?

SSIS Balanced Data Distributor - the package is not running SQL Server 2014 and BIDS for 2015

$
0
0

Hi 

When I try to run a package that contents the componenet Balanced Data Distributor by the SSISDB (Integration Service Catalogs) is not working. My environment: SQL Server 2014 and SQL Server Data ools 2015

And the TxBDD.dll exists here:

C:\Program Files (x86)\Microsoft SQL Server\110\DTS\PipelineComponents

C:\Program Files (x86)\Microsoft SQL Server\120\DTS\PipelineComponents

C:\Program Files (x86)\Microsoft SQL Server\130\DTS\PipelineComponents

The error message are:

Error: The component is missing, not registered, not upgradeable, or missing required interfaces. The contact information for this component is "Balanced Data Distributor;Microsoft Corporation; Microsoft SQL Server; (C) Microsoft Corporation; All Rights Reserved; http://www.microsoft.com/sql/support;0".

Error: Balanced Data Distributor failed validation and returned error code 0xC0048021.

Error: Component "Balanced Data Distributor, clsid {77E9F664-6D5E-420B-962B-2E87E61897BE}" could not be created and returned error code 0x80070005 "Access is denied.". Make sure that the component is registered correctly.

Warning: Cannot find the "CurrentVersion" value for component {77E9F664-6D5E-420B-962B-2E87E61897BE}. The CurrentVersion value for the component cannot be located. This error occurs if the component has not set its registry information to contain a CurrentVersion value in the DTSInfo section. This message occurs during component development, or when the component is used in a package, if the component is not registered properly.

Thanks for help!

How to split Excel file data into 30:70 ratio into two seperate excel file.

$
0
0

Hi,

I have a excel file having some data and want to generate 2 different excel file having data into 30:70 ratio of original data.

How we can do this using SSIS ?

Example: I have Excel file A - 100 Record.

and want to generate 2 different excel B and C using Excel - A.

Excel B - should be 30 record

Excel C - should be 70 record


Regards, Bijay Maurya

Viewing all 24688 articles
Browse latest View live


Latest Images

<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>