Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Question on setting a TLS 1.2 value within a SSIS package when connecting to Vendor's URL using a Web Service Task

July 3, 2018, 2:04 pm
$
0
0

We've been connecting to a vendor, Heartland, using a web service task in SSIS to consume our data and bring it down and insert the data into a SQL server table.

This last Wednesday, they upgraded their environment to only accept TLS 1.2 protocols and gave us no notice.  Unfortunately, we can no longer send a request as our connection is immediately closed.

We've been working to find a solution to help us use a TLS 1.2 value within our SSIS package as we cannot make a change on the SQL Server or OS to use the TLS 1.2 protocol because other apps are using TLS 1.0 and TLS 1.1.  

We're working on SQL Server 2014 and SSIS 2013.  Our understanding is that TLS 1.2 is enabled in these environments by default.  But I'm not finding that to be the case.  When I look at the value of this class:  System.Net.ServicePointManager.SecurityProtocol in my C# script were I try to set a TLS value for the security protocol I see Ssl3 | Tls in the AUTOS window.  And when I change the value of the protocol I see Tls12 value.  Then I execute my web service task and get this error:

[Web Service Task] Error: An error occurred with the following error message: "Microsoft.SqlServer.Dts.Tasks.WebServiceTask.WebserviceTaskException: The Web Service threw an error during method execution. The error is: The underlying connection was closed: An unexpected error occurred on a send..
   at Microsoft.SqlServer.Dts.Tasks.WebServiceTask.WebMethodInvokerProxy.InvokeMethod(DTSWebMethodInfo methodInfo, String serviceName, Object connection)
   at Microsoft.SqlServer.Dts.Tasks.WebServiceTask.WebServiceTaskUtil.Invoke(DTSWebMethodInfo methodInfo, String serviceName, Object connection, VariableDispenser taskVariableDispenser)
   at Microsoft.SqlServer.Dts.Tasks.WebServiceTask.WebServiceTask.executeThread()".

Any suggestions on a work around?  Any help/direction would be appreciated. Thanks.

↧
Search

SE

July 4, 2018, 9:53 pm
↧
↧

Cursor vs While loop

July 4, 2018, 9:54 pm
$
0
0
Cursor vs While loop which one need to use performance based?
↧

SSIS Archive files

July 4, 2018, 7:14 pm
$
0
0

Hi, I am having trouble archiving files to a specific folder.

Appreciate your guidance on this.

The scenario is

1. I have an incoming dir with name "PGSmyths"

2. I need to archive folders into the same dir "PGSmyths"

I already have both the directories set up. The package is traversing sub dir.

The Incoming Folder structure is c:\imp\Stub\incoming\yopl c:\imp\Stub\incoming\yopl\PGSmyths And the Archive I:\imp\Stub\Archive\yopl I:\imp\Stub\Archive\yopl\PGSmyths

↧

DT_WSTR to DT_NUMERIC conversion

June 21, 2018, 4:05 am
$
0
0

Hi all,
I'm trying to make a dtsx package to extract data from a Sharepoint list and import it to an Oracle table. I installed the Sharepoint List Adapter from Codeplex.

Some fields in the Sharepoint list are defined as numeric evaluated fields. In the SharePoint List Source the data type of these fields is DT_WSTR(255). In the Oracle table the matching fields are defined as NUMBER(9,0), which corresponds to a DT_NUMERIC type (precision 9, scale 0) in the OLE DB Destination.

If I try to write the data without conversion, in the table I get zeros even if these fields contain some positive integers.

If I try to convert the input data (with a cast operation in a Derived Column component or with a Data Conversion component), I get a runtime error ("An error occurred while attempting to perform a type cast" or "Data conversion failed while converting column "XXX" to column "YYY" .  The conversion returned status value 2 and status text "The value could not be converted because of a potential loss of data.""

How can I solve this issue?

Thank you in advance.


↧
↧

Oracle Provider for OleDB changing automatically

July 3, 2018, 10:10 pm
$
0
0

Hi,<o:p></o:p>

I am using SSIS 2012. I am storing my Connection String and CompanyCode details in a SQL Table for the purpose of dynamic querying and dynamic connection. using Foreach Loop and ADO Enumarator i am getting this details and parameterizing the the connection using a project parameter. My Source database is Oracle and the provider is Oracle provider for OleDB, but after Parameterize, this automatically changing to SQL Server Native Client. when executing getting the following error.<o:p></o:p>

Here with attached my solution and other images also for your reference. How to solve this ?<o:p></o:p>

link to download the attachment 

https://is.gd/yemacu

<o:p>Thanks in advance,</o:p>

<o:p>Karthik K</o:p>

↧

insert records from excel by conditions

July 4, 2018, 7:45 pm
$
0
0

hello all
I have packages that insert excel files into a table by using for loop container (the first step is truncate MRR table and then inserted into MRR table)

one of the fields in the excel is "birthdate"

I was asked to check before inserting the data if the age in the excel file is less then 1 year then insert to MRR table else
insert to a Logfile and write in a field the name of the excel file

my question:
1. how do I create condition before insert data to my db (MRR table) 
2. how do I get the name of excel file and write it to the Logfile (different file in each iteration)

limitation:

**can't calculate age in the excel ***
** the logic continue after MRR table is populated***

**need to be generic so I could use it all packages***

any advice will be appreciate 

↧

connection info disappears every time i close and reopen solution

July 3, 2018, 2:31 pm
$
0
0

Hi. I'm running vs2008. I cloned a package, added two conns and then tried to add them to configs which already had a few configs in , some using a sql table of conn strings.

While the pkg was open everything was ok.  The two new conns showed the familiar "I'm config'd" stripe and test connection worked.  But every time I close and then reopen the pkg, the conn string in the two new conns goes blank and most of the components show the familiar little red circle. 

when I edit one oledb ds in a dft with red circle in advanced editor, I see 2 error sections in the connection managers tab.  The first references error code 0x80004005 and says [ODBC Driver Manager]"data source name not found and no default driver specified".

in the second section it says The AcauireConnection method call to the connection manager "my conn name" failed with error code 0xc0202009.

I remember some confusing rules from way back about adding configs after the fact but don't know if that is related.  I looked at the xml code and don't see any difference in the conns and config tags (when everything is good), at least not one that would indicate they are being treated differently.  The only way I've found to make things look right while the package is open in the deaigner is to delete and readd the conns.  I've tried to delete and readd the configs as well but nothing seems to be helping.  I cant show too much here due to proprietary issues.

 
↧
Search

SSIS package with a Lookup Transformation running slow

July 2, 2018, 2:10 pm
$
0
0
I'm working on an SSIS package that takes a flat file as a source, looks up a value in a table based on 2 fields in the flat file record and writes the fields from the flat file plus the value retrieved to a destination table.  It takes hours to run and I was looking for a way to speed it up.  My flat file contains about 300,000 records.  My Lookup Transformation uses the results of a SQL query which is pretty complex and joins 5 different tables.  Would it be possible and save time to create a temp table from the SQL query which would contain only 3 columns and do a lookup on that? 
↧
↧

SSIS Get the highest ID number and assign ID to the next records

July 2, 2018, 2:16 am
$
0
0

Hello

I'm developing a data warehouse for a vet treatment database.

I need to assign an ID column when a Pet has stayed in Hospital.

In SSIS I need to get the max ID from the ID column, which I know how to do. I thought I would run a Max SQL script and assign it to a Variable.

How do I take that Variable and add one for each record for each Pet that has stayed in Hospital?

Regards

SQLSearcher99 

↧

SSIS ServerTargetVersion 2016 - no row displayed in dataflow

July 5, 2018, 6:51 am
$
0
0

Hello, 

I have SQL Server Data Tools   15.1.61804.210 installed on my VS2017.

when I create a package with ServerTargetVersion = 2017, rows are correctly displayed in the dataflow.


If I change to ServerTargetVersion = 2016, no rows are displayed in the dataflow anymore, which is very annoying.

TargetVersion 2016

How can we fix this issue in VS2017?

↧

How do i do a simple backup and restore in SSIS?

March 19, 2009, 11:12 am
$
0
0
I've been searching google and to my avail i've found nothing.  How do i do a simple Database Backup to Database A, and from the Backup File, restore it (incremental backups) to Database B using BIDS?  I just wanted to design a control flow to deal with this
SIRIUS
↧

how can i fix this? works good in visual studio

July 3, 2018, 8:36 am
$
0
0

I am having issues while executing my package in SSMS

Package runs fine in Visual studio. I have a oracle as source and sql server destination as connection managers





Message Type

Action

Message Time

Message

Message Source Name

Subcomponent Name

Execution Path

OnError

View Context

7/3/2018 1:05:03 PM

apurvatest:Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005. An OLE DB record is available. Source: "OraOLEDB"  Hresult: 0x80004005 Description: "ORA-12154: TNS:could not resolve the connect identifier specified".

apurvatest

\apurvatest

OnError

View Context

7/3/2018 1:05:03 PM

Data Flow Task:Error: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "DWFEI.AAO8290" failed with error code 0xC0202009. There may be error messages posted before this with more information on why the AcquireConnection method call failed.

Data Flow Task

OLE DB Source [61]

\apurvatest\Data Flow Task

OnError

View Context

7/3/2018 1:05:03 PM

Data Flow Task:Error: OLE DB Source failed validation and returned error code 0xC020801C.

Data Flow Task

SSIS.Pipeline

\apurvatest\Data Flow Task

OnError

View Context

7/3/2018 1:05:03 PM

Data Flow Task:Error: One or more component failed validation.

Data Flow Task

SSIS.Pipeline

\apurvatest\Data Flow Task

OnError

View Context

7/3/2018 1:05:03 PM

Data Flow Task:Error: There were errors during task validation.

Data Flow Task

\apurvatest\Data Flow Task




↧
↧

Login failed for user 'NT AUTHORITY\ANONUMOUS LOGON'. Reason: Could not fin a login matching the name provided

July 5, 2018, 11:06 am
$
0
0

I have created a dts package and deployed to SSIS Dev server, with project deployment model. The package executes a stored procedure in a database named TCUCDB, which resides in another server tcsqldev01.
I have the connectionmanager created with Integrated Security=True, and tested connection is ok. I have environment set for QA, and when I try executing the package, selecting the Environment "QA", and I can see the connection string in "Connection Managers" tab as Integrated Security=True. But on execution from SSMS (Service catalog->package->right click -> Execute), packages fails to run with the error message below, on report

Failed to acquire connection "TCUCDB". Connection may not be configured correctly or you may not have the right permissions on this connection.

I checked with DBA, and they confirmed error logged on access to tcsqldev01 is as below

"Login failed for user 'NT AUTHORITY\ANONUMOUS LOGON'. Reason: Could not fin a login matching the name provided"

Why the login using this user account, instead my windows account, even after setting Integrated Security=True? 

How can I resolve this issue, and make sure package is executed on my windows account?

The dts package execution report also confirm the caller is my windows account 'DOMAINNAME\sbalakrishnan'

↧

SSIS and OData

July 2, 2018, 12:41 pm
$
0
0

All,

We are facing an issue with SSIS (2017 version) and OData (as Source). The error is:

SSIS package starting.
Information: 0x4004300A at DWH_CMN_MV_LOOKUP, SSIS.Pipeline: Validation phase is beginning.
Information: 0x4004300A at DWH_CMN_MV_LOOKUP, SSIS.Pipeline: Validation phase is beginning.
Information: 0x40043006 at DWH_CMN_MV_LOOKUP, SSIS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at DWH_CMN_MV_LOOKUP, SSIS.Pipeline: Pre-Execute phase is beginning.
Information: 0x4004300C at DWH_CMN_MV_LOOKUP, SSIS.Pipeline: Execute phase is beginning.
Error: 0xC02090F5 at DWH_CMN_MV_LOOKUP, OData Source [20]: The OData Source was unable to process the data. The remote server returned an error: (401) Unauthorized.
Error: 0xC0047038 at DWH_CMN_MV_LOOKUP, SSIS.Pipeline: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on OData Source returned error code 0xC02090F5.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.
Information: 0x40043008 at DWH_CMN_MV_LOOKUP, SSIS.Pipeline: Post Execute phase is beginning.
Information: 0x4004300B at DWH_CMN_MV_LOOKUP, SSIS.Pipeline: "OLE DB Destination" wrote 1933 rows.
Information: 0x40043009 at DWH_CMN_MV_LOOKUP, SSIS.Pipeline: Cleanup phase is beginning.
Task failed: DWH_CMN_MV_LOOKUP

Any help to resolve the issue will be appreciated.

- Raghu

 

↧
Search

script task

July 3, 2018, 6:19 am
$
0
0

Hi,

I have a situation whereby I want to calculate:

  • the record count of a file received yesterday,store it in a variable.The file is actually deleted from the folder after being processed.
  • calculate record count of file received next day and compare it with the record count of the previous day's file.

Each day we have a new file received.

↧

SSIS 2012 script component won't complete, spins indefinitely

July 5, 2018, 2:07 pm
$
0
0

Hi All,

Q: Why won't my SSIS Script Component fail or complete successfully?  It spins indefinitely, never passing any rows through nor throwing any error.  It literally ran for the last 40+ hours.

Background: I'm working through an Apress book, "Extending SSIS with .NET Scripting."  In chapter two, we learn how to add a script component that generates a unique key value for each row by incrementing an integer variable by one and then writing that value to an output column, "BikeID," which I created in the "Inputs and Outputs" screen under Output 0/Output Columns.

I realize this isn't a C# forum, but I thought others might've run into the problem of a Script Component never completing.  Any advice you may have is likely to be helpful.

Thanks,
Eric B.

public class ScriptMain : UserComponent
{
int rowNumber = 0;
public override void Input0_ProcessInputRow(Input0Buffer Row)
{
// Increment value
rowNumber++;
// Assigning value to new output column
Row.BikeId = rowNumber;
}
}

↧
↧

Concatenating SSIS Multiple Event Handler Messages

July 5, 2018, 3:02 pm
$
0
0

Hi Everyone,

I enabled eventHandler in my ssis package that send an email to me when an error occurs.

Unfortunately, this floods my mail box with lots of mails.

Now, I want to add a for each loop container that loops through each error message and concatenate them and writes them to a variable. Then I can use this variable in my send mail task to send only one email that has contains all the error descriptions in the message.

Thanks

me


↧

Pivot/Unpivot in dataflow task SSIS

July 5, 2018, 12:04 pm
$
0
0

I have the data in following format:

MONTH	Number of Installs	STATION	          Month Name
Jul	0	                ALPENA	                Jul
Jul YTD	0                       ALPENA	                Jul
Jul	0	                BIG RAPIDS	        Jul
Jul YTD	0	                BIG RAPIDS	        Jul
Jul	0	                CADILLAC	        Jul
Jul YTD	14	                CADILLAC	        Jul


I need to convert it to following format:

YTD   MTD        STATION
0     0         ALPENA
0     0         BIG RAPIDS
14    0         CADILLAC

MTD column should show values of rows with abbreviated month name

YTD column should show values of rows with abbreviated month name and YTD

I can use pivot transformation, but it requires pivotKey values to be specified as Jul and Jul YTD. I need to avoid this because the MONTH column changes its values based on current month. Since this is july month, it has Jul and Jul YTD values. If it is August, it will have Aug and Aug YTD values. So pivot should happen dynamically rather specifying Jul and Jul YTD as pivotKey values.

Any ideas on how to do this? Thanks in advance




EDIT: Sorry for the table format.. I tried many times, it is not showing appropriately
↧

How to Implement PGP encryption in SSIS without any third party tools

July 5, 2018, 8:59 pm
$
0
0

Hi All, 

Could you please let me know if there is a way to implement PGP encryption in SSIS without any third party tools. 

Thanks,

Vikram 

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>