Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

SSIS OracleClient Data Provider - Connection Timeout not recognized

October 28, 2019, 12:19 pm
$
0
0

Fellow SSISers,

I have an ssis 2016 package that reads Oracle - migrated it from ssis 2008 r2.

All done with a new vm.

New up-to-date oracle client/drivers, etc etc.

My package uses a db connection manager that has the provider of .net providers\oracleclient data provider.

In my forloop, I build some of the connection string for each connection and pass it to the connection manager.

The package failes because I previously was passing "Connection Timeout" in the connection string. Looks like this parameter is gone.

Once I removed that parameter in the connection string, the package worked flawlessly connecting to all of the oracle hosts.

So, how does one setup Connection Timeout now with the scenario I have given or is this literally no longer supported? 

Thanks,

MG

↧
Search

Using SSIS to Mirror database tables between different DB2 and SQL Server

October 28, 2019, 12:39 pm
$
0
0
I am wondering if SSIS packages can be used to mirror database tables between DB2 and SQL Server or must there be an intermediary step such as a load?
↧
↧

Need to sync tables between two database in different instance

October 28, 2019, 1:18 pm
$
0
0

Hi team,

i have a requirement to sync tables (for now 2) between two database in different instance. 

Tables: TableA, TableB both has create & update timestamp fields

Instance1--> DB1 --> TableA, TableB SQL Server 2012

Instance2--> DB2--> TableA, TableB SQL Server 2016

No change in structure, just data need to be transferred in real time including CRUD operation changes.

What is the best way to do this ?

1. SSIS package in both end, export delta changes to NAS , then reimport via SSIS package on other end.- Too  many tasks

2. any other latest ways and fast.

Please note CDC not allowed..

Balamurugan


↧

Comparison between two tables

October 29, 2019, 1:12 am
$
0
0

Hello, could somebody give an advice how to perform comparison of two tables, suppose to be the same. E.G., how to discover the difference in column values i.e., specifically, PIN values in PIN column in table A comparing the same in table B?

And, to have it loaded in separate table e.g., table C? (complete rows with different PIN values)

Which tool to use for this task, SSIS?

Any link for tutorial...

Thanks

↧

Strange behavior from Oracle OLE DB Source in a dataflow

August 18, 2010, 3:41 pm
$
0
0

I have a pretty simple data flow that uses an OLE DB Source, using the Oracle OLEDB Client.  In the OLE DB Source, I can parse the query and it succeeds.  I can alos preview the data.  But when I run the package, it fails on that component with the following error:

Error: 0xC0202009 at Instance Properties, OLE DB Source [1412]: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80040E14. An OLE DB record is available. Source: "OraOLEDB" Hresult: 0x80040E14 Description: "ORA-00903: invalid table name".

One thing to note.  I am running on Windows 7 x64 and I know there are designer vs. runtime issues.  But this seems to be different since this is all from within the designer. 

 

↧
↧

Need to create a temp table or table variable that will store data from sql server and will be used in oracle oledb source

October 29, 2019, 10:21 am
$
0
0

Hi,

My ssis package has an oledb source which joins oracle and sql server to get source data and loads it into sql server oledb destination. Earlier we were using linked server, for this purpose but we cannot use linked server anymore.

So I am taking the data from sql server and want to return it to the in clause of the oracle query which i am keeping as sql command oledb source. 

I tried parsing an object type variable from sql server and putting it into the in clause of oracle query in oledb source but i get error that oracle cannot have more than 1000 literals in the in statement. So basically I think I have to do something like this:

select * from oracle.db where id in (select id from sqlserver.db).

Since I cannot use linked server so i was thinking if I could have a temp table which can be used throughout the package.

Can someone please help. Any help will be greatly appreciated.

Thank you!

↧

How to convert string in format dd.mm.yyyy to date using SSIS expression?

October 29, 2019, 2:11 pm
$
0
0

I have a date 26.12.2019(dd.mm.yyyy) in CSV which I'm trying to convert to 2019-12-26 using Derived Column in SSIS.

I have used this expression but it does not seem to work.

(TRIM([Period Start Date]) == "") ? NULL(DT_DATE) : (DT_DATE)(SUBSTRING([Period Start Date],7,4) + "-" + SUBSTRING([Period Start Date],4,2) + "-" + SUBSTRING([Period Start Date],1,2)) 
```
How do I rewrite this expression to produce the correct output with a value of data type?

Prajakt.

↧

SQL Server Agent Job is not running SSIS ETL project properly

October 29, 2019, 11:08 am
$
0
0

We have a SQL Server Agent Job set up to run a package from the MSDB Stored Package. That package runs a SSIS project (ETL). The job is scheduled to run daily. When the job runs, it reports back as a success, but the SQL tables are empty. If we run the SSIS ETL or the MSDB package manually, the tables are populated.

The SQL Job is complaining about a wrong file type for the connection manager. The connection manager "LocalHost.CMD" is for a SQL database on the same server as SSIS. We have always used OLE DB as the connection type. "CMD" is a database, not a file. Any ideas?

This is the results of the SQL job. 

Executed as user: CMDANALYTICS\mzuniga. Microsoft (R) SQL Server Execute Package Utility  Version 11.0.6020.0 for 32-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  10:02:49 AM Error: 2019-10-29 10:02:50.46     Code: 0xC020801E     Source: HubspotDealsV2 Log provider "{9156B21A-F4FE-4643-8916-BDA41A6FDFF5}"     Description: The connection manager "LocalHost.CMD" is an incorrect type.  The type required is "FILE". The type available to the component is "OLEDB".  End Error  Error: 2019-10-29 10:02:52.13     Code: 0xC020801E     Source: HubspotDealsV2 Log provider "{9156B21A-F4FE-4643-8916-BDA41A6FDFF5}"     Description: The connection manager "LocalHost.CMD" is an incorrect type.  The type required is "FILE". The type available to the component is "OLEDB".  End Error  DTExec: The package execution returned DTSER_SUCCESS (0).  Started:  10:02:49 AM  Finished: 10:02:54 AM  Elapsed:  4.836 seconds.  The package executed successfully.  The step succeeded.

↧
Search

Export SQL Server query output into a tab delimited format but the format must be text (ms-dos)

October 30, 2019, 1:02 am
$
0
0

Dear Experts,

I have this requirement from application team to output a query in a specific format. I used the export data wizard available in SQL Server and could generate an output file that is tab delimited. However, the output file is in text (Tab delimited) format.

They want it to be in the MS DOS tab delimited format. Is there any way we could generate an output file in that format?

Can you please share your suggestions?

MM

↧
↧

##TEMP table loads but dataviewer shows NULLS!!

October 30, 2019, 2:10 am
$
0
0
When I select * from my ##TEMP table it shows records during execution, but it shows empty when inserted into the EXCEL Destination.  The data viewer shows all NULLs, but it still shows 4392 records. Why is that?
↧

SSIS Package still running after failure

October 30, 2019, 2:24 am
$
0
0

Hi

I have an SSIS Package that calls another SSIS Package. When the called SSIS Package fails the original package is stuck still waiting for a response. This is the case in Visual Studio and from SSIS itself.

Does anyone know why this might be the case?

Thanks

SG

↧

Importing from Mainframe with Host Integration Server

October 21, 2019, 9:51 am
$
0
0

Hi team,

 I am trying to import from mainframe  to SQL Server using SSIS as something similar mentioned in below article

https://www.mssqltips.com/sqlservertip/3497/importing-mainframe-data-with-sql-server-integration-services-and-host-integration-server/

Please let me know if i want to import  directly from mainframe systems instead of local folder, what connection property need to set?

 I am using  HIS 2013 and SSMS 16.5.3 for SSIS.

Thank you

↧

3rd Party App execution/Automation Process via SSIS

October 30, 2019, 8:05 am
$
0
0

Hi Guys, I`m working with a 3rd party Vendor, Our process will create a Input file from SQL DB which then needs to be uploaded into our Vendor Application, the input file gets processed by software and it spills out an output file.

My Question is How can i automate via SSIS where we can run the input file from Vendor App, Upon contacting Vendor what they`re suggesting is we can run the batch via CMDLine, I need to run the CMD line script in SSIS. The Software has a manual process with which we load the files, when i go to commandline prompts it gives the below script, Can i utilize below script in SSIS and upon execution it executes the software and gets me the output? anyone done this ?

E:\M\mhis\gs\ gs_console.exe
\\e$\M\mhis\gs\ gs_console.exe
cgs_console.exe -input \\F_Drive\Analytics\MInputFiles\LoadTesting\Input_YEARLY_2017.csv 
-input_template E:\M\mhis\gs\templates\grp_in.2019.0.3.dic 
-upload \\F_Drive\Analytics\MInputFiles\LoadTesting\Output\Input_YEARLY_2017_V2__test_output.csv 
-upload_template E:\M\mhis\gs\templates\grp_out.2019.0.3.dic 
-report \\F_Drive\Analytics\MInputFiles\LoadTesting\Output\Input_YEARLY_2017_V2_test_outputreport.html 
-error_log \\F_Drive\Analytics\MInputFiles\LoadTesting\Output\Input_YEARLY_2017_V2_test_errorlog.html 
-edit_log \\F_Drive\Analytics\MInputFiles\LoadTesting\Output\Input_YEARLY_2017_V2_test_editlog.html 
-schedule off -g 07111 
-input_date_format MM/dd/yyyy

↧
↧

SSIS : How to add WSS header to include username token in the SOAP request ?

October 30, 2019, 9:42 am
$
0
0

Error Message : WSS header is missing from request. Can't do username token authentication.

I need to add UsernameToken in the header to pass the username and password in the SOAP body. How do I achieve this in the web service task of SSIS ?



↧

Getting Output from Executing Stored Procedure in SSIS

October 30, 2019, 10:08 am
$
0
0

Hi,

Anyone able to help with this:

I have a SQL Stored Procedure with this:

USE [MyDB]
GO

EXEC [dbo].[MyTable]

GO

If I run this is Management Studio it works and returns the following results:

Code (Header)

28

21

89

50

I want to get that list of results and use them in an Email Body within a SSIS Task, but its not working.

In SSIS Control Flow, I do an SQL Execute Task, add the SQL Statement, Resultset= Full Result set

Set the Result set properties: Result Name: 0 and Variable Name: User::MyVariable

But when I run the package, I get error: [Execute SQL Task] Error: Executing the query "USE [MyDB]
" failed with the following error: "No disconnected record set is available for the specified SQL statement.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.

Any ideas how I resolve this?

I pass nothing to the Stored Procedure, but I want to use the resulting output from the SP pass into the SSIS Package to pass into the Body of the Send Mail Task which comes after this Stored Procedure.

Any help appreciated.


↧
Search

ignoring failure to connect to 1 or more of 12 servers

October 30, 2019, 11:11 am
$
0
0

Hi, we run 2017 std.  I've done my best in the image below to show at a high level the general architecture we use to consolidate info from 12 servers. 

Failure to connect to 1 or more of the 12 servers in their oledb source components should be forgiven so the package can accomplish whatever is possible.

Regarding the package.  It acts incrementally on the data by keeping a table around called job control and using that table to record the high keys from what is really like 22 servers (and thus 22 locations), 11 of which are already replicated to 11 db's on 1 server .   The pkg doesn't write to the job control table until component "Add New Job Control" executes.  That job control table's columns are location identifier, high key and package run date.  There is also an expiration flag column so we can keep a little history in this table. 

The component called "Record High Mod Dates" retrieves those high keys which are recorded temporarily and later baked into dynamically built queries.  "Record High Mod Dates" is the 1st of two components where the 12 servers are connected to.

The component called "Stage Hist" is the 2nd component in which the 12 servers are connected to and where the dynamic sql is run.

Right now the package fails upon failure to connect to any server.  I'd like to forgive failures to connect to 1 or more of the 12 servers without overly complicating the pkg.   connection attempts are always thru oledb source components.  as you can imagine i'd want to somehow share connection failures by location with the component called "Add New Job Control" so only the previous high keys for those failed locations would be inserted to Job Control.  I'd probably want to share with "Stage Hist" any failures encountered in "Record High Mod Dates".

I'm looking at this article https://www.timmitchell.net/post/2013/08/05/continue-package-execution-after-error-in-ssis/ and see that event handlers might help in all of this.  But in general i'm wondering what the available alternatives are for this sort of thing.  I suppose for every one of the 12 oledb sources I could have a separate dft whose failure path could handle this class of problem.

 

 

↧

Duplicate component name in SSIS package

October 24, 2018, 3:57 pm
$
0
0
We have an SSIS package that is currently running on an SQL 2014 instance.    When I exported the package to my workstation and tried to open it, I get 'Microsoft Visual Studio is unable to load this document: Duplicate component name.     Component names must be unique and case-insensitive'.      Any idea what I can do to open this?
↧
↧

Getting "does not have a matching source column in the schema" errors in SQL Server Agent job.

October 30, 2019, 3:53 pm
$
0
0

I have a SQL Server Agent job that runs an SSIS project. We are using SQL Server 2012 and Visual Studio 2015. The data source for the SSIS project is 'CData Hubspot Source'. The output is a table in SQL. When we run the SSIS project it runs fine. We use MSDB Stored package for the job. We can run the MSDB package and it runs correctly.

When we try to run the SQL Server Agent job it complains about not have a matching source column in the schema. The screen shots below shows the error output and the mappings. any ideas?

Microsoft (R) SQL Server Execute Package Utility
Version 11.0.6020.0 for 32-bit
Copyright (C) Microsoft Corporation. All rights reserved.

Started:  3:27:32 PM
Error: 2019-10-30 15:27:34.80
   Code: 0x00000000
   Source: Load Import CData HubSpot Source
   Description: The CData HubSpot Source.Outputs[CData HubSpot Source Output].Columns[Additional consideration ] does not have a matching source column in the schema.
End Error
Error: 2019-10-30 15:27:34.80
   Code: 0x00000000
   Source: Load Import CData HubSpot Source
   Description: The CData HubSpot Source.Outputs[CData HubSpot Source Output].Columns[Additional consideration notes] does not have a matching source column in the schema.
End Error
Error: 2019-10-30 15:27:34.80
   Code: 0x00000000
   Source: Load Import CData HubSpot Source
   Description: The CData HubSpot Source.Outputs[CData HubSpot Source Output].Columns[Estimated hard costs] does not have a matching source column in the schema.
End Error
Error: 2019-10-30 15:27:34.80
   Code: 0x00000000
   Source: Load Import CData HubSpot Source
   Description: The CData HubSpot Source.Outputs[CData HubSpot Source Output].Columns[Estimated project end date] does not have a matching source column in the schema.
End Error
Error: 2019-10-30 15:27:34.80
   Code: 0x00000000
   Source: Load Import CData HubSpot Source
   Description: The CData HubSpot Source.Outputs[CData HubSpot Source Output].Columns[Estimated project start date] does not have a matching source column in the schema.
End Error
Error: 2019-10-30 15:27:34.80
   Code: 0x00000000
   Source: Load Import CData HubSpot Source
   Description: The CData HubSpot Source.Outputs[CData HubSpot Source Output].Columns[Evaluation Score] does not have a matching source column in the schema.
End Error
Error: 2019-10-30 15:27:34.80
   Code: 0x00000000
   Source: Load Import CData HubSpot Source
   Description: The CData HubSpot Source.Outputs[CData HubSpot Source Output].Columns[Services] does not have a matching source column in the schema.
End Error
Error: 2019-10-30 15:27:34.80
   Code: 0x00000000
   Source: Load Import CData HubSpot Source
   Description: The CData HubSpot Source.Outputs[CData HubSpot Source Output].Columns[Source] does not have a matching source column in the schema.
End Error
Error: 2019-10-30 15:27:34.80
   Code: 0x00000000
   Source: Load Import CData HubSpot Source
   Description: The CData HubSpot Source.Outputs[CData HubSpot Source Output].Columns[Source referred by] does not have a matching source column in the schema.
End Error
Error: 2019-10-30 15:27:34.80
   Code: 0xC004706B
   Source: Load Import SSIS.Pipeline
   Description: "CData HubSpot Source" failed validation and returned validation status "VS_NEEDSNEWMETADATA".
End Error
Error: 2019-10-30 15:27:34.80
   Code: 0xC004700C
   Source: Load Import SSIS.Pipeline
   Description: One or more component failed validation.
End Error
Error: 2019-10-30 15:27:34.80
   Code: 0xC0024107
   Source: Load Import 
   Description: There were errors during task validation.
End Error
DTExec: The package execution returned DTSER_FAILURE (1).
Started:  3:27:32 PM
Finished: 3:27:34 PM
Elapsed:  2.387 seconds

↧

Script component has encountered an exception in user code.

August 22, 2017, 6:18 am
$
0
0

Hi

I am running a dtsx package in Microsoft Visual Studio 2010. I am trying to run a xls file with several worksheets. I have never got any problems until today. I have erased the last file and substituted it for another new one. I have refreshed the references in the excel drivers  (for each worksheet) but now I'm getting this error below. Any hints to overcome this would be welcome. 


↧

How to bulk convert ISO8859 text in Text columns to UTF8 in nvarchar(max) columns?

October 1, 2019, 5:46 am
$
0
0
Hi, I've been struggling for days with a problem on a MS SQL database. Here is the situation: I have an old Open Source PHP application (Limesurvey version 1.92) running on a Windows 2008R2 server, with SQL2008R2 as RDBMS. I need to migrate the surveys in the application to a new instance, running on Linux with MySQL. The new instance is version 3, and database structure between both versions is different. The scenario I tried to use is upgrading the old version on the old server, and then exporting the surveys as export files, which I can import into the new application. It works well. Except that I'm stuck because of a problem of character encoding. The old application (web application) uses UTF-8. But the database uses only VARCHAR and TEXT columns. Therefore UTF-8 characters are stored using several bytes in these columns : é is stored as é for example. When I upgrade the application, the upgrade script changes the structure of the tables: TEXT columns become NVARCHAR(MAX), but the content in the column is not converted to UTF-8. So I'm searching for a way to change the content in the NVARCHAR(MAX) columns from ISO8859 to UTF-8. The database has approx 200 tables and is 600MB.
↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>