How to configure connection that uses Oracle Provider for OLE DB

November 1, 2018, 8:50 am

≫ Next: SSIS 2014 package running ultra slowly in Visual Studio 2013

≪ Previous: Parse body of email and send report based on parsed parameters

Hello,

I have come back to SSIS (2014) after a while to make our existing Data Warehouse start extracting data from a new Oracle database. To do this, we are using the Oracle Provider for OLE DB which is a first for me.

Unlike our packages that rely on integrated security, with the Oracle connection we need to provide a user name and password. We are also having to change the package ProtectionLevel as well (to EncryptSensitiveWithUserKey) because the default DontSaveSensitive means the password is not stored.

For our SQL Server connection, we get everything from a database parameter table the is environment so the same package can be run in DEV, PRE and PRO. I tried to do the same for the Oracle connection and as soon as I parameterise the ConnectionString, Password and UserName the Oracle connection manager changes to SQL Server!

How can I parameterise the key Oracle Provider stuff for Oracle so I can use the package on different environments using the configuration database table?

Thanks in advance!

↧

SSIS 2014 package running ultra slowly in Visual Studio 2013

November 1, 2018, 8:53 am

≫ Next: BI developer

≪ Previous: How to configure connection that uses Oracle Provider for OLE DB

Hello,

I am trying to run my SSIS 2014 packages in VS 2013 and although they run and I can debug them, they run very very slowly.

I noticed a number of people saying set the package to work offline. Whilst this works fine for a package that connects to SQL Sever, it breaks packages that connect to Oracle (we are using the Oracle Provider for OLE DB).

Anyone know how I can make my Oracle dependant packages run fast?

Thanks in advance!

↧

BI developer

November 1, 2018, 8:57 am

≫ Next: SSMS to SSIS, cant connect

≪ Previous: SSIS 2014 package running ultra slowly in Visual Studio 2013

creating ETL Job:-

How to obtain the desired result?

I have a column A in source table that has value 0 and 1. I have created a derived table for that column and associated column B and have destination table where there is already associated column Z which has value "XYZ" where source column A has value = 0
So if value in source table A changes from 0 to 1 the destination column Z will have the value "ABCD" and if the value changes back from 1 to 0 the destination column Z should have value "EFGH"

↧

SSMS to SSIS, cant connect

November 1, 2018, 4:04 pm

≫ Next: How to handle deletes and inserts based on a flag table in SSIS

≪ Previous: BI developer

Hi I am trying to connect to Integration services from Management Studio and it fails. If i use a version on the server then it works, but i want to connect from the local pc. I have seen some posts about a bug in SSMS to SSIS. I just upgraded to the latest version but it doesn't work. 2016 SSMS Version 13.0.16 works but 2017 SSMS Version 14.0.17 doesn't.

"Connecting to the intergration services on computer xxxxxx failed with the following error class not registered

Thanks

↧

How to handle deletes and inserts based on a flag table in SSIS

October 23, 2018, 9:14 am

≫ Next: Is the Derived Column Task Dynamic or Static?

≪ Previous: SSMS to SSIS, cant connect

Hi,
I have two packages:

Package ONE pulls data from source (cloud) to destination (on-prem):
a) Unecrypted tables go to DB1
B) Encrypted tables go DBstg

Package TWOdecrypts data from DBstg to DB1 (within the same instance)

Each package has a sequence container. Inside each sequence container, there are about 16 Data Flow Tasks. Inside each Data Flow Tasks, there are 8-10 tables. The way the package works is: First it gets max date from destination then gets max date from source. After this, it will compare between source and destination tables then it replicates the difference ... SELECT * FROM TABLENAME WHERE (Date > ? and Date <=?). Once replicatiOn is done, it decrypts from DBstg to DB1.

The problem is sometimes, the package fails after after half the tables are populated from the source to the destination or half of the tables are dcrypted from DBstg to DB1. half of the load is done.

The following are not an option:

Check point is not an option because when the packages are re-run, there are duplicate values inserted. This is due to having multiple tables per Data Flow Task.
I have multiple Connection Managers (CM) and I cannot use BEGIN/COMMIT TRAN option since this can only be supported within one CM.
The option to enable MSDTC is not on the table!

My question is, how do I go about implementing a method to delete records
My question is, how do I go about implementing a method to delete records when the packages fails half way after records are inserted into half of the tables? The option to use Script Task inside Data Flow Task is not available. I see OLE DB Command but it does not look like I can use as much as I can use Script Task to update a table.

Any help really appreciated!

Thanks

IN~

↧

Is the Derived Column Task Dynamic or Static?

November 2, 2018, 11:00 am

≫ Next: Do you be announced as the next SSIS Guru? Read about TechNet November 2018 competition!!

≪ Previous: How to handle deletes and inserts based on a flag table in SSIS

Lemme 'splain…

I receive a single member file that has member data from several suppliers. Unfortunately, they are not consistent in their naming conventions. Some use First Last; some use Last, First; some toss in the middle initial; for some inexplicable reason, one of them puts the last name in quotes; one of them even tosses in a comma after the name for who knows what reason.

I thought I'd use a single Derived Column task to parse the names. But, each name will need several passes to cover all the eventualities and I'd like the ability to easily put in additional parsing needs, if necessary.

So, that being the case, I didn't know if the successive rows in a Derived Column task could use the results of a prior row (dynamic) or if each row could only use the data as provided by the prior task - in this case, an Excel source editor (static).

If it's static, I can add successive Derived Column tasks to cover all my parsing needs in individual tasks, but, if not, if it's dynamic, then I can do all of it in one task.

So, here I am at the altar of the Cloud Minds to beg their wisdom.

Thanx in advance for any assistance!

↧

Do you be announced as the next SSIS Guru? Read about TechNet November 2018 competition!!

November 2, 2018, 12:04 pm

≫ Next: Data Flow Task Unusual Behavior

≪ Previous: Is the Derived Column Task Dynamic or Static?

What is TechNet Guru Competition?

Each month the TechNet Wiki council organizes a contest of the best articles posted that month. This is your chance to be announced as MICROSOFT TECHNOLOGY GURU OF THE MONTH!

One winner in each category will be selected each month for glory and adoration by the MSDN/TechNet Ninjas and community as a whole. Winners will be announced in dedicated blog post that will be published in Microsoft Wiki Ninjas blog, a tweet from the Wiki Ninjas Twitter account, links will be published at Microsoft TNWiki group on Facebook, and other acknowledgement from the community will follow.

Some of our biggest community voices and many MVPs have passed through these halls on their way to fame and fortune.

If you have already made a contribution in the forums or gallery or you published a nice blog, then you can simply convert it into a shared wiki article, reference the original post, and register the article for the TechNet Guru Competition. The articles must be written in November 2018 and must be in English. However, the original blog or forum content can be from beforeNovember 2018.

Come and see who is making waves in all your favorite technologies. Maybe it will be you!

Who can join the Competition?

Anyone who has basic knowledge and the desire to share the knowledge is welcome. Articles can appeal to beginners or discusse advanced topics. All you have to do is to add your article to TechNet Wiki from your own specialty category.

How can you win?

Please copy/Write over your Microsoft technical solutions and revelations to TechNetWiki.
Add a link to your new article on THIS WIKI COMPETITION PAGE (so we know you've contributed)
(Optional but recommended) Add a link to your article at the TechNetWiki group on Facebook. The group is very active and people love to help, you can get feedback and even direct improvements in the article before the contest starts.

Do you have any question or want more information?

Feel free to ask any questions below, or Join us at the official MicrosoftTechNet Wiki groups on facebook. Read More about TechNet Guru Awards.

If you win, people will sing your praises online and your name will be raised as Guru of the Month.

PS: Above top banner came from Syed Shanu.

Ronen Ariely
[Personal Site] [Blog] [Facebook] [Linkedin]

↧

Data Flow Task Unusual Behavior

November 2, 2018, 4:31 pm

≫ Next: الاصلاح الفورى تكييفات كاريير ( 01127571696) تكييفات كاريير ( 01127571696) الاسكندرية

≪ Previous: Do you be announced as the next SSIS Guru? Read about TechNet November 2018 competition!!

I have a DF Task with a OLEDB source connected to a Oledb destination.

The oracle oledb source query is something like this

Select col1, col2, col3from table a inner join table b on a.col1 = b.col1 where a.modifieddate = sysdate-7

When I preview this I get only 18 rows which is correct. But when I run it pulls all the rows from the source which is 3775.

Can someone please help me why this is the case, I have been trying to identify the root cause for several days and cant seem to find what I am doing wrong.