Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Has anyone had any success converting old packages with Oracle connections to run on sql 2014

$
0
0

I can get the Attunity drivers to work fine, but I cannot get any of the Oracle connections to work to give me the ability to use the Execute SQL Task to run a delete statement.

I have installed both 32 and 64 bit ODAC drivers and the SQL tools. and while I can get a connection to TEST connectivity correctly, it fails on the acquire connection when it runs.

I have tnsname files in both 64 and 32 bit directories. I have put the paths to the client..bin folder in the PAth environment variable. I am at a loss. I've searched the net and only find 2012 examples and the ones I find have all seem to have different setups. So I think they just keep installing Oracle apps until it works.

Does anyone have a bulletproof install guide?

I have a SQL 2014 server and I am developing in Visual Studio 2013.


Be our next Spring SSIS Guru!

$
0
0



In the northern hemisphere at least, Spring is here! (apparently)

And at TechNet Wiki, we're hoping you're all hatching new ideas for this month's TechNet Guru competition!

We're looking for more shoots and leaves of wisdom to sprout forth from the great tree of MSDN/TechNet life.

We're also hoping some of our old Guru winners will be coming back out of hibernation and flexing their grey matter!

So, pick up your pen and MARCH into TechNet History! This could truly be the start of something BEAUTIFUL!

What delightful new arrival will YOU be bringing into this world?

All you have to do is add an article to TechNet Wiki from your own specialist field. Something that fits into one of the categories listed on the submissions page. Copy in your own blog posts, a forum solution, a white paper, or just something you had to solve for your own day's work today.

Drop us some nifty knowledge, or superb snippets, and become MICROSOFT TECHNOLOGY GURU OF THE MONTH!

This is an official Microsoft TechNet recognition, where people such as yourselves can truly get noticed!

HOW TO WIN

1) Please copy over your Microsoft technical solutions and revelations toTechNet Wiki.

2) Add a link to it on THIS WIKI COMPETITION PAGE (so we know you've contributed)

3) Every month, we will highlight your contributions, and select a "Guru of the Month" in each technology.

If you win, we will sing your praises in blogs and forums, similar to the weekly contributor awards. Once "on our radar" and making your mark, you will probably be interviewed for your greatness, and maybe eventually even invited into other inner TechNet/MSDN circles!

Winning this award in your favoured technology will help us learn the active members in each community.

Feel free to ask any questions below.

More about TechNet Guru Awards

Thanks in advance!
Pete Laker



#PEJL
Got any nice code? If you invest time in coding an elegant, novel or impressive answer on MSDN forums, why not copy it over toTechNet Wiki, for future generations to benefit from! You'll never get archived again, and you could win weekly awards!

Have you got what it takes o become this month's TechNet Technical Guru? Join a long list of well known community big hitters, show your knowledge and prowess in your favoured technologies!


The specified header or data row delimiter "{LF}" is not found

$
0
0

Hello,

I'm trying to import a csv file to a SQL server DB using a Flat File source and am running into the following message:

The specified header or data row delimiter "{LF}" is not found after scanning 524288 bytes of the file "C:\filename.csv".
Do you want to continue scanning this file?

What is weird is that I get this message when I select the Unicode check box on the General tab of Flat File source.

The options I have selected on the general tab where I don't run into the above message are below:

Format : Delimited

Text Qualifier: "

Head row delimiter: {CR}{LF}

Header rows to skip: 0

Column Names in the first data row: selected

Thanks!

SSIS Dynamic Input Parameters

$
0
0

Good day,

I have a simple package that makes use of a stored procedure.  The stored procedure makes use of a start and end date parameter. I would like, when I execute the package, the first thing is an input box(es) to accept these parameters, then pass them onto the proc, and the package executes.

May I kindly get assistance with this. I have so far created a script task to prompt the user for these parameters, but I'm getting stuck somewhere.

Please assist.


Many thanks

Regards

Zimiso


MS SSIS command line call "Argument for option 'set' is not valid"

$
0
0

Hi all,

I'm tring to execute a SSIS package from command line. Here's the code:

dtexec.exe /file "E:\TestIS\IntegrationServicesProject1\IntegrationServicesProject1\Package.dtsx" /set \Package.Variables[User::Name].Properties[Value];20150314

and it return a error saying  "Argument for option 'set' is not valid". I've configure the package and generated a XML file. And do exactly as the official doc says. However, this line of code just doesn't work. If I delete the set option and run the package alone, it can be ran. So anyone can help me out? Thank you in advance.

SQL agent scheduling for SSIS package

$
0
0

I have a package with a souce and destination connection using login as 'sa'.

I created a scheduling task to call this package for running. However the sql agent service is running as domain user . It required to be running as domain user as per requirement.

Thus when I scheduling the package for execution, it hit error.

Please advise what I can do in order to be able schedule the ssis package?

Thanks in advance.

[SSISDB].[internal].[operations] vs [SSISDB].[catalog].[executions]

$
0
0

This is on SSIS 2012. What is the difference between these two? I see that one is a table and the other is a view. But not sure how the contents are different.

They both seem to be a log of some sort for each exectution of a package in the SSIS catalog, but I have slightly more entries in [internal].[operations].

If I wanted to check the status of an execution_id immediately after executing

EXEC [SSISDB].[catalog].[start_execution] @execution_id = @exec_id
which would be the appropriate object to check. I think it is [internal].[operations] but wanted to confirm.

EDIT: I did look at the view definition, but was hoping for a quick confirmation on my last statement above.

Error when trying to execute SSIS packages from VB.net that have an Execute SQL task

$
0
0

I can execute SSIS packages from VB.net, but not if they contain an Execute SQL task.  I am getting the error message "A first chance exception of type 'System.IO.FileLoadException' occurred in Microsoft.SQLServer.ManagedDTS.dll" when executing these packages. The SQL Server is 2014 Developer edition and the .net app and the SQL server reside on the same PC.  Help appreciated.  Thanks.





Migrating Packages

$
0
0

Hello

I am trying to migrate some SSIS packages from a 2008 instance to a 2008 R2 instance.  I have exported the dtsx file from the 2008 instance.  When I attempt to import the package into the R2 instance, Management Studio > SSIS > Import Package> File System > Rely on server storage and roles for access control (I am not encrypting the credentials).  I receive an error message below when trying to import the package.  I have run the package within Visual Studio on R2 instance and it runs perfectly.  I have tried rebuilding the package on the R2's Visual Studio and importing but am still running into the same issue.  Unfortunately I cannot do a side by side installation (so I have to migrate via the file system).  If the error message displayed the actual problem I think I would be able to figure this one out.  By the way I am naming the package LocalityFuzzy not 꽸產ᢼ甦ᣘ甦.  Does anyone have any clues?  Thank you

TITLE: Import Package
------------------------------

Object name "꽸產ᢼ甦ᣘ甦" is not valid. Name must contain only alphanumeric characters or underscores "_".
 ({8BBB7189-4388-43F8-A081-9E01A9AB9C8E})

------------------------------
ADDITIONAL INFORMATION:

Object name "꽸產ᢼ甦ᣘ甦" is not valid. Name must contain only alphanumeric characters or underscores "_".
 ({8BBB7189-4388-43F8-A081-9E01A9AB9C8E})

Configuration Settings not changing

$
0
0

I have recently noticed that when I create a new SSIS package and add another Configuration setting such as "Release" or "Test" the values in my project parameters do not change between settings.

For example  in "Development"  i specify email to be "testaccount@test.net"  and when I select "release" from the drop downlist it still says "testaccount@test.net"  Then i change it to productionaccount@test.net, save it and select "development" from the drop down list only to find it showing "productionaccount@test.net"  for the value.  

I recently update the data tools and wonder if something has altered this functionality or caused a break ?

Has anyone else experienced this problem ?

Thanks,

FTP Connection Manager - The password was not allowed

$
0
0

Hi. I have created ssis package that sends a file via FTP. This works fine when testing on my local machine. When I import the package into Integration Services on the SQL Server then run as a job the file for output is created but FTP fails with error below.

[quote]

Message
Executed as user: DOMAIN\Account. Microsoft (R) SQL Server Execute Package Utility  Version 12.0.2000.8 for 64-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  15:27:55  Error: 2015-03-26 15:27:56.31     Code: 0xC001602A     Source: Package Connection manager "FTP Connection Manager"     Description: An error occurred in the requested FTP operation. Detailed error description: The password was not allowed  End Error  Error: 2015-03-26 15:27:56.31     Code: 0xC002918F     Source: FTP Task FTP Task     Description: Unable to connect to FTP server using "FTP Connection Manager".  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  15:27:55  Finished: 15:27:56  Elapsed:  0.375 seconds.  The package execution failed.  The step failed.

[/quote]

I am fairly new to this. Can anyone help?

Thanks,

Phil.

executing a bat file from SSIS

$
0
0
I have a bat file that can only be executed successfully from an administrator command prompt. Double clicking on the bat file will return an "Access denied" message and right clicking and running it as an administrator will just fail. I am trying to execute this bat file from an SSIS package using the Execute Process Task, but getting the "Access Denied" message. Please let me know how to get around this problem. Thanks!

Converting Oracle date type to SQL Server date type

$
0
0

Hi guys, what is your experience when extracting oracle dates to SQL server?

My goal is to extract a Date type from Oracle to SQL Server Date type but I'm getting "Invalid date format", so I need to convert it with TO_CHAR(oracle_date,'YYYYMMDD') to a varchar(8) field in SQL server and then convert it to a date.

I would like to extract it directly as date without having to make this double conversions.

Thank you

What is the most efficent way to iteratively debug custom SSIS component?

$
0
0

I'm iteratively writing a custom SSIS component.  I have two Visual Studio 2013 sessions open. One for the custom SSIS component and one that has a test SSIS package to test the custom data flow component. When I compile the SSIS component, it does the usual uninstall/install to the GAC and places new copies of the assemblies in the appropriate SQL pipeline directories.

In order for the new version of the component to be reflected in the test SSIS package, I have to close Studio and reopen the test project.  Is there an easier way to do this?  Seems tedious to do that every time I make a new change to the SSIS component.  Simply refreshing the toolbox does not work.

Thanks,


Stephen

Datatable returns 0 rows when consuming data from Object Variable (Recordset)

$
0
0









This is crazy! I have a variable called ValidISBN and InvalidISBN (both Type Object). I have a Recordset that populates these variables in a data flow and I can see that the records comes in when look at the dataview.

ISSUE: When I fill the datatable, then count the rows, it returns 0?

Here is my code:

OleDbDataAdapter adapter = new OleDbDataAdapter();
DataTable ValidISBNDT = new DataTable();
DataTable InvalidISBNDT = new DataTable();

adapter.Fill(ValidISBNDT, Dts.Variables["User::ValidISBNTable"].Value);
adapter.Fill(InvalidISBNDT, Dts.Variables["User::InValidISBNTable"].Value);

Dts.Variables["User::ValidISBNTable"].Value = ValidISBNDT;
Dts.Variables["User::InvalidISBNTable"].Value = InvalidISBNDT;

string test = "";

test = (ValidISBNDT.Rows.Count.ToString());
MessageBox.Show(test);

test = (InvalidISBNDT.Rows.Count.ToString());
MessageBox.Show(test);

Thanks in advance!


Dynamically Setting a Variable from a Connection String that has been set by a Config File

$
0
0

Hi Guys

I'm setting up a Master / Slave (Parent / Child) dtsx environment but I'm unable to work out how to dynamically set a variable in the Master dtsx from a connection string that has had its value set by a config file. I'm sure it's possible.

Below is the what I'm hoping to achieve. I've set up everything apart from the highlighted section.

Any ideas?

How to create log file for ETL operation ?

$
0
0

Hello,

I have created a sample project for ETL operation. For that 

1. Source - Flat file is the source from which data are extract. It contains ID,Name and Address Columns

2. Transformation - Lookup that check for duplicate Name in SQL Server table e.g Employee which contain all the three                                       columns.

I would like to write Look up match rows in log file. 

How can I achieve this?

Thanks in advance.

Data Conversion Error

$
0
0

Hi,

I have a requirement, the source is N no.of files. I have to loop through all the file(contains 5 columns col1, col2, col3, col4) and aggregate the results based on column 1,2 and other file based on column 1,2,3. Column 4 contains the numeric values.

Eg: Col1  Col2  Col3  Col4  Col5

      A      PD      SP     1     abc

      A      PD      SP     2    mnp

      A      PD      LP     3     pqr

So, the output1 should be:

A  PD  SP  3

A  PD  LP  3

And 2nd output file is:

A PD 6

I have done this using SSIS Package. Now the thing is the same 'A PD LP 3  pqr' can exist in multiple input files. So after for each loop, I can still see duplicates in the 2nd output file. So What I have done is, I have let only Output1 will be loaded in the for each loop and after the For each loop completion, I have added a DFT and used the Output1 file as source and aggregated the results to load into Output file2.

In this new DFT, I have to use Derived column to convert the value from str to integer so I have make it (DT_I8)Value. But the package is failing at Derived column. If I Disable the For Each Loop Container then the new DFT is completing without any errors. So Can I use the target file that is loaded in For Each Loop as a source in the DFT added after For Each Loop please..?

Please help me out.

Thanks.


Parallel Script Tasks Using Same Connection Manager are Corrupted

$
0
0

We're seeing a bizarre issues in our SSIS package.  We are using an HTTP connection manager in multiple script tasks running in parallel and the connections seem to be getting mismatched.  Here's the basic flow.

We have 6 containers that run in parallel.  Each container does the exact same work (they are copy/pasted) except we change the value of a variable representing the report to generate that is scoped to each container.  The container runs a query (using a SQL connection manager defined in the package designer) and then uses a foreach container to enumerate the rows.  The variables inside the foreach container are scoped to it so we don't have a scoping issue.  Within the loop we write the variable values to a log table, use a script task to generate an SSRS report and then write all the data and the report to an external system.  Everything is working fine except for the generation of the report.

Within the report script block we acquire a connection to a HTTP connection manager that is defined in the package (just like the SQL connection manager).  We then create a new HttpClientConnection with it and update the URL to include the necessary parameters that SSRS needs to generate the report.  We then download the results and return it back to the container.  Here's the basic code we use

var httpConn = Dts.Connections["ReportServerUrl"];
var clientConn = new HttpClientConnection(httpConn.AcquireConnection(null));
var uri = new UriBuilder(clientConn.ServerURL) { Query = reportQueryInfo };
clientConn.ServerURL = uri.Uri.ToString();
clientConn.DownloadData();

The issue we are seeing is that when 2 of the scripts run at the same time the ServerURLs are getting cross wired such that we see 2 of the same report being requested rather than 1 of each type that we had requested (based upon the SSRS execution logs).  It's almost like we are getting a shared HTTP client connection.  Provided the scripts don't run at the same time everything works correctly.  We are confident our variables are set correctly because we are storing them both before and after in external tables and they are always correct.  The URL calculation logic is also correct because this problem only occurs when 2 requests are sent in parallel.

What am I missing here?

Michael Taylor
http://blogs.msmvps.com/p3net

Load data from 2012 to 2008

$
0
0
If i create a ssis package and have a source of sql 2012 to destination sql 2008 in my dataflow, will this work? The ssis package would be created for sql 2012 and installed on the sql 2012 server.
Viewing all 24688 articles
Browse latest View live


Latest Images

<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>