Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Unable to configure ADO.Net connection manager for Sybase ASE in SSIS 2016

October 20, 2016, 4:04 pm
$
0
0

I am trying to configure an ADO.NET connection manager in an SSIS 2016 project, using the Sybase ASE 15.7 client in Visual Studio 2015.

When I attempt to create a new manager, there is no configurable fields within the Connection window and there is no configurable fields within the "All" window:

I have tried connecting using ADO.NET providers via a trial version of Mist and have been able to successfully configure and connect.

I have tried both x86 and x64 ASE Client installations and am getting the same results each time. I have also tried later versions of the ASE client and have found no difference.

Has anyone come across this issue? Does anyone have a work around?

Thanks

↧
Search

Result set single row straggling with date format

May 9, 2016, 2:41 am
$
0
0

I love SSIS, I hate SSIS. Especially when I must do something with the date.

I got the query Select max(ndate) from Table1 now I want be alerted if the max(ndate) is two day before today.

I created a Execute SQL Task with result set single row. I added the variable but first problem: how can I fix the variable as date? When I try it asks me a default value. I gave up and I set up a string variable.

Now I need to convert the variable from string to date because the expression should be:

 @[User::MxDt]<DATEADD("dd", -2, GETDATE()) 

but @MxDt is a string. I tried in all the way but I can't figure out a solution...

Any advice?

Thanks


↧
↧

Issue with SSIS

October 21, 2016, 12:16 am
$
0
0
I have two servers one is ssis server and one is database server. I have SQL Server 2014 sp1 ent edition installed on windows server 2012 r2 ent edition 64 bit. when my ssis package runs it was not able to access the txt files on network share.  It tells that it can open the files on the network share. The user account and sql server accounts on both of the servers have access to the network share. It has permissions in the SQL Server also. Any ideas on what is missing.
↧

My Dataflow task Not loading data in Sequence container

October 21, 2016, 4:49 am
$
0
0

Hi Experts,

I have table A. Iam using Excute Sql Task to truncate table A.

Then my DataFlowtask loading oledb source to table A. I want to implement rollback of A If dataflow task failed.

For that I have taken both tasks in Sequence Container and Changed Sequence container Transaction=Required.

Then while executing   Package it not loading data. If  I set Transaction=Supported then executing proper and loading data.

Thanks in advance friends

↧

Time out error in Transfer SQL Server Objects Task

October 21, 2016, 5:26 am
$
0
0

Hi,

I am having Transfer SQL server object Task in my SSIS package and it is giving following error 4/5 times when I execute the package. I am using SQL server Data tools 2010 for my SSIS package.And my source and destination database server is SQL server 2014

Code: 0xC002F325
   Source: Create Tables Transfer SQL Server Objects Task
   Description: Execution failed with the following error: "Timeout expired.  The timeout period elapsed prior to completion of the operation or the server is not responding.".
•I unchecked for "Cancel long running query after 30 seconds" in Query and view designer options.
•I have also set connection timeout and Query time out as 150 in Business Intelligence Designer Option.

But nothing is working for me, can anybody please suggest how to resolve this issue?

↧
↧

How to set Active flag false in target table if record is not available in source and available in target.

October 21, 2016, 7:21 am
$
0
0
I am working on an SSIS job where I am importing a .xls file to OLE DB destination (sql database). We load these files on daily basis. The .xls file contains records of hospitals. Each row represents a hospital.  I am able to do insert and update for this process

Here's what I need help with:

If the hospital no longer active we are going to get the same .xls file without the record of hospital. How do I check to see if the record is not in .xls file but it exists in SQL database? I need to update that hospital row in SQL database and update the IsActive field for that row to false.
↧

Loading Data into target table from source files

October 21, 2016, 7:08 am
$
0
0

mapping columns from text file to database

We get multiple files from multiple clients..for which we need to load all files into one stage table...below i will explain one client scenario


i have 3 text files comming from a client..each have different columns..but there is only
one id column which is common on 3 files..i need to load these 3 files into only one table
where column names are different than column names in text files.

sample data for 3 files

file1.txt

empid     empname       dptno       dname         sname
100       john           a10        marketing     howard
200       smith          b10        sales         scott
300      dustin          c10        hr            sdfsfd
400       scott          d10        payroll       steve 
500        rachel        e10        it            robert





file2.txt

empid     addr1          addr2
100       NYCITY NY 
200       LA CA
300      SEATTLE          WA
400      RICHMOND         VA
500      CHICAGO          IL


FILE3.TXT

EMPID      SPOUSENAME
100         JENNA
200         CHRISTY
300         HEATHER
400          ASHLEY
500         AMBER


TARGET TABLE

EMP_STG

empid     EmployeeName        DeptNo   DeptName       SecondName   Address1    Address2       SpouseName






IF YOU SEE ABOVE DATA..COLUMN NAMES OF FILES AND TABLE ARE DIFFERENT..In order to map source to target columns i created a lookup table (In real scenario there are 100's of  files..and 100's of columns ..and when i created lookup i got 800 rows and 500 different column names..but below is the sample )
MY LOOKUP TABLE IS LIKE THIS

SOURCE COLUMN NAME               TARGET COLUMN NAME
empidempid
employeeid                              empid
eid                                     empid
empname                              EmployeeName
ename                                EmployeeName
dptno                                DeptNo
deptno                               DeptNo
dname                                DeptName
dptname                              DeptName
sname                                SecondName
Scdname                              SecondName
addr1                                 Address1
adr1                                  Address1
addr2                                 Address2
adr2                                  Address2
spousename                           SpouseName
Spouse                               SpouseName



so my question is whenever i get an input file it needs to look  into lookuptable and and pick corresponding target column and load data into emp_stg table..Any ideas how to do it..

What i did:

I loaded 3 flat files into one table named as "InitialLoad" using ragged right option in ssis flat file as source ..In this InitialLoad table we will have only one column but it consits of 3 files data..with comma separated  values
..After that i extract rows only with column names from InitialLoad table ...and tried to extract target columns like these  

select  TargetC_olumn_name from <lookuptable> where Source_column_name in
(...<all column names from file)..I do get target column names..

but i cannot map resulting columns with exact value in InitialLoad table..I am struck here..i am not sure how to proceed from here..

..Any ideas how to map input columns to Target columns..?

ssisnovice

↧

SSIS FTP Task Variable Remote Path invalid

June 16, 2006, 10:10 pm
$
0
0

I am working on the SSIS FTP Task that transfer file from one FTP server to local location, rename the file name, and finally transfer the renamed file to another FTP server. So I defined 2 FTP tasks.

For the FTP file receive operation, I need the remote path to be updated by a script and pass to the user define variable. So I set TRUE to IsRemotePathVariable. In the RemoteVariable, I set User::FTPSourcePath where the variable is set in the script with "/DMFTP/filename1.jpg"

For the FTP file send operation, I set TRUE to IsRemotePathVariable. In the RemoteVariable, I set User::FTPDestPath where the variable is set in the script with "/DestFTP/"

After all the setting, the FTP Task box show me the error as "Variable "FTPSourcePath" doesn't start with "/". Another FTP box show me "Variable "FTPDestPath" doesn't start with "/"

Can anyone help me on this problem?? Thanks.

↧
Search

What is the version of SSIS Package on SSDT for VS 2015?

October 21, 2016, 12:44 pm
$
0
0

Hi All,

What is the version of SSIS package (like we say 2008 SSIS package or 2012 SSIS package) on SSDT for VS2015?

 MSDN - SSDT for VS2015

In the above link, in supported SQL versions, it’s mentioned that it supports Integration package from SQL Server 2012 to SQL Server 2016. What will happen if I will SSIS 2012 package open it in VS 2015? Will the SSIS 2012 package be upgraded to SSIS 2016 version?

Regards,

Amit



↧
↧

Project deployment model project not picking up environment.

October 21, 2016, 12:23 pm
$
0
0

Hello Folks:

I have developed an SSIS application that I have working and am ready to deploy.  In SSDT-BI - I have a number of project level connection managers with connection strings that map to the Developer Edition I have on my laptop.  By our convention - the name of the connection manager is the name of the database it references.  So the connection (in the SSDT-BI world) for AdventureWorks would be implemented in AdventureWorks.conmgr and the connection string would be:

DTS:ConnectionString="Data Source=.;Initial Catalog=AdventureWorks;Provider=SQLNCLI11.1;Integrated Security=SSPI;Auto Translate=False;" />

So - project working - I parameterized all the connection managers.  As expected - Project Parameters for each of these - with the DataSource=. I had used during SSDT-BI testing.

I created an Environment called Development - and deployed that to a project in SSISDB on a development server.  (Not my laptop - where I did the SSDT-BI work.)  In that environment I have a variable called AdventureWorks.  It contains a connection string that begins with DataSource=REALNAME.  With that done - I deployed my SSIS project to the same folder on the development server.

When I right mouse on the project within SSISDB - and choose properties - I get a menu that only contains General and Permissions.  I do not get references or parameters that I expect fro various postings around the web.  Further - if I attempt to (right mouse) execute a package - making sure the environment is checked - it starts but fails because some of the databases necessary are not on the the particular server I am running on. 

I ran profiler on my dev server.  I see requests for every database coming in - even for databases that are not on that machine.  Further - all the requests are for Data Source = .  So - I'm concluding my environment is not getting sucked in.

What am I doing wrong?

John

↧

SSIS - How to ignore sequence value for a table using Attunity Oracle Destination

October 21, 2016, 1:13 pm
$
0
0
I am trying to load data in oracle table. The table has sequence for the primary column (ID). When I try to ignore the column in attunity destination it is throwing error. But it is working in oledb destination.

How can make attunity destination to ignore the primary key field?







↧

SSIS Script Failing in VS2015

October 21, 2016, 1:44 pm
$
0
0

I've hit what appears to be a show stopper in my quest to convince my organization to jump on the SQL2016 bandwagon.

It appears any SCRIPT task I attempt to run in VS2015 fails, with one trivial exception.

Here' the environment I am operating in:

SQL Server: Microsoft SQL Server 2016 (RTM-CU2) (KB3182270) - 13.0.2164.0 (X64)  Sep  9 2016 20:13:26   Copyright (c) Microsoft Corporation Developer Edition (64-bit) on Windows Server 2012 R2 Datacenter 6.3 <X64> (Build 9600: )

 

Visual Studio 2015: 14.0.23107.0 D14REL

 

Data Tools: 14.0.60923.0 (Released in June, 2016)

 

.NET Framework: 4.6.01055

After a bunch of monkeying around I opted to do the simplest test of all... A package that only has a single script task that does nothing.  Initially it runs successfully, but if I open it with the script editor, it fails.

The details of my test follows:

 

  1. Create a SCRIPT TASK that only contains the default template for C#.
    1. OBSERVE: The SCRIPT task runs in VX2015 successfully.
  2. Edit the SCRIPT task==>Edit Script==>Save it. (No code changes).
  3. Exit the SCRIPT EDITOR.
  4. In the SCRIPT EDITOR, hit OK.
    1. OBSERVE: Scripts contained in the package have compilation errors. Do you want to save the changes.
    2. Hit YES.
    3. OBSERVE: The SCRIPT TASK now has a RED X.
    4. The binary code for the script is not found. Please open the script in the designer by clicking Edit...
  1. Back in the SCRIPT Editor attempt to BUILD the script:
    1. BUILD==>Build ST...
    2. OBSERVE:
      1. Unexpected exception: System.IO.FileNotFound Exception: could not load file or assembly 'System.Collections.Immutable, Version=1.1.37.0, Culture = neutral, ....

I know I'm not the first person to attempt to run a SCRIPT task in VS2015, but it sure feels like I'm deep in the woods.

What am I missing?

Thanks,

↧

SSIS approach to import multiple datasets

October 21, 2016, 10:04 am
$
0
0
Hi, I am using SQL Server 2014 with SSDT BI for visual studio 2013. I have a requirement to copy datasets from a third party SQL Server to our reporting database. Everytime we load this data we drop and recreate table objects. I tried using openquery with linked server connection and its too slow and we have more than 300 datasets to copy. What is best way to approach this in SSIS when writing something in t-sql isn't an option when copying many different source objects to destination.

P.S: The catch here is the business requirement to drop and create the object in the staging database

Thank you in advance....

SQLEnthusiast

↧
↧

SSIS feed list to the table list collection property

October 21, 2016, 2:28 pm
$
0
0
Hi, I am using SQL Server 2014 with SSDT BI for visual studio 2013. For a Transfer SQL Server Object Task I would like to store collection of tables in a variable, and assign this variable to the ObjectsToCopy.TablesList property with an expression. Is there a way to feed this list via a variable to the TableList collection property?

Thank you.


SQLEnthusiast

↧

Create Directory on SFTP if not exists using winscp script

September 26, 2016, 11:38 pm
$
0
0

HI

I am connecting to SFTP server in my SSIS package using winscp.

The issue that i am facing is i need to check if folder already exists on the SFTP server.

If it does not exist ,create a folder on SFTP

Bit if the directory already exists, then just move the files.

Tried googling it, but could not find relevant answer.

I am creating script in VB and then executing that script through winscp.

If someone can help on urgent basis??

Script generated , looks like and is working fine as of now :

ECHO OFF
NET USE B: /DELETE
REM Check if already mapped
DIR Z:
IF NOT ERRORLEVEL 1 GOTO Connected
SET ERRORLEVEL = 0
NET USE Z: SFTPSrrverNameTemp password /USER:testuserName
:Connected

Thanks,

↧
Search

SSIS - Storing datatable in variable from CSV and Impact on Performance

October 24, 2016, 7:15 am
$
0
0

Hello,

I need to load data from CSV and check few things before actually added it into live table(s).

So in one of the step, i will load data into CSV and will store it in variable, will do some verification and then will insert data into actual tables.

Storing it in variable to use in next steps has any impact on performance?

i mean instead of using OLEDB destination editor to load data from flat file.

Max data can be, say around 10000 with around 35-40 fields.

Technical Project Manager cum Architect

↧

SSIS 2005 and Issues with Protection Level

October 3, 2016, 5:56 pm
$
0
0

Hello All

We have SSIS packages in SSIS 2005. Someone created the package and Protection Level was set to "EncryptSensitiveWithUserKey". All of sudden the same code is not working. While executing we are getting  the following message.

Message

Executed as user: <Name of Proxy Account>. ....00.5000.00 for 64-bit  Copyright (C) Microsoft Corp 1984-2005. All rights reserved.    Started:  3:21:56 PM  Error: 2016-10-01 15:21:57.02     Code: 0xC0016016     Source:       Description: Failed to decrypt protected XML node "DTS:Password" with error 0x8009000B "Key not valid for use in specified state.". You may not be authorized to access this information. This error occurs when there is a cryptographic error. Verify that the correct key is available.  End Error  Error: 2016-10-01 15:22:27.87     Code: 0xC0016016     Source:       Description: Failed to decrypt protected XML node "PackagePassword" with error 0x8009000B "Key not valid for use in specified state.". You may not be authorized to access this information. This error occurs when there is a cryptographic error. Verify that the correct key is available.  End Error  Error: 2016-10-01 15:22:27.87     Code: 0xC0016016     Source:       Description: Failed to decr...  Process Exit Code 1.  The step failed.

You would be surprised to know the moment server was rebooted, this issue went away. But again the code is not working. There is connection manager for oracle when we try to connect by inputting password, we cant make connection manager to work. Its OLEDB connection. We tested the userid and password from SSMS and its working.

It is due to the protectionLevel we have in place the connection is not working. Appears to me that's the reason.

I will try to change the protection level and try to run. We tried once but the same didn't worked.

best regards,

Sidd


↧
↧

deleting files with file system task and wildcard

October 24, 2016, 7:49 am
$
0
0
Hi we run 2012 enterprise. I would have thought from https://zappysys.com/products/ssis-powerpack/ssis-file-system-task-advanced/ that by creating a variable with a wild card I could use the file system task to delete files using a wild card.  I stuck *.dat after the path and common 1st 7 chars of each of my file names.  But I got an invalid character in the file name error .  DO I need to create a loop over a file name collection?  I do not have the option of creating a directory just for these files.
↧

Incremental Package Deployment in SSIS 2012 Project Deployment Model

October 24, 2016, 7:33 am
$
0
0

hello,

We have recently migrated all our SSIS 2008 packages to 2012 and adopted to project deployment model, and so would like to know what's the best approach to deploy a package updated in a project. (came to know we don't have incremental package deployment under 2012 and available in 2016) Would like to know what are the best practices if we want to deploy updated package to production etc..

Appreciate your help..!!



↧

How to load CSV accessed via HTTP into a table with SSIS?

October 24, 2016, 8:41 am
$
0
0

I would like to load a CSV file located remotely (something like "http://productdata-download.affili.net/affilinet_products_xxx_yyyy.csv?auth=moreOrLessSecretCode&type=CSV&file=0") into a MS SQL Server using SSIS. Since I am new to SSIS, I have no idea on how to proceed.

Unfortunately, I cannot use the "flat file source" since it only accepts local files.

Can anybody hint me to the right direction?

↧
Viewing all 24688 articles
Browse latest View live
Search