Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Best way of updating a table with SSIS

$
0
0

I have the next query

insertinto tabla_A (value_1, value_2, value_3)select table_B.value_1, table_B.value_2, table_B.value_3from tabla_A rightjoin(table_C leftjoin table_D on table_C.value1 = table_D.value1)on table_A.value_1 = table_B.value_1where table_A isnull

As you can see, I have several tables involved in this query, and the thing is that table_B, table_C, table_D belong to an Oracle Database and Table_A is located in a SQL server.

What do you thing is the best way to face this query?, I mean by using the less quantity of merge join tasks, and using more the SQL statement.


Is it possible to loop through files in a folder, but only load those with a specific filename?

$
0
0

Hello all. I have a folder with about 100 text files total, but it's really only about 25 different reports, each with multiple quarters. So, for example, it looks like this...

Report A 2014-12-31

Report A 2014-09-30

Report A 2014-06-30

Report A 2014-03-31

Report B 2014-12-31

Report B 2014-09-30

Report B 2014-06-30

Report B 2014-03-31

Report C 2014-12-31

Report C 2014-09-30

Report C 2014-06-30

Report C 2014-03-31

...and so on

I need to load only report B to a table in SQL Sever 2008 R2, but I need to load all quarters for report B. I'm trying to accomplish this using a foreach loop container, but I haven't figured out hot to tell it to only look at report B and ignore the others. In testing, the loop always starts with report A.

In the process, I also need to capture the date section of the filename in a variable so I can create a derived column with the date to insert into the table.

Any ideas how to accomplish this? I'm trying to avoid putting each report in its own folder because it adds a manual step, but if there's a way to do that using a file system task before running the loop, I'm open to it.

Thanks for any advice you have!


WeeLass

broken pipe column delimiter text file in ssis

$
0
0
using ssis to load broken pipe delimit file 

replace , with pipe in csv files

$
0
0
in ssis packages change , with | in csv file 

How data flow when SSIS packages are run on a different server than the DB server

$
0
0

The scenario is that i have a dedicated SQL SErver 2014 SSIS machine that executes the packages.

The database server is a separate machine with SQL Server 2008R2.

1) Running SSIS packages that transfer data within SQL Server 2008R2 (same machine)

2) Running SSIS packages that transfer data between 2 separate SQL Server servers.

How the data flow in these two cases and what resource is being used where? (cpu,disk,ram,network)


Elias

Upload Text file in sql server through SSIS- Dynamic

$
0
0

Hi Team 

I need to upload  .txt file from server path like \\00.00.00.00\[folder name]\ file name 25-01-2015.txt. [file format]

File getting creating on server every day.

Need your inputs on 

How to copy same file with system date -1 to my local server and then to upload same file sql db.


getting xsd location from a variable

$
0
0
Hi we run std 2012.  In my xml file adapter I don't see an option for mapping the xsd source file to anything but a hardcoded value.  Is there a way to get the location from a variable?

Deploy a package in SSIS DB catalog and pass Config file dynamically in a SQL job

$
0
0

Hi,

I have a Package that needs to be deployed in SSIS Catalog DB.

Later I need to execute it through SQL Job.

Please let me know the steps how to do this and also I need to pass a Config file to run the package in SQL job.

Thanks,.

Sailaja


FTP Error in SSIS

$
0
0

I am trying to run a job which contains an SISS package and it runs Under SA ,I get an error for FTP task and when i ran in BIDS it is working fine.The error is below and could anyone please help me to solve the issue.I tried with package protection level and still i am getting the same error.

Message
Executed as user: M****\Svc-****SQLAgent. Microsoft (R) SQL Server Execute Package Utility  Version 10.50.6000.34 for 32-bit  Copyright (C) Microsoft Corporation 2010. All rights reserved.    Started:  2:30:01 PM  Error: 2015-01-27 14:30:02.02     Code: 0xC0016016     Source:       Description: Failed to decrypt protected XML node "DTS:Property" with error 0x8009000B "Key not valid for use in specified state.". You may not be authorized to access this information. This error occurs when there is a cryptographic error. Verify that the correct key is available.  End Error  Error: 2015-01-27 14:30:02.14     Code: 0xC0016016     Source:       Description: Failed to decrypt protected XML node "DTS:Property" with error 0x8009000B "Key not valid for use in specified state.". You may not be authorized to access this information. This error occurs when there is a cryptographic error. Verify that the correct key is available.  End Error  Error: 2015-01-27 14:30:03.48     Code: 0xC001602A     Source: SSISPackage Connection manager "FTP Connection Manager "     Description: An error occurred in the requested FTP operation. Detailed error description: The password was not allowed  .  End Error  Error: 2015-01-27 14:30:03.48     Code: 0xC002918F     Source: FTP Task Get Files FTP Task     Description: Unable to connect to FTP server using "FTP Connection Manager 1".  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  2:30:01 PM  Finished: 2:30:03 PM  Elapsed:  2.496 seconds.  The package execution failed.  The step failed.



Advantage OLE DB in SSIS

$
0
0
I created an SSIS project in Visual Studio 2014 which runs on Windows Server 2008 R2 and SQL Server 2014.  I need to load and ADT file from an Sybase Advantage database into a table on SQL Server.  All I have is the detached ADT file.  The Advantage server is on a different Windows Server.  I downloaded and installed the Advantage OLE DB provider from Sybase.  The provider shows up in the data source list on SQL Server, but it does not show up in the data source list in my SSIS project.  I searched the web but found no solutions.  Is there a solution to this problem?  Is there a better process to use to accomplish this?  Thanks.

Migrate data from Access 2003 database to Azure

$
0
0

Hello,

I have to migrate data from an old Access 2003 database to another existing database with different table and columns. For example, I have Customers table in both databases, but in the local database I have Name, Surname1 and Surname2 columns and in azure I have only FullName column (Azure.FullName = Local.Name + " " + Local.Surname1 + " " + Local.Surname2). Another difference is that in local DB I have PhoneNumber and MobilePhoneNumber columns and in Azure only PhoneNumber column. Sometimes PhoneNumber is home phone number, other times mobile phone number or maybe empty, so I have to check if both columns and get only one phone number. Other thing that I have to do is the following: for each row that migrates in Customers table I have to create another row in another table named Services with the ID generated automatically in the Customers table.

These are very complicated things for me because I have never used Integration Services. I'm doing some test and using SQL Server Import and Export Wizard 32-bit (running from Apps screen of Windows 8.1) I have created a simple package (don't know if it is a package). In this case I have migrate only direct columns. Then I can see my test element in MS SQL Server Management Studio in MyLocalServerName->Stored Packages->MSDB->MyTest. But now I don't know what I have to do with this...

In some sites I can see things like that:

But I don't know how to get this design view...

I'm working with Windows 8.1 Pro (x64) machine with SQL Server 2012 Enterprise (on the intallation time I check all components).

Can you help me explaining the steps? Any useful tutorial?

Thanks in advance,

Jon.

header and footer

$
0
0

hi

in my SSIS package i have to generate 1 file which has just header and footer , all the values are hard coded except one is identity column.

thee no source here, how to do it

DTEXEC - I don't get the data from SQL Package Configurations

$
0
0

I'm running this query

master..xp_cmdshell 'DTEXEC /SQL Post\PostCH_SFTP /DECRYPT Password'
And I get this error

Description: The package path referenced an object that cannot be found: "\Package\Upload.Properties[Disable]". This occurs when an attempt is made to resolve a package path to an object that cannot be found.

\Package\Upload.Properties[Disable]"

This should be taken from SQL Package Configurations. What could I do to be able to get the data from SQL Package Configuration? If I run the package in Data Tools it runs properly.

SSIS 2012 - Use OPENROWSET in SSMS and SSIS

$
0
0

HI Experts , 

I am getting very much confused with 64 bit ,31 bit environment in SQL server, SSIS and MS office , Accessdatabase engine
which I want to use for ETL as what should be the combination


My scenario - I have written an SP with  OPENrowset to be used  in EXECUTE SQL TASK and load data into SQL Table
example 

SELECT * into myTable 
     FROM OPENROWSET (
    'Microsoft.ACE.OLEDB.12.0',
    'Excel 12.0;Database=E:\SourceFolder\Department.xlsx;HDR=YES;IMEX=1',
    'SELECT * FROM [Sheet1$]');



My SQL SERVER version is :: 

Microsoft SQL Server 2012 - 11.0.2316.0 (X64) 

Enterprise Edition (64-bit) on Windows NT 6.1 <X64> (Build 7601: Service Pack 1) (Hypervisor)


MS OFFICE 2010, 64 Bit 

After executing 

sp_configure 'show advanced options', 1;
RECONFIGURE;
sp_configure 'Ad Hoc Distributed Queries', 1;
RECONFIGURE;

My OPENROWset query Store Procedure is working fine in SSMS but when I executed Same SP in EXECUTE SQL TASK ,it failed .
Also I was not able to used Excel as a Source , I forgot the error but it did not even allowed me to select a sheet Name in Excel Source..

After doing bit of google I found that we need to have MS office 2010 in 32 bit because our BIDS is 32 Bit .


I asked my admin team to uninstall MS office 2010 64 bit and Install 32 bit version.

Now my versions are 
SQL server 2012 , 64 bit 
MS office 32 bit 

Now

1) I am able to Take excel sheets as Source in SSIS Excel Source transformation but package fail 

2) SP with OPENROWSET Query in which was running fine earlier in SSMS  is also throwing error

3) and Execute SQL TASK with same SP in SSIS are  throwing error ..

NOW I Installed AccessDatabaseEngine i.e. 32-bit but same issue 

"The 32-bit OLE DB provider "Microsoft.ACE.OLEDB.12.0" cannot be loaded in-process on a 64-bit SQL Server"


PLEASE TELL ME THE COMBINATION .. I cannot reinstall SQL SERVER but definately MS OFFICE VERSION AND ACCESSdatabase engine version

I WANT 

1) MY OPENROW SET QUERY CAN RUN BOTH IN SSMS and Execute SQL Task (SSIS).
2) I can use Excel as a Source in SSIS Package (with out making RUN64bitRUNTIME to FALSE )

PLEASE ASSIST

Unable to add reference for Excel Object Library for use within Script Task

$
0
0

I have a requirement to use a Script Tax that needs to reference the Excel Object Model. There are numerous articles on using this such as http://www.databasejournal.com/features/mssql/article.php/3921141/SSIS-Script-Task-and-Microsoft-Office-Automation.htm.

Simply, I need to add a reference to the Microsoft Excel 12.0 Object Library.

I have selected this from the Object List on the COM tab and when this adds the reference it states 'The System cannot find the reference specified', even though the referenced file for this Object is C:\Program Files(x86)\Microsoft Office\Office12\Excel.exe and this file location exists on my local machine ?


Look up will give multiple records or only single records ?

$
0
0

Hi

My source had                   ID  ---256

LOOKUP(FULL Cache)table   ID, MR_ID

                                         256  5

                                          256  6

Result : Destination ID, MR_ID

                                         256   5

here my problem is

Destination should result as mentioned below:(Multiple records by matching ID)

                                             256  5

                                            256  6

why I am getting                     256   5  ? (only 1 record top 1)?

I want all records by matching ID?? How ?? Please do Help.

Thanks

ssis job

$
0
0

hi

i copied 1 packge and made another one.

while executing job of second package ,its still calling sp that is in first package.

why it is

Create SSIS Import parsing based on text file...

$
0
0

I have a text file listing 500 field names and their lengths.  (In a few months we will begin receiving monthly data files matching that schema). I can create an SSIS 2008 project and manually parse the columns (inside SSIS)  to match that schema but I wonder if there is an easier way to do what I want (e.g. if I created a table using t-sql commands could SSIS somehow "pickup" the SSIS parsing from the table schema?)

TIA,

edm2

SSIS .dtsx Package pre-validation fails when default values of variables is set to UNC path SQL SERVER 2012

$
0
0
 

   Hi ,

       SSIS .dtsx Package  pre-validation fails when default values of variables is set to UNC path SQL SERVER 2012.

If the default  values of variables  set to  any UNC path . (ex. \\QWERTSDS34\Files\Abc\) - package fails on loading.

    But if same default  values of variables set to any invalid path or even empty(ex. Z:\  or  empty ) - package runs successfully.

pre-validation fails  when  in valid UNC path is set  , but for non-UNC path invalid path  runs successfully.

P.S - At runtime Variable are set to valid path from application.



error

$
0
0

whats does this error mean

i download 2008 r2 and try to open package but still getting error

Error1 Error loading  The version number in the package is not valid. The version number cannot be greater than current version number.  
Error2 Error loading Package migration from version 8 to version 3 failed with error 0xC001700A "The version number in the package is not valid. The version number cannot be greater than current version number.".  

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>