Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

How to use loop to insert multiple tables into oracle db using MSFT Attunity

$
0
0

hi folks:

  Recently, I've encountered a situation where I need to transport a large number of tables from SQL SERVER to Oracle. 

I've used MSFT Attunity to transport data from SQL SERVER to Oracle which works great for a single table. Now, the challenge is that I have a large number of tables and really don't want to create a data flow task for each table. 

  If the destination is Sql server, I'll simply use variable in the data access mode but it does not exist in the oracle destination using MSFT attunity. I've attached the picture below. 

   Any ideas on how to solve this ? 

 

Thanks

 


--Currently using Reporting Service 2000; Visual Studio .NET 2003; Visual Source Safe SSIS 2008 SSAS 2008, SVN --


Error while importing/exporting .xslx Microsoft.ACE.OLEDB.16.0 / 15.0 / 12.0

$
0
0

My Setup is as follows:

Windows 8.1 - 64bit

SQL 2016 GA -  64 bit

Office 365 - 64 Bit.

- Have installed Access Drives for office 2007, 2013 all 64 bit.

Now none of the solutions described online have worked so far.

Office 2003 components worked fine. All other even after getting installed and being shown in list of providers is not working.

I am getting the same error ...

TITLE: SQL Server Import and Export Wizard
------------------------------
The operation could not be completed.
------------------------------
ADDITIONAL INFORMATION:
The 'Microsoft.ACE.OLEDB.12.0' provider is not registered on the local machine. (System.Data)
------------------------------

Since I have installed the office 365 - from online Click-to-Run process. it wont allow me to install any other setup as it conflicts with the click to run installer.

All this is quite a pain and after so many years and version I dont get it whats wrong and why we have to keep doing so many things just to get this basic stuff working.

I guess I will install all this on a new server and then check... But its quite annoying... Hope there is some better work around of fix for this.

Run a SSIS package from remote server

$
0
0

I have created a SSIS package in one server say XYZ which is used to run a .exe file in that server (XYZ). I have my main packages created in another server called ABC once all the packages ran successfully in ABC server i need to run the package in XYZ. I have shared the SSIS package folder in XYZ so that i can access it from ABC server.

  I read that "The executable will always run in the context of the operatingfrom which you call it, not on which you call it. In other words, even though you are calling the copy of cmd.exe located on a remote machine, it is still executing on the machine running the SSIS."

So what is the correct method to achieve this.


Sarvan

I tried the below and want to know is this a correct method.

Created a new job step in SQL server agent after my last job step.

Changed the 'On Success Action' to Go to the next step.

The next step was configured to run the package which is in XYZ server. I choose Package Source as 'File System' and directly choose the .dtsx package from XYZ server.

Integration Services DLL Issue - SSIS 2012 & SSIS 2008 R2

$
0
0

I have setup Integration services in one of my windows clustered environment. This was earlier hosting SSIS 2008 R2 and the development team did a recent migration of the databases to SQL 2012.

From our understand the packages were not upgraded and they are still of 2008 R2 Version. post migration there were few errors and we had to follow the below link to address the issue. The fix was to install SSIS 2012 and other client tools. 

http://pietervanhove.azurewebsites.net/?p=461

Things were working fine and all of a sudden we notice a peculiar issue everyday after a specific package starts running. It goes

into a never ending state and other packages are also failing. 

GAC_MSIL still has SQL 2008 R2 related ssis assemblies. 

Noticed the below messages when i had enabled logging. Script invocation errors were seen. 

does not exist in the namespace 'Microsoft.SqlServer.Dts.Tasks.ScriptTask' (are you missing an assembly reference?)

Cannot apply indexing with [] to an expression of type 'Microsoft.SqlServer.Dts.Runtime.Variables'

The referenced component 'Microsoft.SqlServer.ManagedDTS' could not be found. 

Below link deals with a similar issue and the solution there did not help too. 

https://caonnect.microsoft.com/SQLServer/feedback/details/744390/ssis-any-pre-2012-error-cannot-apply-indexing-with-to-an-expression-of-type-microsoft-sqlserver-dts-runtime-variables 

I solve the problem moving the file "Microsoft.SQLServer.ManagedDTS.dll" located in the path:
"C:\Program Files (x86)\Microsoft SQL Server\110\SDK\Assemblies" to a backup folder, then the bids take the reference from the path C:\Windows\assembly\GAC_MSIL\Microsoft.SqlServer.ManagedDTS\10.0.0.0__89845dcd8080cc91\Microsoft.SqlServer.ManagedDTS.dll

What worked for me was a restart of the SQL instance. This again is not a permanent fix and i was wondering if anyone faced a similar issue. 

Should the team upgrade all packages to 2012? Should only one version of SSIS be running in the server? Should i add SSIS 2012 DLL files in GAC?

Requesting your Inputs and ideas in case you had faced a similar issue in the past. 


Balaji.G


DontSaveSensitive; Key not valid for use in specified state error

$
0
0

I initially had my packages set to 'EncryptSensitivewithPassword' and usedthe config files.  My job executes fine.  But I noticed I was getting THE error "......Key not valid for use in specified state.....".  So, I change the protection level to 'DontSaveSensitive' , saved packaged ,build and re-imported it.  And I still get the same result.

What am I doing wrong??   Package is on the same server where it was built.

I have a package in production that executes without the error.  I made a change to the package (logging) in test and now it also encounters same error as the package referenced above.

[Azure Blob Upload Task] - Value does not fall within the expected range. (Microsoft.SqlServer.ManagedDTS)

$
0
0

Hi

I’m trying to use the Azure Blob Upload Task to move a file from my C drive to my Azure Storage account but on running the SSIS project (or just the component by itself) I get the error
: Value does not fall within the expected range. (Microsoft.SqlServer.ManagedDTS)

I know the storage account is fine because I can use Azure Storage Explorer and save files without issue.
The SSIS connection is also good.

Dev Environment: VS 2015, SSDT(latest)

Thanks
Mike

Here is the simple 1 component code dump

<?xml version="1.0"?>
<DTS:Executable xmlns:DTS="www.microsoft.com/SqlServer/Dts"
  DTS:refId="Package"
  DTS:CreationDate="7/29/2016 2:11:02 PM"
  DTS:CreationName="Microsoft.Package"
  DTS:CreatorComputerName="xxxxxxxxxxxx"
  DTS:CreatorName="xxxxxxxxxxxx"
  DTS:DTSID="{89ECFBD1-797A-4EBC-8986-5895DBFFED83}"
  DTS:ExecutableType="Microsoft.Package"
  DTS:LastModifiedProductVersion="13.0.1601.5"
  DTS:LocaleID="1033"
  DTS:ObjectName="Package"
  DTS:PackageType="2"
  DTS:VersionBuild="13"
  DTS:VersionGUID="{1698E589-21E6-4AD6-A5A9-7105925C75F4}">
  <DTS:Property
    DTS:Name="PackageFormatVersion">8</DTS:Property>
  <DTS:Variables />
  <DTS:Executables>
    <DTS:Executable
      DTS:refId="Package\Azure Blob Upload Task"
      DTS:CreationName="CopyToBlobTask"
      DTS:Description="Azure Blob Upload Task"
      DTS:DTSID="{02652254-7C2E-496F-84D4-D4AEA71D590F}"
      DTS:ExecutableType="CopyToBlobTask"
      DTS:LocaleID="-1"
      DTS:ObjectName="Azure Blob Upload Task"
      DTS:TaskContact="Azure Blob Upload Task; (C) Microsoft Corporation; All Rights Reserved"
      DTS:ThreadHint="0">
      <DTS:Variables />
      <DTS:ObjectData>
        <CopyToBlobTask
          ConnectionId="{C2D09777-093F-43D7-89D6-9DA54A4176FE}"
          BlobContainer="mssqltest"
          LocalDirectory="C:\Download\Blobtest\up"
          FileNameFilter="*"
          TimeRangeFrom="01-Jan-1900 12:00:00 AM +10:00"
          TimeRangeTo="31-Dec-2200 12:00:00 AM +10:00" />
      </DTS:ObjectData>
    </DTS:Executable>
  </DTS:Executables>
  <DTS:DesignTimeProperties><![CDATA[<?xml version="1.0"?>
<!--This CDATA section contains the layout information of the package. The section includes information such as (x,y) coordinates, width, and height.-->
<!--If you manually edit this section and make a mistake, you can delete it. -->
<!--The package will still be able to load normally but the previous layout information will be lost and the designer will automatically re-arrange the elements on the design surface.-->
<Objects
  Version="8">
  <!--Each node below will contain properties that do not affect runtime behavior.-->
  <Package
    design-time-name="Package">
    <LayoutInfo>
      <GraphLayout
        Capacity="4" xmlns="clr-namespace:Microsoft.SqlServer.IntegrationServices.Designer.Model.Serialization;assembly=Microsoft.SqlServer.IntegrationServices.Graph">
        <NodeLayout
          Size="190,42"
          Id="Package\Azure Blob Upload Task"
          TopLeft="69.5,86.5" />
      </GraphLayout>
    </LayoutInfo>
  </Package>
</Objects>]]></DTS:DesignTimeProperties>
</DTS:Executable>

Data mining query task and connection problems

$
0
0

Hi!

 

I have problem using Data mining query task: when I want to set connection to Analysis services DB I don't see connections created in connection manager (they are not listed in the dropdown). (I can click on "New" and create new one but I already have one created in connection manager.)

 

Also, I want to make connections created in the connection manager flexible, easy to change after transfering package(s) to another server. How to do that?

 

Thanks in advance!

RowCount Vs @@RowCount

$
0
0

Hi Developers 

Hope you are well, I would like to find out how do i go about this 

So what i need to do is create some sort of Pseudo Code In SSIS That will say 

If the Records that have been inserted is equal to the records actually loaded on the table then proceed with the SSIS package else notify user via email 

i would like some advise on how to go about it 

Please Help 

Thank You 


SSIS - incremental load to Azure

$
0
0

Can I use SSIS to incrementally load data from an on-premise SQL Server database to Azure SQL Database (PaaS)? If yes, are there any good articles that I can refer to? I was tryong to create a test package and was getting the error:

Description: "Keyword or statement option 'DTS_Buffers' is not supported in this version of SQL Server.

I was using Visual Studio Tools for Applications 2012.

[File System Task] Error: The process cannot access the file because it is being used by another process.

$
0
0

Hello Team,
I've a common issue as follows:

In my SSIS package
I have excel files to be loaded into target and the same is processed through a Foreach loop container.
After the process, the respective files need to be moved to Success/Failed folder.
But the issue is once a file is processed, the very next file does not process either and also it does not move to the Success/Failed folder.
it shows the error:

"The Process cannot access the file because it is being used by another process"
Task move files to success folder failed

Please get me a proper solutions for this.

Learning MSBI

$
0
0

Hi Experts,


I am in SharePoint, but now planning for MSBI, and starting with SSIS. Please let me howz feature of MSBI ?

Please suggest some study materials for me.

Thanks for your help.

Thanks,

Mahesh


Please Mark as answer if found useful :)


SSIS - No congif file created when deploying manifest file

$
0
0

Hi All,

I'm new to SSIS. I want to deploy a SSIS 2008 package to the server. I created Manifest file and xml config file. Then copied the package, config and manifest files to server. Then I tried to deploy the manifest file in the server. When doing file system deployment , only package created to the destination folder but no config file created. What will be the reason for this?

Thanks,

Julie


Cannot create SSIS Project

$
0
0

Visual Studio 14.0.25424.00 Update 3

Running as Admin

SQL Server 2016 Integration Services Designer 13.0.1601.5

SQL Server Data Tools 14.0.60629.0

When I try to create a SSIS Project, nothing happens, except in the status bar

Creating project 'project name' ... project creation failed.

No other useful information is provided.

So yet another day wasted on poorly documented buggy product.

Package that runs perfect on SSIS, but fails on SQL - server job activity

$
0
0

Hi , 

I wonder if you can help me,  I am having an annoying problem which I can't figure out for the last few days... I get these errors when I run a package, that runs perfect on SSIS, on SQL - server job activity:

Error: There were errors during task validation

Error: .. failed validation and returned error code 0xC0208449

Error: One or more component failed validation 

ADO NET source has failed to acquire the connection {...} with the following error message "exception from HRESULT: 0x80131937

Some additional info:

- I am using project deployment  mode

- my Sql server version is 2014

- My protection level in SSIS is  DontSaveSensitives both in project and packages, but I think that it doesn't matter when I deploy anyway...

- The package I get this error about run on SSIS but not on SQL-server job activity

Thanks in advance! Liat 

Loop through files selecting only certain files to process

$
0
0

I have a package that reads files (e.g.0828_20150828_RRD_CT1_FILE.TXT) with a process date in the name some files are placed in the process directory as much as four weeks ahead of schedule. the package needs to only process files with date less than or equal to todays date. I have some code to parse the file name and determine if the file meets the criteria but how do I get the script task to bypass the file without throwing a error and causing the package to stop executing the for each loop? All I really need is for it to not error and just check the next file.


Software needed for msbi latest version

$
0
0
hi i wanted to know that what software we need to install and work on msbi projects from scratch.pls suggest me.

Saving UTF-Text Files in SQL

$
0
0

Is there a way to save UTF-8 text files as a column in a SQL database using SSIS?

Thanks,

DTEXEC running in 32 bit instead of 64 bit mode by default - In SQLserver Job

$
0
0

Hello, 

we are running SQL 2016 Enterprise  MSDN version. 

JObs/ Packages  migrated from SQL 2012 when running in SQL 2016 are running by default in 32 bit mode

Here is how we are invoking the package

dtexec /SQL "\bs_rebuild_claim_eom" /MAXCONCURRENT " -1 " /REPORTING V

Here the is the job log. Note 32 bit on first line

Message
Executed as user: ****\******. ...n 13.0.1601.5 for 32-bit  Copyright (C) 2016 Microsoft. All rights reserved.    Started:  3:04:42 PM  Info: 2016-07-26 15:04:42.62     Code: 0x40016041     Source: bs_rebuild_claim_eom     Description: The package is attempting to configure from the XML file "C:\Program Files\Microsoft SQL Server\Configuration\SSIS_Config.DTSCONFIG".  End Info  Info: 2016-07-26 15:04:42.62   

Question - why is the job running the package in 32 bit mode?

When we specify a path to pickup 64 bit in the job it runs in 64 bit

"D:\Program Files\Microsoft SQL Server\130\DTS\Binn\dtexec.exe" /SQL "\bs_load_clm_tbls" /MAXCONCURRENT " -1 " /REPORTING V

I upgraded the packages to SQL 2016 through Integration services

Execute SQL task for BACKUPS

$
0
0

Hi there,

I want to use a variable for the backup destination file (.BAK) in my Execute SQL Task. how can I pass the parameter previously defined in Parameter Mappings?

Thanks for your time,

Unable to publish SSIS project to SSIS catalog

$
0
0

I have created a new Integration Catalog on one of our SQL Servers (SQL 2014)

and I have a project that I want to deploy to it, but when I try and connect to the folder browser I get the following message

"the server principal "SQLdomain\username" is not able to access the database "SSISDB" under the current security context. (Microsoft SQL Server, Error : 916)"

The SQL server is on a different domain to the main office domain and I connect via SQL user account.

How do I get the project to deploy under my SQL user rather than a domain account?

Thanks

Viewing all 24688 articles
Browse latest View live