We recently upgrade SQL server from 2008 to 2014.

We have some SSIS packages. Now we start to use the project deploy model to replace package deploy model.

I found one issue that really frustrating.

That is when executing a package in SSISDB catalog by right click the package and execute, if the package has a source or destination that is on network share or UNC path, then the package failed with Access denied. even I have all permissions to the share. 

I searched online it says because when we execute from SSISDB catalog, it caused double hop issue, the fix is to setup SPN and allow Kerberos  authentication.  Just for this small issue like this , we have to setup SPN and Kerberos, this is a  little frustrating.

When we use package deploy mode, we save packages on file system, and never have an issue like this, and we never need to setup spn and Kerberos authentication.

Also in the new deploy model, if I execute that in SQL agent job, it suceeed, there is no issue about double hop, it is only in SSISDB catalog.

Is this known issue, and what is the workaround of that?

Try to use the new model, but don't find much advantages compare with using package deploy model to the file system.

Thanks

SQLFriend

I simplified the issue to a simple write action in C# script task, writing current time stamp into a text file located on the same machine inC:\test\, the directory has been granted full control to Everyone and NT Service\MsDtsServer130, NT Service\SQLSERVERAGENT. The environment is SQL Server 2016, Visual Studio 2015, and Windows Server 2016.

If create a SQL Server Agent job from file system, it updates the text file as expected. If deploy the package into SSISDB and execute, the execution report shows all success while the write action actually never happened. And I was not able to find any clue in system logs.

I will be very grateful to inputs on:

• What might be wrong in this simple-write test; and
• How to get more useful log information about this error and possibly other issues.

Code in the simple-write script task:

public void Main()
{
    Dts.TaskResult = (int)ScriptResults.Failure;
    try
    {
        // TODO: Add your code here
        using (var writer = new StreamWriter("C:\\test\\simple-write.txt", true, Encoding.Unicode))
        {
            writer.WriteLine(DateTime.Now.ToString("yyyy-MM-ddTHH:mm:ss.fffffffK"));
            writer.Flush();
        }
        Dts.TaskResult = (int)ScriptResults.Success;

    }catch(Exception ex)
    {
        Dts.Events.FireError(0, "Simple-Write-Test", ex.ToString(), String.Empty, 0);
        Dts.TaskResult = (int)ScriptResults.Failure;
    }
}

** The catch block is supposed to fire an error if something goes wrong in the write action; but it was not triggered and task seems to be successful in execution report.

I just installed the 15.8.0 update to Visual Studio 2017 and now I am unable to deploy SSIS projects and packages to the SSIS Catalog from within Visual Studio 2017.The Deployment Wizard does still work from the command line, however.

I have repaired SQL Server Data Tools. I have repaired Visual Studio 2017. I have uninstalled and reinstalled SQL Server Integration Services Projects. The end result is the same:

ETA: This error occurs after the "Connect" button is clicked on the "Select Destination" page of the Wizard.

===================================

Could not load file or assembly 'Microsoft.SqlServer.Management.IntegrationServicesEnum, Culture=neutral, PublicKeyToken=89845dcd8080cc91' or one of its dependencies. The parameter is incorrect. (Exception from HRESULT: 0x80070057 (E_INVALIDARG)) (mscorlib)

------------------------------
Program Location:

   at System.Reflection.RuntimeAssembly._nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.RuntimeAssembly.nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.RuntimeAssembly.InternalLoadAssemblyName(AssemblyName assemblyRef, Evidence assemblySecurity, RuntimeAssembly reqAssembly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Microsoft.SqlServer.Management.Sdk.Sfc.ObjectCache.LoadAssembly(String fullName)
   at Microsoft.SqlServer.Management.Sdk.Sfc.ObjectCache.LoadElement(ObjectLoadInfo oli)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Environment.GetServerVersion(Urn urn, Object ci)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Environment.GetObjectInfo(Object ci, RequestObjectInfo req)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Enumerator.GetObjectInfo(Object connectionInfo, RequestObjectInfo requestObjectInfo)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Enumerator.Process(Object connectionInfo, RequestObjectInfo requestObjectInfo)
   at Microsoft.SqlServer.Management.Sdk.Sfc.SfcInstance.GetSupportedResultTypes(ISfcConnection connection, Urn urn)
   at Microsoft.SqlServer.Management.Sdk.Sfc.SfcInstance.Initialize()
   at Microsoft.SqlServer.Management.Sdk.Sfc.SfcInstance.MarkRootAsConnected()
   at Microsoft.SqlServer.Management.IntegrationServices.IntegrationServices..ctor(SqlConnection sqlConnection)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.ServerHelper.ConnectToServer(String server, String username, String password, AuthenticationType authenticationType)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.ServerProjectBrowser.validateServerWorker_DoWork(Object sender, DoWorkEventArgs e)

===================================

The parameter is incorrect. (Exception from HRESULT: 0x80070057 (E_INVALIDARG)) (mscorlib)

------------------------------
Program Location:

   at System.AppDomain.nApplyPolicy(AssemblyName an)
   at System.AppDomain.ApplyPolicy(String assemblyName)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.MatchAssemblyName(AssemblyName reference, AssemblyName definition)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.FindAssembly(String name, IEnumerable`1 probingPaths)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.InnerResolveHandler(String name)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.ResolveHandler(Object sender, ResolveEventArgs args)
   at System.AppDomain.OnAssemblyResolveEvent(RuntimeAssembly assembly, String assemblyFullName)

Hi,

I am trying to export the data using SSIS from an oracle 11g DB table to a postgres DB table which has a Jsonb column. In "advanced editor" of source OLEDB component, I have changed the data type of that column as 'DT_NEXT' (Unicode Text Stream) from 'DT_WSTR' (Unicode string). while trying to execute the task, I am getting the error as below

"[TARGET TABLE (JSON_TABLE) [54]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Intellisoft OLE DB Provider for PostgreSQL"  Hresult: 0x80004005  Description: "ERROR:  column "JSON_COLUMN" is of type jsonb but expression is of type character varying
LINE 1: ...ct_JSON_COLUMN") VALUES ($1,$2,$3,$4,$5,$6,$7,$8,$9)
                                                                    ^
HINT:  You will need to rewrite or cast the expression.".

Can anyone please let me know the equivalent data type of jsonb in SSIS as I am unable to find Jsonb datatype in SSIS

Hi Friends - I need to read some data from Amazon Snowflake warehouse and load to SQL server. I am planning to implement it using SSIS. Please provide me the link to install the drivers for it and steps required to integrate the data to SQL server.

Regards..

Hi All,

 we are facing a weird issue after an office upgrade to 2016.

the target ssis catalog is in 2014 where as we are building our projects in ssdt 2015 with deployment mode set to 2014 server.

what we did was , we removed office 2013 and installed office 2016.

now all our script task in ssis are not working and showing a error like 

SeverityCodeDescriptionProjectFileLine
ErrorSystem.IO.FileNotFoundException: Could not load file or assembly 'System.Collections.Immutable, Version=1.1.37.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. The system cannot find the file specified.ST_83f5e20bfab4403f9e4c8fbf2d07b03bC:\Program Files (x86)\MSBuild\14.0\bin\Microsoft.CSharp.Core.targets67

we tried the solution like recreating the script tasks, but all in vain .

please help if you can .

Hi

I deployed a SSIS 2012 project and I received the following message:

How can I solve this message?

I've run into an interesting issue when trying to deploy SSIS packages that leverage project level DQS connection managers.

We're able to deploy SSIS projects and run the SSIS packages to our development environment just fine and run them with no issues. But when trying to deploy the exact same projects to our test environment, the deploy constantly fails at the same point: changing protection level.

After double and triple checking that the package protection level is the same as the project protection level, I decided to try removing the project level DQS connection manager and replacing it with a package level DQS connection manager. Voila! Deployed just fine with no issues.

I'm at a complete loss as to why 1.) the same project(s) deploys fine to one server and not another, and 2.) why a DQS connection manager would have anything to do with the protection level??

I know when deploying to a catalog, it changes the protection level to storage, but again, not sure what a connection manager has to do with that.

The only difference I can see between the two servers are the versions.

The server which has no deployment issues is at 14.0.3029.16

The server that is having issues is at 14.0.3035.2

Apparently 3035.2 is a security update meant to address a security flaw:

https://support.microsoft.com/en-us/help/4293805/security-update-for-remote-code-execution-vulnerability-in-sql-server

After reading this, I still don't see where this would impact deploying SSIS packages with a DQS connection manager.

We'd be fine with using a project level connection manager, but we have two DQS servers and package level connection managers don't travel well between environments.

If anyone has any insight into this or has seen this, please feel free to comment!

Thanks!

A. M. Robinson

I have a 3rd party SSIS JOB running on one of our SQL server. Prior to SQL SVR 2014 SP3 (from SP2 CU12) update, it was running just fine every hour. After the update this morning, the job has been failing.

Any ideas? TIA

Message

Executed as user: XXXX\#XXXXservice. Microsoft (R) SQL Server Execute Package Utility  Version 12.0.6024.0 for 64-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  11:09:17 AM  Error: 2018-11-14 11:09:18.00     Code: 0xC002F304     Source: DeleteErrorFileFolder File System Task     Description: An error occurred with the following error message:"Access to the path 'DimAccount.err' is denied.".  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  11:09:17 AM  Finished: 11:09:18 AM  Elapsed:  0.719 seconds.  The package execution failed.  The step failed.

Hi All, 

I need to create a connection manager to access a REST api on a remote server.  I have the static IP of the server.  I am expecting I need  to create a REST connection manager but when I attempt to do so I don't know which configuration to select if any.

Can someone kindly give a some guidance?  A bit new at this so if I doing something fundamentally wrong please excuse,

Thanks tonnes, Roscoe

Hi everyone,

I have an ssis package that loads data to different csv files. The package dynamically create new files for each of the destination csv everyday. This works fine but I need a task that moves old files from the current folder to an archive folder as the job runs.

For instance, if the current folder looks like this, I want the cleanup task to move files that are older than the current date to the archive folder.

Current Folder (before implementing the cleanup task)

• FileA_20181111.csv
• FileA_20181112.csv
• FileA_20181113.csv
• FileA_20181114.csv   (today)
• FileB_20181111.csv
• FileB_20181112.csv
• FileB_20181113.csv
• FileB_20181114.csv   (today)
• FileC_20181111.csv
• FileC_20181112.csv
• FileC_20181113.csv
• FileC_20181114.csv   (today)

Current Folder (after implementing the cleanup task)

• FileA_20181114.csv   (today)
  
• FileB_20181114.csv   (today)
• FileC_20181114.csv   (today)
  

Archive Folder (after implementing the cleanup task)

• FileA_20181111.csv
• FileA_20181112.csv
• FileA_20181113.csv
• FileB_20181111.csv
• FileB_20181112.csv
• FileB_20181113.csv
• FileC_20181111.csv
• FileC_20181112.csv
• FileC_20181113.csv

me

Hello,

i have a For Loop container to process records. If there is any error while processing, task will skip that record and proceed with other records. and all the errored records will not be marked as processed.

i am looking for something like, once the For loop task completed, i will check for the count of non-processed records. if count >0 then i want to re-execute For Loop container. this execution should happen till all the desired records marked as processed.

i added a sql task to get the count of unprocessed records. if Count > 0 then i have to re-execute For loop. but when i try to add precedence to this, i am receiving message like below. Is there any way to achieve this?

"Cannot create a connector.A task would indirectly depend upon itself. To create this connection, remove one of the other connectors."

Thanks,

Narendra

I have reviewed a lot of the Forum discussions and referenced documentation on how to run SSIS on 64-bit machines and have an Excel source for the incoming data.  I have tried a number of the suggestions without success.

First I will list the error.  I will then note all the the conditions that I have tried and what I have seen.   Please forgive me for the long post.

The error I'm getting is this:

Date  3/1/2011 3:00:00 AM
Log  Job History (GSSETL)

Step ID  1
Server  DB-METRICS-PRD
Job Name  GSSETL
Step Name  RunGSSETL
Duration  00:00:04
Sql Severity  0
Sql Message ID  0
Operator Emailed  
Operator Net sent  
Operator Paged  
Retries Attempted  0

Message
Executed as user: 3PAR\eng_metrics. Microsoft (R) SQL Server Execute Package Utility  Version 10.0.2531.0 for 32-bit  Copyright (C) Microsoft Corp 1984-2005. All rights reserved.    Started:  3:00:00 AM  Error: 2011-03-01 03:00:04.89     Code: 0xC0202009     Source: Package Connection manager "Excel GSS System"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.  An OLE DB record is available.  Source: "Microsoft Office Access Database Engine"  Hresult: 0x80004005  Description: "'Z:\Install_Base_SW-Tracker_Current.xlsx' is not a valid path.  Make sure that the path name is spelled correctly and that you are connected to the server on which the file resides.".  End Error
Error: 2011-03-01 03:00:04.89     Code: 0xC020801C     Source: Data Flow Component Source for Excel Connection Manager [1]     Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel GSS System" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.  End Error 
Error: 2011-03-01 03:00:04.89     Code: 0xC0047017     Source: Data Flow Component SSIS.Pipeline     Description: component "Source for Excel Connection Manager" (1) failed validation and returned error code 0xC020801C.  End Error  Error: 2011-03-01 03:00:04.89     Code: 0xC004700C     Source: Data Flow Component SSIS.Pipeline     Description: One or more component failed validation.  End Error  Error: 2011-03-01 03:00:04.89     Code: 0xC0024107     Source: Data Flow Component      Description: There were errors during task validation.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  3:00:00 AM  Finished: 3:00:04 AM  Elapsed:  3.922 seconds.  The package execution failed.  The step failed.

Actions Discussion:

The SQL Server 2008 R2 server is 64-bit.  I have mapped a drive to the other host that contains the Excel file I'm using for the source data.

I have confirmed that the  Run64BitRunTime option = False.
The Connections   delayValidation = True.
The Connection string points to OLEDB.12 -- Provider=Microsoft.ACE.OLEDB.12.0;Data Source=Z:\Install_Base_SW-Tracker_Current.xlsx;Extended Properties="EXCEL 12.0;HDR=YES;READONLY=TRUE";

The Job step is pointing to the correct file = E:\packages\GSSETL.dtsx
The Job command line is pointing to x86 = /FILE "E:\packages\GSSETL.dtsx"  /X86  /CHECKPOINTING OFF /REPORTING E
The use 32 bit runtime Exectution option is checked.

I used the same domain id to edit, build and test the package as is used for the SQL Agent Service logon account. The same account is used for all of the SQL Services as well.

The domain account is in the local administrators account.

I can run the package and connect to the Excel spreadsheet from the same id in the BIDS debugs environment or the Execute package Utility.

It fails to connect when I run from SQL Server Agent job step.  Or, if I start BIDS as Administrator and try to run the debug feature.

I'm assuming that some level of authority is different when the job is run under SQL Server Agent even when the same user id is used.

Can some one please give me some guidance?

Thank you,

Grant

Hello team,

i have done upgraded VS2008 to VS2012, And while opening master packages i am getting below error for all individual packages .and this SSIS packages using config files .

Please let me know what can be done for this .Thanks 

I'm looking for some help setting up a "variable + filename" setup in connection manager for a large number of files.
Currently I have a SSIS package that runs through the files and imports them each into individual tables in SQL using FlatFile connections. Each file has differing columns and naming conventions so I haven't found other options suitable.

I know that the package works with hardcoded file name values, and I have set up a variable that will show as a ConnectionString when set under Expressions, so it seems getting it to go through and use the variable+filename for each file should be simple.

What I can't seem to do is successfully add the "+ filename" setup for each connection manager. If I simply write it on the end of the ConnectionString as though I'm hardcoding it - which I thought would be correct - then when I go back and change the variable it doesn't seem to update.
If I just leave the connection string as the variable, then it isn't picking up the file names and transfers 0 rows to the DB.

Can anyone let me know what I've missed?

Hi,

I had installed sharepoint list adapters to SSDT 2012. Sharepoint List Source and Sharepoint List Destination components got successfully added in Dataflow toolbox. However when i am trying to create new connection manager for sharepoint list  i am not able to see any sharepoint connection mananger in 'Add SSIS connection manager'. .dll files are also in C:\Program Files\Microsoft SQL Server\110\DTS\Connections.

Thanks 

Bhanu

I am working on bringing data in to a database from multiple sources, I have a particular set of tables - Header -> Details

The customer only wants to bring in Header records going back, say, 90 days.

So I have a date limiter on the header set

There is obviously a Parent ID that is contained in the Details table that connects the two one to many

So, on the next step, when I bring in details, I want to filter out any records for Parent IDs that do not exist in the Parent Table.

I am running the incoming records through a lookup that matches the ParentID in the detail tables to the existing ParentIDs in the Parent table and returns only matches, that is, only write records to the Detail table where the Parent exists

This filter does not work and all the records get passed and I end up with a  FOREIGN KEY constraint failure on the Details table when I go to write the records.  The only way I get it to work is to leave Check Constraints checked but ignore errors, but I don't think that is best practice.

I can post what I am doing, but I just cannot understand why the Lookup returns all records as matched when they are not, unless there is something simple I am missing

DWM

Hello Team,

I have data from pivot table in excel sheet. My header is on Sheet1$A5:D5. and all values are in Sheet1$A5:D6-D230000. But cell range is not fixed sometimes it is Sheet1$A5:D4000 or sometimes Sheet1$A5:D350000 so i really dont know cell range . As for time being i did (select * from [sheet1$A5:D1048576]) to avoid cell range but as i mentioned i am using pivot data so there are so many filters are coming that reflects error if i am using my select query statement.

Please i really need developers help if i can do through script also or may be some other ways. Please try to give me as SSIS package.

Dear All,

Im newbie in SSIS, I have search and try some reference but none its works like I expected.

here my case:

I have some folders that contain some flat file, which is the flat file name and folder name it self will be added as new column.

illustration:

I have 1 main folder that contains 3 sub folder, each sub folder contain the same 3 flat files.

C:\\MainFolder

>>>>> C:\\Main Folder\SubFolderA\

>>>>>>>>>C:\\Main Folder\SubFolderA\a.txt,b.txt,c.txt

>>>>> C:\\Main Folder\SubFolderB\

>>>>>>>>>C:\\Main Folder\SubFolderB\a.txt,b.txt,c.txt

>>>>> C:\\Main Folder\SubFolderC\

>>>>>>>>>C:\\Main Folder\SubFolderC\a.txt,b.txt,c.txt

and, I wan to added 1 new column everytime the package runs, the column name is combination between SubFodler name and File Name, so the output will be like this :NewColumn --> SubFolderAa,SubFodlerAb,SubFolderAc,SubFolderBa,SubFolderBb,SubFolderBc,SubFolderCa,SubFolderCb and SubFolderCc.

does anyone can help with this?

Thank you before.

Best Regards,

Bambang