Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Data conversion failed. The data conversion for column "value" returned status value 4 and status text "Text was truncated or on

$
0
0

Hi Experts,

 

I am extracting data from SQL Server 2005 to flat file destination. I am using SQL Command to specify the data selection query. One of my query uses Replicate function to derive a column value. When I execute this package it fails with the error "Data conversion failed. The data conversion for column "value" returned status value 4 and status text "Text was truncated or one or more characters had no match in the target code page".

 

The reason for the problem is that, it is taking the InputColumnWidth of the flat file destination as 8000 and I specified the OutputColumnWidth as 4.

 

If I change the OutputColumnWidth to 8000, it is working without any error but resulting in the column width of 8000.

 

I tried using DerivedColumn Transformation's Type cast and DataConversion Transformation but still I am getting the same error in the respective Transformation components.

 

Can anyone suggest how to solve this issue.


For Each looping issue question.

$
0
0
I am maintaining some SSIS packages for a client. The master package goes out to MDS and gets a list of companies that are "active" from an mds entity view. The package then loops through multiple ETL packages for each company in the list. The logic works fine most of the time however when the client adds a new company to the MDS entity and set it to active some of the ETL packages do not run correctly until I manually execute the package for the specific company. Does anyone have any ideas why this would occur in a for each loop in SSIS?  

VS2017 Restart when running packages

$
0
0

I have a number of packages in my project which used to run quite successfully.

When I run them in VS2017 they get part way through and then VS2017 restarts.

If I deploy the package to the database server and execute it from there it runs quite successfully.

Can anyone suggest a way I can diagnose what is happeneing.  I have been unable to fins any logs with pertenant info.

Thanks in advance

Andy

SQL Agent

$
0
0

Hi All,

I have 3 different packages from different projects. I have created a agent job to run one package after another using next step process in agent job. But I am currently looking to change the Job to make it run parallel i.e after one package is completed I want to start the next 2 packages at the same time once the first package finishes. Please help me how to do it.


Thanks in advance


sush

Should I explicitly define my data touch points in a SSIS ETL

$
0
0
So we have written our T-SQL...tested it...and the .csv looks fine. But we DID NOT explicitly define our data touch points...just took what was in the database. In an ETL exercise, does best practice kind of dictate NOT to leave data to chance and explicitly define your output data touch points? Through a CONVERT.

parameter with dynamic query

$
0
0

Hi,

Query 1: Simple query.

Query2: Dynamic query.

 The string from where condition is different for different company as well as table.  So, I created the dynamic query as an example below .  I have the exception for company and 10 and else.  I might not have the right syntax, so please help.

Thanks

Query 1

select * from mytbl
where order in ('ABCD', 'EFGH')

Query 2

declare @query nvarchar(max)
declare @comp nvarchar(3)
declare @string nvarchar(50)

if @comp = 10 
set @string = 'ABCD', 'EFGH'
else
set @string ='IJKL', 'MNOP'
end

set @query = '
select * from mytbl
where order in '+@string+'
'
exec sp_executesql @query


How to append local variable to global variable in ssis?

$
0
0

Hi,

I have created global connection manager for my Packages and I have variable call filePath , file is on netwrok drive.

for example T:\\testConn\\testProject\\*.txt  is my full file path.

file path (T:\\testConn\\testProject\\) var is created under project.params

and file name is local variable.

How should I append both this values in all my packages(they are all independent packages) in SSIS?

Thank you.


chipsy

Adding new items to the SSIS toolbox in VS2017

$
0
0
I'm looking to migrate from VS2008/BIDS running on SQL Server 2008R2 to VS2017 running on SQL Server 2014.  I have some third party items in my BIDS SSIS tool box that I need to add to VS2017.  In BIDS I do a right click and select ...choose items but in VS2017 that's not an option.  I tried the Tools --> Choose toolbox items but there was no SSIS tab like I have in BIDS.  Any suggestions on how to add items to the ssis toolbox?

Issue with SQL Server 2016 SSIS C# Script Task that reads file metadata

$
0
0

Hi

I created a C# Script Task for SSIS 2016 using Visual Studio 2017. The script ran fine in Visual Studio 2017. Then I deployed it in SQL Server 2016 Standard Edition. I created a Job in SQL Server for that and executed the Job. Then it failed with the following error:

Get File Metadata Error: There was an exception while loading Script Task from XML: System Exception: The Script Task "ST_f243e23b696a49118a5366d9120ea814" uses version 15.0 script that is not supported in this release of Integration Services

How do I resolve this? Appreciate your reply

Master key issue in Secondary SSIS DB

$
0
0

Hi Experts

we have always on AG servers (SQL 2014) packages are working fine in A01 node when fail-over happens AG moves to A02 then all packages are failing with error 

Description: Please create a master key in the database or open the master key in the session before performing this operation.  Source: .Net SqlClient Data Provider  Started:  7:44:42 PM  Finished: 7:44:42 PM  Elapsed:  0.156 seconds.  The package execution failed.  The step failed.

i have tried below options but no luck.

USE [SSISDB]
OPEN master Key decryption by password = 'password' -- Password used when creating SSISDB
ALTER Master Key ADD encryption by Service Master Key

Alter master key add encryption by service master key 
close master key 

Could you please suggest me is there any other alternatives to resolve this.

Thanks 

Raghavendra


Thanks & Regards Raghavendra Petla

Running SSIS as an Agent job using a proxy

$
0
0

Hello,
 I built a simple SSIS package using BIDS.

The package does a backup of a DB to a network share.
I imported the dtsx file into SQL Server using SQL Server WB (connected to the SSIS server)

I created a SQL Agent job to run the SSIS package.

I have created a credential that maps to a domain account (BackupUser1). The domain account has access to the network share: I verified it by running a command line using the Run As and accessing the network share as that user.

Of course, I have a sql agent proxy associated to the credentials which is assigned to run the job step that executes the SSIS package.
When the job runs it fails because of access denied to the network share.
To see what actually happened, I changed the permissions and the share (and the NTFS permissions) to allow R/W access to 'everyone'.

I re-scheduled the job and this time it succeeds. I went over to the backup file that was created when the SSIS package executed and discovered that the owner (i.e. the creator) of the file is not the domain account (BackupUser1), rather it's the data base server computer account name DBSRV$
this means that SQL Server Agent didn't impersonate the account defined by the SQL Agent proxy.

I looked for information and wasn't able to find an answer...
A couple of things I made in the local security policy (user rights assignment):
allowed the specified domain account the permission to log-on as a batch job
allowed the SYSTEM principal (the agent runs under LocalSystem) to replace process level token (i.e. impersonate, at least as I understand this user right)

Any thoughts, suggestion on why SQL Server Agent doesn’t actually use the credentials associated with the proxy account to access the network share?

Thanks,
Asher

execute SSIS packages from vb.net

$
0
0

Hi!

 

I was following this article http://www.codeproject.com/useritems/Execute_Package_by_C_.asp to execute list of SSIS packages via vb.net. I created a windows application in server A copied the exe file in server B. the SSIS package is in server B. I deployed the package and it runs file vis integration server. below are my codes. everytime i run the exe in server B. I can see the list of packages but when i hit execute button i get error msgs that says "failure" I am not sure how to get more error out of it. I am not sure whats causing this error.

----------------------------

Imports

System.Data.SqlTypes

Imports

System.Data.SqlClient

Imports

Microsoft.SqlServer.Management.Smo

Imports

Microsoft.SqlServer.Management.Smo.Agent

Imports

Microsoft.SqlServer.Dts.Runtime

Imports

Microsoft.SqlServer.Management.Common

Public

Class Form1

Dim app AsNew Microsoft.SqlServer.Dts.Runtime.Application()

Dim pInfos As PackageInfos = app.GetPackageInfos("\\", "SQLKEV", "", "")

 

PrivateSub Form1_Load(ByVal sender As System.Object, ByVal e As System.EventArgs) HandlesMyBase.Load

ForEach pInfo As PackageInfo In pInfos

If pInfo.Name <> "Maintenance Plans"Then

ComboBox1.Items.Add(pInfo.Name)

EndIf

Next

EndSub

 

PrivateSub btnExec_Click(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles btnExec.Click

Dim app As Microsoft.SqlServer.Dts.Runtime.Application

app =

New Microsoft.SqlServer.Dts.Runtime.Application()

Dim pkgResults_Sql As DTSExecResult

Dim pkgIn AsNew Package()

Try

pkgIn = app.LoadFromSqlServer(

"" + ComboBox1.SelectedItem.ToString().Trim(), "SQLKEV", "", "", Nothing)

pkgIn.PackagePassword =

"password21"

pkgResults_Sql = pkgIn.Execute()

MessageBox.Show(pkgResults_Sql.ToString())

Catch ex As Exception

MsgBox(

"this is an exception" + ex.ToString)

EndTry

EndSub

 

End

Class

----------------------------

 

 

 

please help

Logical Constraints of OR and executing SQL Task

$
0
0

So in my Control Flow, I have an Expression Task that checks to see if the GlobalDateOverride Boolean is set...if it is TRUE, it will get the dates from the StartDate and EndDate variables. If it is FALSE, then there are two Execute SQL Tasks to derive the normal/standard StartDate and EndDate. So two Precedence OR Constraints then feeding the next Execute SQL Task to determine if there are rows to extract.

If the GlobalDateOverride is FALSE, it correctly branches to derive the StartDate and EndDate. However the subsequent Execute SQL Task seems to execute prior to that because of the other OR Precedence Constraint. Do I need to incorporate a WAITFOR in my subsequent Execute SQL Task to wait for the StartDate and EndDate to be derived?

Thanks for your review and am hopeful for a reply.

Unable to deploy SSIS after VS 2017 update 15.8.0

$
0
0

I just installed the 15.8.0 update to Visual Studio 2017 and now I am unable to deploy SSIS projects and packages to the SSIS Catalog from within Visual Studio 2017.The Deployment Wizard does still work from the command line, however.

I have repaired SQL Server Data Tools. I have repaired Visual Studio 2017. I have uninstalled and reinstalled SQL Server Integration Services Projects. The end result is the same:

ETA: This error occurs after the "Connect" button is clicked on the "Select Destination" page of the Wizard.

===================================

Could not load file or assembly 'Microsoft.SqlServer.Management.IntegrationServicesEnum, Culture=neutral, PublicKeyToken=89845dcd8080cc91' or one of its dependencies. The parameter is incorrect. (Exception from HRESULT: 0x80070057 (E_INVALIDARG)) (mscorlib)

------------------------------
Program Location:

   at System.Reflection.RuntimeAssembly._nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.RuntimeAssembly.nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.RuntimeAssembly.InternalLoadAssemblyName(AssemblyName assemblyRef, Evidence assemblySecurity, RuntimeAssembly reqAssembly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Microsoft.SqlServer.Management.Sdk.Sfc.ObjectCache.LoadAssembly(String fullName)
   at Microsoft.SqlServer.Management.Sdk.Sfc.ObjectCache.LoadElement(ObjectLoadInfo oli)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Environment.GetServerVersion(Urn urn, Object ci)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Environment.GetObjectInfo(Object ci, RequestObjectInfo req)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Enumerator.GetObjectInfo(Object connectionInfo, RequestObjectInfo requestObjectInfo)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Enumerator.Process(Object connectionInfo, RequestObjectInfo requestObjectInfo)
   at Microsoft.SqlServer.Management.Sdk.Sfc.SfcInstance.GetSupportedResultTypes(ISfcConnection connection, Urn urn)
   at Microsoft.SqlServer.Management.Sdk.Sfc.SfcInstance.Initialize()
   at Microsoft.SqlServer.Management.Sdk.Sfc.SfcInstance.MarkRootAsConnected()
   at Microsoft.SqlServer.Management.IntegrationServices.IntegrationServices..ctor(SqlConnection sqlConnection)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.ServerHelper.ConnectToServer(String server, String username, String password, AuthenticationType authenticationType)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.ServerProjectBrowser.validateServerWorker_DoWork(Object sender, DoWorkEventArgs e)

===================================

The parameter is incorrect. (Exception from HRESULT: 0x80070057 (E_INVALIDARG)) (mscorlib)

------------------------------
Program Location:

   at System.AppDomain.nApplyPolicy(AssemblyName an)
   at System.AppDomain.ApplyPolicy(String assemblyName)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.MatchAssemblyName(AssemblyName reference, AssemblyName definition)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.FindAssembly(String name, IEnumerable`1 probingPaths)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.InnerResolveHandler(String name)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.ResolveHandler(Object sender, ResolveEventArgs args)
   at System.AppDomain.OnAssemblyResolveEvent(RuntimeAssembly assembly, String assemblyFullName)



the file name property is not valid. the filename is a device or contains invalid characters

$
0
0

Friends,

I am having problems running an SSIS package using JOB, the following error is displayed, I believe it is either by the network directory containing special character on the folder ( Solicitação )


SSIS Connection Manager to SQL Server with Passwords Best Practice

$
0
0

So I have Googled and Searched and Googled and Searched and Googled again...No where can I find the "Best Practice" for defining Connection Manager to SQL Server and Passwords both on the Connection Manager and the Package Security and the Project Security and anything else I may be forgetting.

I guess one could make the argument that the only people that would and will have access to the SSIS Package, thus the security of passwords, are the Business Intelligence Development staff.

So based on that assumption that no environment is truly the Wild Wild West, yet I'm sure there are some...especially in small shops, what is the Best Practice for defining a Connection Manager to SQL Server?

  1. Package Security ProtectionLevel Property?
  2. Project Security ProtectionLevel?
  3. Connection Manager to SQL Server, actually SQL Azure? XML Provided Password? Connection Manager Properties and Expression and providing the ServerName and Password there via variables? (That's what we do now to keep it simple)

Thanks for your review and am hopeful for a reply.

I want to load 1 table(single destination server and database ) from 2 separate tables(single source server and database) in single data flow task. Is this possible in SSIS?

$
0
0


It worked that out for me in sql server impost export wizard.(I use right join and it worked.)

But I need it to be done in SSIS.


chipsy

FTP task fails on timeout, Exception from HRESULT: 0xC001602A

$
0
0
I wanted to "thank" the SSIS team for their traditionally wonderful job at error handling. From what I understand the 0xC001602A is a catch-all for pretty much any and every problem, which I personally find incredibly helpful when debugging a "weird" problem. But enough with the well-deserved praise, let's turn to the problem at hand.

I have an FTP task that basically goes places and get me all XML files from that directory. It is a standard "Receive files" not a script, and when I try it on VS 2005 with SQL 2005 on x86 XP Machine it works like a charm. From the same network to the same FTP server running from VS 2008 with SQL 2008 on x64 Win 2008 machine it gives me the timeout exception. 32 bit filezilla runs fine on both platforms, so the issue is not the network, nor permissions. The issue is that I created a blank package, and than added a singular task, setup an FTP Connection in the Manager, and tested it successfully. When attempted to run it produced an error message saying that task timed out, which is funny since the task was set to time-out in 60 seconds, but came back in 30. I'm not a great specialist, but I am running against a deadline so any help, that is actually helpful is appreciated.

Thanks
Vadim

Actual Output: "0xC001602A at Package2, Connection manager "FTP Connection Manager": An error occurred in the requested FTP operation. Detailed error description: The operation timed out"

how to load data after a maximum date in SSIS using date filed from source

$
0
0

Dears,

Basically i am loading data from oracle source to sql server destination,i have a date field in my oracle source and i wanted to load data after a maximum date,for example the maximum date from source is 01-11-2018,from next load on wards i wanted load data after this date.,that means i don't want to do full load every time.

please note that the maximum date from source is not yesterday or today.

could any one suggest me the solution.

Regards,

Checking if folder is empty

$
0
0
Hello,

Does anyone know how I can check if a folder is empty using SSIS? I have a package that loops through several files and loads them into a DB. I want to have the ability to check if the folder is empty.

Any help would be appreciated,

Dave

Dave SQL Developer
Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>