Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS package failed in sql server agent.

$
0
0

My package is running fine in the package store and MSDB independently. However, when I add the package as a step in the SQL server agent job ( only step in the job), it has following error:

An invalid reporting
option was specified. Only E, W, I, C, D, P, V, and N are allowed.
The command line parameters are invalid. The step failed.

The Commend line for the package in the step  is /SQL "\PDSQL01\CS_Versadex" /SERVER PDSQL01  /CHECKPOINTING OFF /REPORTING E

Not sure why the job failed.

PS I am in SQLSERVER 2008R2


Execute Process Task Issue in SSIS

$
0
0

Hi,

I have a package with Execute Process task, that gets the files from SFTP using Putty.

It works fine locally on my PC. But when i run through SSIS Catalog, the package is hanging at the Execute Process task.

Its not returning any errors. I am using SSIS - 2017

Please help me in resolving this.

Move excel files from sharepoint library to a local folder using SSIS

$
0
0

Hi,

I have a sharepoint site which has a document library with some excel files. I want to loop through these files using foreach loop container and copy these to my local folder. I have set up the package with the all the variables as below

@filename = t.xlsx

@filepath = \\sharepointsite\folder

i have a foreach file loop where i set the directory expession to the @filepath  value and on variable mappings map to @filename index 0.

When i run the task it shows that it ran successfully but does not go into the loop.

upon checking the execution results i see a warning that "Warning: The For Each File enumerator is empty. The For Each File enumerator did not find any files that matched the file pattern, or the specified directory was empty."

i have checked and my account that i am using to run ssis package has full access/rights to the sharepoint folders.

where am i going wrong?

thank you in advance

I am


Natalie

Update data through SSIS

$
0
0

Hi ,

We have a situation where data needs to be updated on a table. We are not allowing users to update directly on table. we have asked users to copy the data on to a csv file for the changes they need to done. 

Each table has a primary key and we need to implement the historical attribute of the data by using scd. Can someone help me out if this is a right approach or any other easy way to handle this.

Thanks

Data Conversion Transformation - Output has source columns and also converted datatyes columns

$
0
0
HI

Need some clarification for Data COnversion Transformation.

I have a Data COnversion transformation which has 5 input columns of unicode data type.
I change the datatypes for these columns to proper string .int datatypes .

Next When I redirect the output to OLEDB Destination,I get 10 output columns in Mappings for OLEDB Destination.
5 columns of unicode datatype from original source and 5 columns with datatypes after conversion.


I want to have only 5 columns (converted output) from the data conversion task and dont want the source unicode fields.


Is it possible? If Yes how ? :)
Also what is the performance impact if I dont remove the source columns?

Thanks in advance
Mou
mou

SSIS - Script Task Error - Could not load file or assembly

$
0
0
Hello

I have script task that has references added to it but still giving me above error? How should i resolve this situation?


Thanks

Error trying to create job that executes SSIS

$
0
0

Hi 

I have been struggling with this for a while, when I try to create a job that executes or calls an SSIS package, I get this error message:


(1 row affected)
Msg 50000, Level 16, State 1, Procedure sp_add_jobstep_internal, Line 255 [Batch Start Line 17]
Invalid object name 'ReportingDB.ExtPharm.Jobs'.
Msg 208, Level 16, State 1, Procedure trSysJobsMonitoring, Line 33 [Batch Start Line 31]
Invalid object name 'ReportingDB.ExtPharm.Jobs'.

A couple of observations:

1.- I have no db called ReportingDB on the server.

2.- Either with management studio(GUI)  or with a script is the same error.

3.- I can create jobs, but if they call an SSIS package, then the same happens.

4.- This was a cloned server.

Do you have any idea of how to resolve this?? 


Error at restoring SSISDB in an other server

$
0
0

I have the master key, I already did the following steps:

1.- Enable CLR in the new server

2.- Create the asymmetric key and the login for it and grant unsafe permissions to the login.

3.- Restore the SSISDB from the backup.

4.- Execute scripts for creating ##MS_SSISServerCleanupJobLogin##, sp_ssis_startup and SSIS Server Maintenance Job.  BTW The agent is running.

5.- I ran the following : EXEC sp_procoption N'sp_ssis_startup','startup','on' 

6.- I mapped the SSISDB user ##MS_SSISServerCleanupJobUser##  to  ##MS_SSISServerCleanupJobLogin##.

7.- Restored the master key  using this script :

Restore master key from file = 'c:\temp\RCTestInstKey' 
       Decryption by password = 'LS2Setup!' -- 'Password used to encrypt the master key during SSISDB backup' 
       Encryption by password = 'LS3Setup!' -- 'New Password' 
       Force

8.- I ran the  catalog.check_schema_version.

The thing is that with everything done I get this:

An error occurred during decryption. (.Net SqlClient Data Provider)
------------------------------
For help, click: http://go.microsoft.com/fwlink?ProdName=Microsoft%20SQL%20Server&ProdVer=12.00.5000&EvtSrc=MSSQLServer&EvtID=15466&LinkId=20476

------------------------------
Server Name: QA01\MSSQLSERVER
Error Number: 15466
Severity: 16
State: 9
Line Number: 1


------------------------------
Program Location:
   at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
   at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)
   at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)
   at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString, Boolean isInternal, Boolean forDescribeParameterEncryption, Boolean shouldCacheForAlwaysEncrypted)
   at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async, Int32 timeout, Task& task, Boolean asyncWrite, Boolean inRetry, SqlDataReader ds, Boolean describeParameterEncryptionRequest)
   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, TaskCompletionSource`1 completion, Int32 timeout, Task& task, Boolean& usedCache, Boolean asyncWrite, Boolean inRetry)
   at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(TaskCompletionSource`1 completion, String methodName, Boolean sendToPipe, Int32 timeout, Boolean& usedCache, Boolean asyncWrite, Boolean inRetry)
   at System.Data.SqlClient.SqlCommand.ExecuteNonQuery()
   at Microsoft.SqlServer.IntegrationServices.Common.ObjectModel.SqlHelper.ExecuteSQLCommand(SqlStoreConnection storeConnection, CommandType cmdType, String cmdText, SqlParameter[] parameters, ExecuteType execType, Int32 commandTimeout)
   at Microsoft.SqlServer.Management.IntegrationServices.CatalogFolder.DeployProject(String projectName, Byte[] projectStream)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeployExportProjectHelper.DeployProject(CatalogFolder folder, Project project)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeploymentModel.Deploy(CatalogFolder folder, Project project)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeploymentModel.DeployProject()
   at Microsoft.SqlServer.IntegrationServices.Deployment.DeployProjectPage.DoWork(Object sender, DoWorkEventArgs e)
   at System.ComponentModel.BackgroundWorker.OnDoWork(DoWorkEventArgs e)
   at System.ComponentModel.BackgroundWorker.WorkerThreadStart(Object argument)

You get this error trying to deploy a new package or executing an existing package on the new server with the restored db.

Any ideas, before I drop the SSISDB and set a new one.






Powershell copy script works on my desktop, and the server, but not in SQL Agent

$
0
0

I am attempting to copy database backups from our Prod server to our BCP server.  The following script runs successfully on my desktop and on the server, in PowerShell ISE, running as the same account set in the 'Run As' field in the properties of the SQL Agent job.

When I attempt to run this through a SQL Agent job however, it fails.

Version 1

$backuppath = "\\ProdServer\Prod_Backups\msdb\FULL" 
$destpath = "\\BCPServer\Prod_Backups\" 
Get-ChildItem -path $backuppath 
sort-object -Property $_.CreationTime 
select-object -last 1 
Copy-Item -Destination $destpath


Version 1 error:

The job script encountered the following errors. These errors did not stop the script: A job step received an error at line 5 in a PowerShell script. The corresponding line is 'Get-ChildItem -path $backuppath | '. Correct the script and reschedule the job. The error information returned by PowerShell is: 'Cannot find path '\ProdServer\Prod_Backups\msdb\FULL' because it does not exist.

Version 2

$backuppath = "Microsoft.PowerShell.Core\FileSystem::\\ProdServer\Prod_Backups\msdb\FULL" 
$destpath = "Microsoft.PowerShell.Core\FileSystem::\\BCPServer\Prod_Backups\" 
Get-ChildItem -path $backuppath 
sort-object -Property $_.CreationTime 
select-object -last 1 
Copy-Item -Destination $destpath

Version 2 error:

A job step received an error at line 5 in a PowerShell script. The corresponding line is 'Get-ChildItem -path $backuppath | '. Correct the script and reschedule the job. The error information returned by PowerShell is: 'Invalid Path: 'Microsoft.PowerShell.Core\FileSystem::\BCPServer\Prod_Backups\'.


-Al H

Conditional expression for evalexpression in forloop container

$
0
0

I have a forloop on which the EvalExpression is like below - 
(@[User::Sales] == 1 || DATEPART("hh", GETDATE()) >= 22) ? "False":"True"

leaving InitExpression and AssignExpression blank. 

so, my req is either of the above evaluates to true then the loop needs to break.

The process will come out of loop if the boolean evaluates to false. So, the executeSQL task inside the forloop is assigning "1" to @[User::Sales] and I expect it to break the loop and proceed further. But, the loop is still continuing endlessly. Please let me know If I am missing anything. thank you.



Job is crashing without no obvious reason

$
0
0

I have a job that is waiting for a file, and when the file is delivered it is read into the Data warehouse and then the file is zipped and archived.

A For loop container waiting for as long as 5 days for the inner loop to finnish, before the loop stops. The "inner For loop" looking for the file, wait 15 minutes, looking again, and on it goes (for 5 days). Simple as that.

Works for a couple of hours. Then suddenly crashes for no obvious reason. The Report from SSISDB says that the job is still running. Got this error message from the Agent; "The return value was unknown.  The process exit code was -1073741571.  The step failed."

My question is really, is this not a proper way to do it, waiting for a file?

Kerberos Authentication

$
0
0
I have configured kerberos authentication for my domain user and In AD -> my domain user -> under delegation I've chosen Kerberos authentication. Also I had successfully configured SPN in my db server residing machine and I am using SQL 2012. But still when I connect via SQL management studio it is keep on connecting via NTLM. How can I fix this to connect via Kerberos. Your help will be appreciated like anything. Thanks!

What port can I use to deploy SSIS paackages from SSDT

$
0
0

I am working with a server that is really tied down because of security concerns. I must ask that ports be opened to allow us to add software and tools, deploy packages, deploy reports and access reports. Can this all be done with the default port of 1433?

Thanks,

Mike

SSIS Execute Package Task and its Behaviour

$
0
0

I am populating a fact table(sales_Fact). There are multiple stg tables(each representing sales from different countries for ex: stg_uk, stg_finland etc). The requirement is to build a child dtsx package for each country aka each stg table(there are other reasons why a dtsx package needs to be built for each stg table, so lets assume that a child package is mandatory).

I have a parent package with a DFT that stores the item dimensions and currency dimension in cache(using cache connection manager) and then is connected to Execute Package Task( that executes the child package) in this case it would be something like LoadUKSales.dtsx(child package)

This child package(LoadUKSales.dtsx) has a DFT that extracts data from stg table, performs (lookups, multicast, derived columns, conditional split), and writes the data to fact table

Certain  lookups(in child package use cache connection manager--items and currency), other lookups(customer) uses oledb connection and a query.

The reference type of the Execute Package task is 'Project Reference' and ExecuteOutOfProcess is set to false.

I have attached 2 images, the parent package and the child package DFT. If you look at the DFT, it has skipped the execution of bunch of components and just says package successfully executed. No errors 

Can anyone please help me in the right direction

Parent.dtsx

Childdtsx




SSIS XMLTask:XSLT: Could not load file or assembly (random_id) : Failed to grant permission to execute. (Exception from HRESULT: 0x80131418)

$
0
0

I have a DTS package defined that uses an XML Task to transform some data. This is a very simple task.

1. It takes XML on an Input read/write variable
2. Transforms it through a fileconnection (test.xslt)
3. Writes the XML output to another read/write variable

It fails on step 2 with: [XML Task] Error: An error occurred with the following error message: "Could not load file or assembly 'ezpvg7kz, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null' or one of its dependencies. Failed to grant permission to execute. (Exception from HRESULT: 0x80131418)".

Where the 'ezpvg7kz in the above error is randomly generated with each debug session.

I have run a test application that will transform the input xml through the xslt and give me the output exactly how I want it, it is not the format of the input XML, or XSLT file so please do not waste time asking those questions.

What I want to know, what assembly is being generating 'on the fly' and why does SSIS have no access to it if it creates it?  Any ideas on how to fix this?


Cannot use breakpoints while debugging the package.

$
0
0

Hi , 

I'm facing an issue where I can enable breakpoints on few tasks to debug the package but watch tab comes up empty . My package has several variables and all are used in ETL package. If any one has faced this issue , please let me know the resolution for it.. Break point is on execute SQL task. 

Pass the variable from a foreach loop into a sql execute task

$
0
0
i would like to know how to pass the varaiable from the foreach loop to the sql execute task, in the select statement as a table name, meaning i want to select * from the @variable that i am passing from the loop.

Excel Column Headings and values getting truncated by two letters in SSIS while loading

$
0
0

Hi Everyone,

I am loading an excel file to the database. strangely, the last two letters of each column heading (and values) is getting truncated for no reason. can you please guide me in this.

For Ex: If the column name is 'MyDate' and has the value '2018-10-14', In 'Columns' tab it is coming as 'MyDa' and the value is '2018-10-'. 



SSIS Configuration vs Parameters

$
0
0

Hi ,

I am new to SSIS so please explain below scenario.I am running via VS2015.

I have SSIS 2012 created which has some config values and same name with Parameters.

Example:

User::Name -Which expects string 

Parameter have same "Name" with Default Value "John"

If I give correct expected type say for example "Marry " in the Config SSIS fetch Marry from config file  and process the package.

If I give wrong type int or special characters  say eg: 123434 like .Its not throwing error but fetch default value "John" value from parameter and process without error.

Please let me know the behavior.

SSIS-Wrong value in Configuration file overridden by Parameter Default ?

$
0
0

Hi ,

I am new to SSIS so please explain below scenario.I am running via VS2015.

I have SSIS 2012 created which has some config values and same name with Parameters.

Example:

User::Name -Which expects string 

Parameter have same "Name" with Default Value "John"

If I give correct expected type say for example "Marry " in the Config SSIS fetch Marry from config file  and process the package.

If I give wrong type int or special characters  say eg: 123434 like .Its not throwing error but fetch default value "John" value from parameter and process without error.

Please let me know the behavior.


Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>