Hello guys,
I have to implement a scenario in SSIS package where it has to be insured that a collection of SQL task's completes in a defined period of time and incase if these task's fails to complete in that interval of time then SSIS package should choose an alternative flow and leave the current processing of those of SQL task's.
Please provide suggestions on how to implement this in the best possible way that it has no performance impacts as well.
Regards,
Harsh
Is it possible to share temp tables between two connection managers as 2 separate execute sql task in ssis.
I am not able to do so.
I have two execute sql tasks which uses two different connection managers.
So in one execute sql task i create the temp table and put data into it
In the second sql task, i use the temp table to do some calculations. I set delay validation to true and also set the connection managers to share same connection property to true. Still no luck.
It errors on second sql task saying Invalid temp table....can anyone help. It will be very much appreciated.
Thanks
I have a folder and under that there are several subfolders. I m trying to loop through all folders and subfolders so i can grab all the files under sub folders. When i do that my for each loop container doesnt stop even after traversing is done? How do we stop this once all traversing is done or is there any mistake i m doing?
Any help much appreciated.
Hello All,
I am having issues with SSIS packages running from SQL agent job.
The server we are running the job is used for SSIS and there are lot of other SSIS jobs that are running.
We were able to run the job once successfully and the later runs are failing with the below error.(nothing has been changed)
The step did not generate any output. The return value was unknown. The process exit code was -1073741701. The step failed.
Nothing is being logged in the [catalog].[operations] or operation_messages view. When tuned the profiler ON we do not see the job trying to connect to SSISDB at all. I am assuming that the job is failing much before if does any thing.
I have moved the package to a different server and ran it with the same proxy account and it works fine there.
Any help or suggestion on this issue would be helpful.
Thanks !
Hi,
I am able to use the DQS Client with SQL Enterprise 2014 for creating the KB, Discovery and Matching. However in VS Professional 2013, running under Windows 7 client, when I drag the DQS Cleansing component in Data Flow pane, it shows Red x mark on the component and error message - Microsoft.Ssdqs.Proxy.EntryPoint.ProxyException: Failed to initialize configuration --
Detailed error message when I click on the DQS component property is given below:
The component has detected potential metadata corruption during validation.
Error at Data Flow Task [DQS Cleansing [104]]: System.NullReferenceException: Object reference not set to an instance of an object.
at Microsoft.Ssdqs.Infra.Log.LLogger.Log(String uniqueId, String severity, TraceEventType traceEventType, Exception exception, String message, Object[] args)
at Microsoft.Ssdqs.Infra.Log.LLogger.Error(String uniqueId, Exception exception, String message, Object[] args)
at Microsoft.Ssdqs.Proxy.EntryPoint.ProxyInit.Init(ProxyInitParameters parameters)
at Microsoft.Ssdqs.Component.Common.Utilities.ComponentUtility.InitializeProxy(Boolean fireInfoEvents, IDTSComponentMetaData100 componentMetadata)
at Microsoft.Ssdqs.Component.DataCorrection.Logic.DataCorrectionComponent.Validate()
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostValidate(IDTSManagedComponentWrapper100 wrapper)
It may not be possible to recover to a valid state using a component-specific editor. Do you want to use the Advanced Editor dialog box for editing this component?
Thanks for any input in resolving this.
Mathew
Hi,
SQL job agent fails to run when I change my computer login (Password) credentials information often.
How I can run the SQL job agent with Database login credentials.
Regards
Venkatesh S
I have created a config file for my first package and want to use the same config file for second package as well. Config file contains the server name value. Both the packages have same variabale called servername , I'm using this variable to change the server name through config file and it is working fine for 1st package but doesn't reflect on second package. I have used 'reuse' config file for second package.
What I have observed is at run time second package connection manager are changed to what I have given in config file but the package still executes with old connection manager server.
Can someone help me figuring where I went wrong.
Thanks,
sree
I created a SSIS package that litterally just export a view onto a server. The database, ssis and location are all on the same server. When I run the SSIS package in SSIS works perfectly. When I run it in SQL it doesnt work. I have read way to many articles trying to figure out how to fix this. The best was something about a proxy. I really just want to run the package through as a JOb through SQL Server Agent. Any directions would be great.
Message
Executed as user: NT Service\SQLSERVERAGENT. Microsoft (R) SQL Server Execute Package Utility Version 11.0.2100.60 for 64-bit Copyright (C) Microsoft Corporation. All rights reserved. Started: 3:15:00 PM Error: 2015-03-05
15:15:00.41 Code: 0xC0011007 Source: {A9456201-8A74-44C9-839F-1CD3CC02637F} Description: Unable to load the package as XML because of package does not have a valid XML format. A specific XML parser error will
be posted. End Error Error: 2015-03-05 15:15:00.41 Code: 0xC0011002 Source: {A9456201-8A74-44C9-839F-1CD3CC02637F} Description: Failed to open package file
"C:\Users\lasadmin\Documents\Visual Studio 2010\Projects\Integration Services Project1\Integration Services Project1\Package.dtsx"
due to error 0x80070005 "Access is denied.". This occurs when loading a package and the file cannot be opened or loaded correctly into the XML document. This can be the result of specifying an incorrect file name when calling LoadPackage
or the specified XML file has an incorrect format. End Error Could not load package "C:\Users\Documents\Visual Studio 2010\Projects\Integration Services Project1\Integration Services Project1\Package.dtsx" because of error 0xC0011002. Description: Failed to open package file "C:\Users\Documents\Visual Studio 2010\Projects\Integration Services Project1\Integration Services Project1\Package.dtsx" due to error 0x80070005 "Access is denied.". This occurs when
loading a package and the file cannot be opened or loaded correctly into the XML document. This can be the result of specifying an incorrect file name when calling LoadPackage or the specified XML file has an incorrect format. Source: {A9456201-8A74-44C9-839F-1CD3CC02637F} Started: 3:15:00 PM Finished: 3:15:00 PM Elapsed: 0.015 seconds. The package could not be found. The step failed.
thanks
bryan
For a File System Task I need to specify the destination and the source as a variable. What is the difference between:
1. doing so in the source and destination Connection Managers as an expression in the ConnectionString
2. in the File System Task setting the Is*PathVariable=true and specifying the variable
Thanks
Mark Aurit Priest River Systems
I need some help within the above task. I know that I can use a variable as my SQL Command Text and update the variable from outside the package at runtime. I also imagine that I can use the script task to change the table destination and column mapping (driven via sql tasks to pull dynamic info).
I was wonder if someone knew of a better way or had something they could share so that I am not reinventing the wheel.
Thanks,
Robert Johnston
Have you seen this error?
A buffer failed while allocating 10485088 bytes. I understand it's a memory problem with many lookups in full cache mode.
Is there a setting in SQL 2008r2 which could help eliminate this issue?
Thanks
Hi,
I am working on upgrading my SSIS packages to SSIS 2014. Packages are created in SSIS 2012. When I open the project in visual studio 2013 the Upgrade wizard automatically opened and I started following the wizard taking the default configurations. After clicking 'Finish' it throws an error "The connection (xxxx) is not found...". Below is the full error message.
Can any one help me with what I need to do to fix this? What is the best practice in SSIS package upgrade?
- Upgrading package Package.dtsx (Error)
<dir>Messages
Information 0x40016019: Package: The package format was migrated from version 6 to version 8. It must be saved to retain migration changes.
Error 0xc001000e: Package: The connection "{8E52ED4B-AF33-421C-8544-8124309377F2}" is not found. This error is thrown by Connections collection when the specific connection element is not found.
</dir>Error 0xc001f429: Package Upgrade: The loading of the package Package.dtsx has failed.
Thank you!
Locally I have 32 bit windows and the server is 64 bit. When I try to change the provider locally to SQLNCLI11.1, the connection test succeeds but when I close the package and reopen it the provider is set to 10.1 again. Do I need to install a driver locally to get the 11.1 version to work, or is this not the issue with the error message?
Thanks
Thankx & regards, Vipin jha MCP
sree
I would like to pass back via an Email the name of the file that was successfully FTP'ed to a remote server. And I was hoping to do this via an Execute SQL Task with the following SQL Statement...but I just don't know if it will append the Foreach Loop Container variable enumerator to the appended Email message that I am building in SQL Server or if I can and how I can...
I sort of get the feeling that I can try and do this via Dynamic SQL...I just don't know if by building dynamic SQL if my Foreach Loop Container enumerator variable will be appended to my Email Message via the SQL Server UPDATE
@[User::FTPFHFileName]
Or do I add a Data Flow Task and an OLE DB Command and pass the Foreach Loop Container enumerator variable to a Stored Procedure referenced in the OLE DB Command via a "?"
Thanks for your review and am hopeful for a reply.
I have a Package that I want to put logging information in to a SQL table.
I can do this with a script task but each time the package runs it will open a SQL connection write the log information and then close this connection it will do this 10 times every time the package executes and i could 50 of the packages running at the same time so i am looking for a better way to do this.
My thought was to create a in memory table object at the start of the package and then insert the log records in to it and at the end do a bulk insert at the end of the package.
My problem is I don't know if this can be done and if it can how would I create the in memory table insert the records and then bulk load it to the SQL server table.
I tried using Task Factory Pragmatic Works TF Secure FTP Task within aForeach Loop Container and using a lookup variable to the Secured FTP Site to determine if a file exists that we need to process. And I am getting an error saying...
Variable "User::VendorFileList" does not contain a valid data object
Now I'm re-thinking this whole thing after Googling a little bit. I guess my first question is this...
Has anyone used the Task Factory tools and the TF Secure FTP Task to perform a generic file lookup against a Secured FTP site to determine if files exist?
Instead, should I use an Execute Process Task and use WinSCP and a script to determine if files of type exist on a Secured FTP site? Can I perform this in one script? Check to see if a file exists and value a Boolean accordingly and then handle the Boolean variable back within my SSIS flow...
Does anyone have any experience with this and can provide a good web site that kind of walks through the whole "checking secured ftp site for files and if they exist" scenario? Or a good YouTube?
Thanks for your review and am hopeful for a reply.
Hi All,
I have a requirement to load different sheet's data into multiple tables & each sheet's metadata id different (each sheet has different column name in it). I want to load all the sheets into tables and mapping also has to happen dynamically based on the column names.
Is there a way to achieve this.
Thanks in advance