Hello and good day to all
I'm trying to determine if Visual Studio 2015 (VS2015) Ultimate or any other version VS2015 will allow for SSIS packages for 2008, 2012, 2014 environments.
Any direction is appreciated
Thank You Forum
Mark Covian
Hello and good day to all
I'm trying to determine if Visual Studio 2015 (VS2015) Ultimate or any other version VS2015 will allow for SSIS packages for 2008, 2012, 2014 environments.
Any direction is appreciated
Thank You Forum
Mark Covian
Can we also deploy the xml config file to msdb database along with package. I do not feel comfortable to maintain this file on server.
any inputs on this?
Neil
Hi All,
I would like to know the process to search for a word(in my case email id) in packages stored in file system and replace with another word(another email id). One of our colleagues left our team recently and a new team member joined. Old colleague's email id is manually written in the SQL script to send failure/success notifications inside some SSIS packages. I manually replaced his email id with new member's and everything running fine so far. I wonder what could be the efficient way to replace some text in packages? In my case I know the packages with his ID, but If I am new to team and have to replace something within some 100+ SSIS packages? Appreciate any thoughts..
Thanks,
MSBIan.
MSBIan
Hi,
I have created a SSIS package that contains Azure Blob Storage tasks, the package runs fine in Visual Studio 2012 but when I try to deploy to SQL Server 2012 Integration Services Catalog, I get a failed deployment error because "AzureStorage" connection manager object can't be created.
The SQL Server 2012 instance has SP2 installed and .NET framework 4.5.
Does anyone know why this could be happening.
Thanks in advance for your time.
dpoleon
Greetings,
I currently have a table with the following columns that looks something like this: (Real data consists of more than a hundred thousand records)
I'm trying to pivot the data into something that looks like this:
So far, I've tried to pivot the data using SSIS Pivot transform and sorting on Market.
However, I get the following error:
---
[SSIS.Pipeline] Information: Execute phase is beginning.---
Any help to resolve this issue will be greatly appreciated.
Thank you in advance.
Jeannette
Hi,
I need a step by step process that works to call an oracle procedure with IN/OUT parameters in SSIS 2012.
MY oracle procedure is very simple, this is basically a test procedure, which if works I will use the approach for all my real world procedures.
I have pasted the procedure below:
create or replace procedure demo_ssis_test(IN_PARM varchar2, out_parm out number)
as
begin
select 1 into out_parm from dual;
end;
/
How do i call this procedure using user defined variable from an ssis package and store the result in another user_defined variable?
Please help.
I need it urgently.
Thanks a ton,
KAy
It's another month, and another chance to find... the one!
That special person who brings us... the knowledge!
That thing we didn't know.
That revelation that saves us so much bandwidth on the search tool.
Clear and concise revelations that bring us closer to our goal!
You have that power my friends!
Step forth with words of wisdom!
Step up and let us know your name!
Carve your mark on the community... and history!
MARCH forth and win glory, fame, love honour and immortality!!!! (in the form of the written word... kind of...)
All you have to do is add an article to TechNet Wiki from your own specialist field. Something that fits into one of the categories listed on the submissions page. Copy in your own blog posts, a forum solution, a white paper, or just something you had to solve for your own day's work today.
Drop us some nifty knowledge, or superb snippets, and become MICROSOFT TECHNOLOGY GURU OF THE MONTH!
This is an official Microsoft TechNet recognition, where people such as yourselves can truly get noticed!
HOW TO WIN
1) Please copy over your Microsoft technical solutions and revelations toTechNet Wiki.
2) Add a link to it on THIS WIKI COMPETITION PAGE (so we know you've contributed) <----
3) Every month, we will highlight your contributions, and select a "Guru of the Month" in each technology.
If you win, we will sing your praises in blogs and forums, similar to the weekly contributor awards. Once "on our radar" and making your mark, you will probably be interviewed for your greatness, and maybe eventually even invited into other inner TechNet/MSDN circles!
Winning this award in your favoured technology will help us learn the active members in each community.
Below are last month's mighty winners and contenders!
#PEJL
Got any nice code? If you invest time in coding an elegant, novel or impressive answer on MSDN forums, why not copy it over toTechNet Wiki, for future generations to benefit from! You'll never get archived again, and
you could win weekly awards!
Have you got what it takes o become this month's
TechNet Technical Guru? Join a long list of well known community big hitters, show your knowledge and prowess in your favoured technologies!
Hi,
I have a 64 bit machine running win 8.1. I installed the oracle 12c 64 bit client and the 64 bit odac drivers. However, all of my oracle connections are give me the "'oraoledb.oracle.1' provider is not registered on the local machine" error.
thanks
Scott
I have 2 datasources (A and B), both have completly different transformations but the result sets have the same datastructure
I need to join them in the following way
A + those from B that do not exist in A (based on an ID Field).
I could do the following:
run transformation A, put result in a temp table
run transformation B put result in a temp table
new transformation C insert A + B (where B not in A)
I was just wondering if I could do this without creating the temp tables and do this in one package run, like
Thanks in advance
Hi, all
I'm trying to read with Flat File Source pipe-separated file of the following structure:
Code|Description ABC|Bad description because this text too long and will trigger truncation error BCD|Good description
That is pipe-separated file with header row and 2 data rows. Extra carrige return between 2 data rows was added intentionally to reproduce a problem.
Column lentgths defined in Flat File CM: 3 and 20 chars. What I've expected is that first row will be redirected to Error Output only. What I have actually:
the first row is redirected BOTH to Output and Error Output. In Output row appeared with empty first field (Code) and second field (Description) truncated to 20 chars.
If I remove extra carrige return between 2 rows, all works as expected.
Any ideas how to handle such files correctly (containing extra carriage returns)?
Server:
Integration Services 12.0.4439
VS Studio 2013:
Microsoft Visual Studio 2013 Shell (Integrated)
Version 12.0.40629.00 Update 5
Microsoft .NET Framework
Version 4.6.01055
Installed Version: IDE Standard
SQL Server Data Tools 12.0.60315.0
Microsoft SQL Server Data Tools
SQL Server Integration Services
Microsoft SQL Server Integration Services Designer
Version 12.0.2430.0
Hi,
I'm migrating Dts package to integration services. I have migrated package to dtsx (2008) using dtspackage migration wizard. But I have few lines of code which I'm not able to migrate to SSIS 2014 using script task from Activex script Task. Could you please help me with your suggestions.
Set oPackage = DTSGlobalVariables.Parent
Set oStep = oPackage.Steps("DTSStep_DTSActiveScriptTask_1")
Set oPresCons = oStep.PrecedenceConstraints
oPresCons.Remove (1)
oPresCons.AddConstraint (sDependancy)
And below code as well.
Dim oPackage, oStep
DTSGlobalVariables("SendEmail").Value = True Set oPackage = DTSGlobalVariables.Parent Set oStep = oPackage.Steps("DTSStep_DTSActiveScriptTask_4") 'email step oStep.ExecutionStatus = DTSStepExecStat_Waiting End Function
Thank you in Advance.
Regards,
Ashok
Hi All,
I`ve been having a really hard time to acomplish this task. I have a folder where everyday a zipped file is dropped I then want to Unzip the file and map it to my source folder in a SSIS package. I have tried Execute Process task, it runs but nothing happens.
Followd everything mentioned on this post http://www.sql-server-performance.com/2008/ssis-unzip/ , but nothing happens.
executable: C:\Program Files\7-Zip\7z.exe
Arguments: e “S:\Ops\Qt\XS_EV_201603160317.txt” -o+
I also found another way, script task , Followed step by step on here http://sqlblog.com/blogs/jorg_klein/archive/2009/08/27/ssis-unpack-a-zip-file-with-the-script-task.aspx , but failed.
When i try to add the rference as mentioned in the above post, I get an Pop up saying
"No template information found" See the application log in the event viewer, When I checked the event viewer this is what I found " The global template information is out of date. Regenerate the templates by running 'VSTA.exe /installvstemplates' or reinstalling the application. Note: corrective action requires Administrator privileges"
Then I followed everything this Process asked : https://gallery.technet.microsoft.com/Unzipping-with-SSIS-Script-6b055183
See the below Code, Basically I dont have Imports Shell32 Namespace defined.
#Region "Imports" Imports System Imports System.Data Imports System.Math Imports Microsoft.SqlServer.Dts.Runtime Imports Shell32 #End Region 'ScriptMain is the entry point class of the script. Do not change the name, attributes, 'or parent of this class. <Microsoft.SqlServer.Dts.Tasks.ScriptTask.SSISScriptTaskEntryPointAttribute()> _<System.CLSCompliantAttribute(False)> _ Partial Public Class ScriptMain Inherits Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTARTScriptObjectModelBase #Region "Help: Using Integration Services variables and parameters in a script" 'To use a variable in this script, first ensure that the variable has been added to 'either the list contained in the ReadOnlyVariables property or the list contained in 'the ReadWriteVariables property of this script task, according to whether or not your 'code needs to write to the variable. To add the variable, save this script, close this instance of 'Visual Studio, and update the ReadOnlyVariables and 'ReadWriteVariables properties in the Script Transformation Editor window. 'To use a parameter in this script, follow the same steps. Parameters are always read-only. 'Example of reading from a variable: ' startTime = Dts.Variables("System::StartTime").Value 'Example of writing to a variable: ' Dts.Variables("User::myStringVariable").Value = "new value" 'Example of reading from a package parameter: ' batchId = Dts.Variables("$Package::batchId").Value 'Example of reading from a project parameter: ' batchId = Dts.Variables("$Project::batchId").Value 'Example of reading from a sensitive project parameter: ' batchId = Dts.Variables("$Project::batchId").GetSensitiveValue() #End Region #Region "Help: Firing Integration Services events from a script" 'This script task can fire events for logging purposes. 'Example of firing an error event: ' Dts.Events.FireError(18, "Process Values", "Bad value", "", 0) 'Example of firing an information event: ' Dts.Events.FireInformation(3, "Process Values", "Processing has started", "", 0, fireAgain) 'Example of firing a warning event: ' Dts.Events.FireWarning(14, "Process Values", "No values received for input", "", 0) #End Region #Region "Help: Using Integration Services connection managers in a script" 'Some types of connection managers can be used in this script task. See the topic '"Working with Connection Managers Programatically" for details. 'Example of using an ADO.Net connection manager: ' Dim rawConnection As Object = Dts.Connections("Sales DB").AcquireConnection(Dts.Transaction) ' Dim myADONETConnection As SqlConnection = CType(rawConnection, SqlConnection) ' <Use the connection in some code here, then release the connection> ' Dts.Connections("Sales DB").ReleaseConnection(rawConnection) 'Example of using a File connection manager ' Dim rawConnection As Object = Dts.Connections("Prices.zip").AcquireConnection(Dts.Transaction) ' Dim filePath As String = CType(rawConnection, String) ' <Use the connection in some code here, then release the connection> ' Dts.Connections("Prices.zip").ReleaseConnection(rawConnection) #End Region 'This method is called when this script task executes in the control flow. 'Before returning from this method, set the value of Dts.TaskResult to indicate success or failure. 'To open Help, press F1. Public Sub Main() Try Dim sh As New Shell32.Shell() ' Creating the target directory: IO.Directory.CreateDirectory("C:\Temp\ExtractedFilesFolder") Dim TargetFolder As Shell32.Folder = sh.NameSpace("C:\Target") ' Declaring the inputfile: Dim InputZipFile As Shell32.Folder = sh.NameSpace("C:\Source\F_201512011208.txt.zip") ' Extracting all files from the source file, supressing the progress bar: TargetFolder.CopyHere(InputZipFile.Items, 4) Dts.TaskResult = ScriptResults.Success Catch ex As Exception Dts.Events.FireError(0, "", ex.Message, 0, 0) Dts.TaskResult = ScriptResults.Failure End Try End Sub #Region "ScriptResults declaration" 'This enum provides a convenient shorthand within the scope of this class for setting the 'result of the script. 'This code was generated automatically. Enum ScriptResults Success = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Success Failure = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Failure End Enum #End Region End Class
I`ve never done this task before , I am very new to it.. Can someone Please help me thru ??
FM
Greetings!
I've created a pivot table using SSIS and the output is being displayed via multicast and copied into an Excel spreadsheet.
Now, I've been asked to add a column within the Pivot table and output the last known balance for each account. For example, fi the last record for Jane Doe was from 12/31/2015, then I would want to use 100, and John Smith 300 as "Balance."
Here is sample data:
From this data -
I now need to created something like this in SSIS:
So far, I've created a CTE that gives me the result desired:
------
;With NBB AS-----
Questions I have:
I'm not sure if the CTE created is necessary or if there is a better way within SSIS to perform the task?
I'd appreciate if some feedback to identify if it is possible to add the additional column showing a defined Row_Number for balance.
Thank you in advance!
Jeannette
Lee
Hi PowerShell Gurus,
I am facing an issue while invoking SSIS package from MSDB using powershell SQLCMD. However, the same SSIS package runs fine using powershell remoting and DTExec.exe. We have a clustered SQL environment where we submit the SSIS query to the controller server, the controller then uses internal credentials to run the package at adequate server.
The command runs fine if I remote (PSRemote/Invoke-command) to the controller server and execute SSIS package using DTExex.exe. This method properly invokes the Controller and controller runs the package on correct server. When I run the package at Controller using SQLCMD, It appears that Powershell impersonates credentials upto two hops which is until SQL server on Controller and it starts throwing the authentication failure errors after this point.
I am hopeful that Micorosoft suggested any solution to handle the credential impersonation issue in Powershell 5. Note I do not feel comfortable in passing credential objects/ building credential object in remote server. Please help me with your suggestions to resolve these kind of issues(for SQL SSIS invocation).
Charlie
Hi,
I have a BI solution that was created in Visual Studio 2013, I have recently pulled the solution down from TFS and have tried running it. Every SSIS package in the solution has 2 custom SSIS tasks which we use in all of our solutions, when I try running the solution every package is failing to validate on my 2 custom tasks, If I try to execute the tasks individually then they fail. However if I add ANY task from my ssis toolbox onto the package then the packages\tasks will run fine.
Does anyone have any thoughts on why this is occurring and how I can imitate what is happening when I add a new task from the SSIS toolbox. I really don't wan to have to go through 200+ packages and add a task from the toolbox or delay validation to get it to work. It was working fine on my machine a few months ago.
Thanks a lot!
Martyn
I'm a software engineer(with heavy applications background), and I've only begun learning the SSIS tool set this week. I work for a medium size insurance company with about 50 software developers, and we want to make this tool available for an upcoming project that will require a lot of ETL work. Our primary databases are all Oracle, but our data warehouse is SQLServer. We use TFS for change control. I've played around with SSIS this week and now I think I can ask some intelligent questions (I hope!)
Is running DTEXEC from the command line the preferred method for executing packages from our enterprise scheduler (Automic/UC4?)
If DTEXEC is the preferred method, what are the pros and cons of /FILE vs /ISSERVER? (It seems to me that if we used /FILE, we could avoid a lot of change control complexities?)
The DBA on this project is pushing the package deployment feature. Good or bad choice?
I still need to research passing parameters into a package at runtime. I understand there are configurations one can set up for each environment, and one can also override the values of parameters via the DTEXEC command line. Seems to me that there are different use-cases that would favor both methods, so we should probably apply both as appropriate?
Our DBA proposes we run our packages on two new servers called SSISDEV (to support multiple non-production environments) and SSISPROD. Are there any other approaches we should consider?
(If this is the wrong forum, them please steer me elsewhere!)
Pete
Hi, I am trying to execute a SSIS Package from a stored procedure within a transaction. I also want the execution to be in Synchronized mode. This is an example of my stored procedure code:
begin try begin transaction /* inserts, updates */ declare @execution_id bigint EXEC [SSISDB].[catalog].[create_execution] @package_name=N'My Package.dtsx', @execution_id=@execution_id OUTPUT, @folder_name=N'MyFolder', @project_name=N'MyProject', @use32bitruntime=False, @reference_id=Null EXEC [SSISDB].[catalog].[set_execution_parameter_value] @execution_id, @object_type=50, @parameter_name=N'LOGGING_LEVEL', @parameter_value= 1 EXEC [SSISDB].[catalog].[set_execution_parameter_value] @execution_id, @object_type=50, @parameter_name=N'SYNCHRONIZED', @parameter_value= 1 EXEC [SSISDB].[catalog].[start_execution] @execution_id; /* throw error if execution status is not = 7 ("Success") */ commit transaction end try begin catch if @@Trancount > 0 rollback transaction; end catch
The problem is that the package reaches a timeout and gets a status = 5 ("Pending").
If I remove the Synchronized setting, it works. If I remove the transaction, it works. But a combination of both will not work. Can anyone think of a simple workaround for this?
Thank you,
Filip
Hi All,
We have a situation where we have a SQL Server 2008R2 SSIS package x64 that needs to be executed in 32bit runtime because the package uses MS Excel. We tested the package by setting 64 bit runtime as false. We deployed it to the dev SSIS server and called it from the SQL Job, it failed with Excel connection error. We found that required client tools were not installed and we installed them on the server. After the installation we executed the package with 32 bit runtime option and it fails to load. Could you please help me to debug this issue? Would be helpful if you can point me to similar question previously asked and answered.
Thanks in advance.