Hi
I have created a packages which pull and push the data to SAP server.
I want to create a report every day and send that report to the manager.
For the same i want to call reporting services in my SSIS package.
I know i can write a SQL script and export the report in excel but i want to use Reporting services.
Have any one call reporting services from ssis.
Just curious what are all the best practices in industry for error handling which includes generating the exact version of source format . So that end user can correct and reload it.
Also what is the best practices of validating data in oracle db after data load? Right now I am doing the count ,distinct to find different column values and spot checking the data format. Is there any opensource tool available for data validation?
What should I expect the output as per ETL work? Right now gathering stats and generating excel for missing records.
Please share some guidance on this...
Thanks...
Hello All,
I have created a SSIS package and deployed it as a project model in SSISDB Internal Catelogs and run from SQL server Agent Job. It runs for a while and then starts throwing the below error. And then restart of the SQL server makes it work again for few more
hours and again the same error appears.
I have raised the memory to fullest possible in SQL Server 2012. Its 32 bit SQL server instance. No matter increasing the memory or enabling the CLR it still runs for few hours after the SQL server restart. This cannot be a solution as there needs to be something
which has to be addressed for the Storage issue.
Please could you advice me on this?
Error : Failed to create AppDomain "SSISDB.dbo[runtime].3". Could not load file or assembly 'System.Xml, Version=4.0.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089' or one of its dependencies. Not enough storage is available to process
this command
Memory
Memory
Error Message
Thanks
Senthil
# SSIS package for Microsoft SQL Server 2014 (SP2) (KB3171021) - 12.0.5000.0 (X64)
# PSVersion 5.0.10586.117 32 bit
$ErrorActionPreference="Stop"
Set-PSDebug -Strict
Add-Type -AssemblyName "Microsoft.SQLServer.ManagedDTS, Version=12.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91"
Add-Type -AssemblyName "Microsoft.SqlServer.DTSPipelineWrap, Version=12.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91"
[string]$srcConnStr = "Provider=SQLNCLI11;Integrated Security=SSPI;Persist Security Info=False;Initial Catalog=Test;Data Source=XYZ;"
[Microsoft.SqlServer.Dts.Runtime.Package]$Package = New-Object Microsoft.SqlServer.Dts.Runtime.Package
[Microsoft.SqlServer.Dts.Runtime.Application]$App = New-Object Microsoft.SqlServer.Dts.Runtime.Application
[Microsoft.SQLServer.Dts.Runtime.Executable]$exec = $Package.Executables.Add("STOCK:PipelineTask")
[Microsoft.SqlServer.Dts.Runtime.TaskHost]$th = [Microsoft.SqlServer.Dts.Runtime.TaskHost]$exec
$th.Name = "Data Flow Task"
[Microsoft.SqlServer.Dts.Pipeline.Wrapper.MainPipe]$DataPipe = [System.Runtime.InteropServices.Marshal]::CreateWrapperOfType($th.InnerObject, [Microsoft.SQLServer.DTS.pipeline.Wrapper.MainPipeClass])
[Microsoft.SqlServer.Dts.Runtime.ConnectionManager]$SourceConn = $package.Connections.Add("OLEDB") -As [Microsoft.SqlServer.Dts.Runtime.ConnectionManager]
$SourceConn.Name = "OLEDBConnectionSource"
$SourceConn.set_ConnectionString($srcConnStr)
$oledbSource = $DataPipe.ComponentMetaDataCollection.New()
$oledbSource.Name = "OLE DB Source"
$oledbSource.ComponentClassID = "DTSAdapter.OLEDBSource.1";
[Microsoft.SqlServer.Dts.Pipeline.Wrapper.CManagedComponentWrapper]$InstanceSource = [System.Runtime.InteropServices.Marshal]::CreateWrapperOfType($oledbSource.Instantiate(),[Microsoft.SqlServer.Dts.Pipeline.Wrapper.CManagedComponentWrapperClass])
$instanceSource.ProvideComponentProperties()If I change DTSAdapter.OLEDBSource.1 -> DTSAdapter.OLEDBSource.4
Thank you
Like many shops, I am working in a heterogeneous environment. Old Production is SQL Server 2008 R2 Express. We are currently migrating to new production environment of SQL Server 2012 Enterprise. We've been told by our DBA team, that we will probably be upgrading to SQL Server 2016 Enterprise in Q2 of 2017. In real terms, as an ETL developer, I have Visual Studio 2008 (BIDS), Visual Studio 2010 (Shell), Visual Studio 2012 Pro (/w Data Tools), and Visual Studio 2015 Pro (/w Data Tools).
My problem is one of version incompatibility. I can edit and debug .DTSX packages in all environments but one... The one I need... Visual Studio 2012 Pro... The environment we're migrating to. I can build and edit packages, but whenever I activate the Debugger I get:
Unable to start program 'DTS'. The debugger is not properly installed. Cannot debug the requested type of code. Run setup to install or repair the debugger. (Microsoft Visual Studio Debugger).
I've run repair from my Visual Studio 2012 Pro installer, I've uninstalled and reinstalled, and I've tried various suggestions from various forums... all to no avail. Can anyone in this forum make a substantive suggestion on how I can fix this problem?
Thanks!
Brandon.Forest@blueshieldca.com
Hi,
I have been trying to access the https://api012.successfactors.eu/odata/v2/
The test connection succeeds but it does not load the collection.
Your help would be highly appreciated.
Thanks in Advance.
Hi all,
I have an SQL script that selects images taken by specific users. I want to create a package that will extract all these images and place them in appropriate folders, based on the user names.
For example, my data is as follows:
I want the package to create folders based on the user names (the user name is part of the image name). So , in this example, the folders created would beuser1 (3 images), user4 (2 images), user5 (1 image), user6 (4 images).
Please assist
Regards
Hi
I want to do custom logging (not ssis logging from ssis > logging menu) but I obviously don't want the logging to participate in the main transaction otherwise i'll lose the log records.
DTC is set up. I've a parent (controller) package. The package TransactionOption property is required and the rest (except for logging 'execute sql' tasks) are set to 'not supported'. So it's a basic all or nothing affair except for the logging inserts.
When I try to insert into the logging table it hangs on that task. Ive used profiler and im getting insert locks with blocking session id -2.
It seems as though the transaction start (required) is locking the schema, but allows reads). I've gone through all the properties of the connection manager and execute sql task and nothing is shouting at me. The connections RetainSameConnection property is false so I assumed the connections would be pooled and thus can cope with a 'not supported' task. It doesn't. So I tried to create a new connection and assigned the sql task to this (as not supported) but this doesn't help either, still hangs.
It must be pretty common to log errors independently of a transaction within that package - in the same way as you can do it in a try / catch via sql. But none the wiser through ssis. Any ideas?
Thanks, Jon
I am using SSIS Data Flow Task to export data from Sql Server to Excel Destination, but while exporting it Convers int value to Numbers Stored As Text Excel Cell Error,every cell gets this error with a green tag.Can you please guide me how can I export my int value to number in Excel.
Thanks
Hi All,
I now have 2 packages:
Package 1 to create the folders, as in the below (which works perfectly):
Package 2 to export the images to specific folder, (the "E:\Zimiso\Test" folder, as in my previous query) (also works perfectly for one folder):
How can I combine these 2 packages into one, so that the export (Package 2) is done to all the folders created by the first (Package 1).
Please advise,
Many thanks
Hello, Please I have excel files that I receive with different sheet names, and the record I want to use starts from a specific range like sheet1$A3:DH4
I was able to get the sheetname as a variable using scripttask, so my question is how can I dynamically populate this range value using the sheetname. Thanks
Hi There,
We have an existing web application of sales of customers in which the back end data is maintained in the form of sql databases. They are nearly 50 databases and we have a fresh server in which we have to work remote. Our client want us to Migrate the total databases and DTS to SSIS packages, from the existing server(SQL server 2008 R2) to the new server (SQL server 2016).
We have several DTS packages (in 2000) since the data is too old and we need to convert those DTS packages to SSIS packages, we are working with it.
What are the points need to be considered while migrating those SSIS packages (Which are not Converted yet from DTS) to the new server? Suggest us the best plan to migrate DTS or SSIS without any issues in SQL server 2016.
Hi,
I have two table(Dataset from sql command) from different server. I want to use first table result set join with other server table and get the result and insert in different server destination.
Kindly suggest, I did the same from merge join but I want to get data from other table only required dataset. because 2nd table output has more than 1,00,000 record.
Hi,
As per my requirement in the org, we need to sync the data on one of the DB server. We have more than 30 DB servers across the country. In global (Centralized DB), we have a column for every row which has Local Server ID/Sequence No. Depending on the ID, we need to connect that server through SSIS and perform the INSERT/UPDATE/DELETE operation on that server.
Can you please share the way and code sample to complete the task.
Thanks
DKG
Hi,
As per my requirement in the org, we need to sync the data on one of the DB server. We have more than 30 DB servers across the country. In global (Centralized DB), we have a column for every row which has Local Server ID/Sequence No. Depending on the ID, we need to connect that server and perform the INSERT/UPDATE/DELETE operation on that server.
Can you please share the way and code sample to complete the task.
Thanks
DKG
Hi All,
I'm using SQL server 2012 and Visual Studio 2010 sp3. I have a SSIS package which is connecting to Oracle DB. An upgrade of Oracle from 11g to 12C (both 64bit) has recently happended and after that whenever I open my SSIS package it is crashing.
If I develop a new package pointing to Oracle, getting error "Test connection failed because error in initializing provider. ORA -06413 : Connection not open" . I'm not sure what need to be checked to make sure the connection is open.
Request you please suggest the fix for it. Kindly let me know if you need more details. Thanks
Cheers
Jim
I have the exist SSIS package export data form SQL and completed some data manipulated.
Now, I need to convert the Excel to csv format in SSIS. it works fine. a small issue needs help here:
I need the csv file with empty data having the column head. I delete all the records in CSV file. Exported data starts not the first row.
Any advice would be appreciated.
Thanks!
I'm trying to buff up my skills with SSIS/SSRS/SSAS.
I have the 70-448 MS SQL Server 2008 Business Intelligence and Maintenance self-paced training book. However, I no longer have SQL Server 2008 and cannot find a place to download it THAT WILL WORK. I tried one, and it came back and said I didn't have some registry entries it was looking for.
So, now I'm trying to use this 2008 book with SS 2014, and, well, there's some problems with following stuff due to changes in the version I guess.
So, question is, what self-paced books are out there THAT ARE GOOD, that I can use. I'm an experienced programmer, and have used SSIS several times at work, and SSRS for one job. No SSAS yet.
I'm looking at Amazon, and nothing is really floating my boat.
I DO NOT WANT TO GO TAKE SOME BOOT CAMP CLASS. That is not how I learn.
Possibly work towards a certification, though I and some employers don't view certifications as an adequate replacement for real world experience. Since I have the real world, a certification might just convince someone. But, I definitely need to work through some projects and get familiar with as much as I can.
Thanks, David
hi how i can generate the report uisng ssis?