I am trying to copy data from one server to other.
Initially the current package truncates the tables and then populates the tables with new data on other server.
In this process, if anyone else is using that table, its either empty or not complete table.
if i have a table XXX, I would like to create some new table XXX_new, copy the data into that new table and at the end of the process drop my old table and then rename the XXX_new to XXX.
Is this possible in SSIS package (2012)
Have the performance issues with the SSISDB been fixed for SQL Server 2016? Such as the missing index issues that were reported in previous versions. If this has not been fixed yet, do you have best practice configuration and maintenance for SSISDB 2016.
Currently We have horrible performance issues with SSISDB in 2014. 12GB database 2 projects. I'm trying to delete one project and it ends up consuming 43GB of log space in SSISDB and ends up failing
with timeout. We may not put the effort into fixing this one since we are planning to move it to 2016 soon.
Melissa Explore Information Services, LLC
I'm struggling with the concept of package protection.
I'm using datatools bids 2012 and security defaults to encryptwithuserkey.
When I change this to don't save sensitive, or even to use a password, it can't build because the package doesn't match. So some googling found the article on changing package levels using dtutil, which then seems to corrupt the dtsx file and the project can't load any longer.
What am I missing?
Ideally I don't want it to save sensitive info at all as I'll be handing this off to an operations team.
I've done this before with 2008r2 but I was able to simply change the property and be done with it.
EDIT: specifically this is the error when I try to build:
Error 1 Project consistency check failed. The following inconsistencies were detected: filename.dtsx has a different ProtectionLevel than the project. 0 0
changing this back to encryptwithuserkey allows me to build, but obviously isn't acceptable with team environment.
Hi,
We need to generate csv file with datetime (to milli seconds) to distinguish from other files. I am setting up a variable like this at package scope:
variable @[user::RepFilePath]
"C:\\Backup\\ABC\\" + "REP_HLDS_" + (DT_WSTR,4)YEAR(GETDATE())In dataflow task, getting data from sql server and using flat file destination, generating CSV file using above variable as file name. There is another process that copies the files from above folder. Once data is retrieved from sql server, need to do conditional split and generate 3 files. Some times there may be data that satifies for only 2 files or 1 file. In that case rest of the empty files are getting generated even though there are no rows.
After doing lot of research, using rowcount transformation task to get row count in DataFlow and after execution comes back to control flow, trying to delete a generated file using File System Task. For delete, I am using @[user::RepFilePath] as source variable. When I run the package, it shows that it ran successfully, but I still I see a file in the folder. How does this dynamic file name generation variable work.
Does it get set once when package starts running and stays same throughout until it is changed again or it gets builts dynamically when ever variable is accessed ? As far as I know, if scope is set to package, it is available to all tasks in the package, but value changes when ever it is accessed because it is set as expression.
Please clarify and let me know how to handle this.
Thanks
I created SSIS package and its running perfectly fine using BIDS. My package is saving the data from excel files to SharePoint list. I saved the package to production Sql Server using the option Save Copy of Packages as from BIDS tool. I have the proxy set up and i'm using that to run my package thru Sql Server Agent Job. I received the following error:
"Could not load package " " because of error 0xC0014062. Description: The LoadFromSQLServer method has encountered OLE DB error code 0x80040E4D (Login failed for user 'NT\svc_prd_17'.). The SQL statement that was issued has failed. Source: Started: 4:48:02 PM Finished: 4:48:02 PM Elapsed: 0.094 seconds. The package could not be loaded. The step failed."
I'm trying to create a folder called MyPackage in the SSIDB folder of the Integrated Services Catalogs in SQL Server. I right-click the SSIDB folder, Create Folder, type in 'MyPackage, Ok, then error message:
Execution Error. Operation 'Create' on Object 'CatelogFolder[@Name = 'MyPackage']' failed during execution
Can anyone explain how to fix it?
Hello,
i have a strange issue using Microsoft OLEDB provider for DB2, I was migrating SSIS 2008 to SSIS 2012 the dataflow task with OLEDB Source which have error output configured are throwing error in 2012 where as works fine in 2008.
Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80040E00.
An OLE DB record is available. Source: "Microsoft DB2 OLE DB Provider" Hresult: 0x80040E00 Description: "Accessor is invalid.".
When i remove the error output everything executes fine, does anyone encountered this before?
Thanks,
naveej
I created an SSIS Project in BIDs. The packages are created with domain account and the package protection level is Don’t Save Sensitive. The package work fine on developer server the package is deployed to the QA and the package is executed with a service account that has dbo permission to the database accessed by this packages. A credential and proxy is created for this service account. But this execution failed with this error message:
“Unable to start execution of step 1 (reason: Error authenticating proxy name. system error: Logon failure: unknown user name or bad password.). The step failed. Anyone with the idea of how to resolve the issue”.
Thanks
Hello,
In my Script Component I'm trying to use Microsoft.AnalysisServices Namespace to access the Cube Partitions.
Here's my code (Microsoft Visual Basic 2015) extract that I have:
#Region "Imports" Imports System Imports System.Data Imports System.Math Imports Microsoft.SqlServer.Dts.Pipeline.Wrapper Imports Microsoft.SqlServer.Dts.Runtime.Wrapper Imports Microsoft.AnalysisServices #End Region .. Public Overrides Sub CreateNewOutputRows() ' ' Add rows by calling the AddRow method on the member variable named "<Output Name>Buffer". ' For example, call MyOutputBuffer.AddRow() if your output was named "MyOutput". ' Dim sASServer As String = Me.Variables.ASServer.ToString()
' The following line produces a compile error:
' Type 'Microsoft.AnalysisServices.Server' is not defined Dim oASServer As New Microsoft.AnalysisServices.Server Try ' Connect to the requested server oASServer.Connect(sASServer) Dim oASDatabase As New Microsoft.AnalysisServices.Database Dim oASCube As New Microsoft.AnalysisServices.Cube Dim oASMeasureGroup As New Microsoft.AnalysisServices.MeasureGroup Dim oASPartition As New Microsoft.AnalysisServices.Partition Dim parse As Double ' Loop trough all of the dbs on the server For Each oASDatabase In oASServer.Databases If oASDatabase.Name = Me.Variables.ASDatabase.ToString() Then ' Find the desired database For Each oASCube In oASDatabase.Cubes ' Loop through the cubes If oASCube.Name = Me.Variables.ASCube.ToString() Then ' Find the desired cube For Each oASMeasureGroup In oASCube.MeasureGroups ' Loop through the measure groups For Each oASPartition In oASMeasureGroup.Partitions ' Loop through the paritions With PartitionListBuffer ' Load the source script component buffer .AddRow() .DatabaseName = oASDatabase.ID .CubeName = oASCube.ID .MeasureGroupName = oASMeasureGroup.ID .PartitionName = oASPartition.ID End With Next Next End If Next End If Next Finally ' disconnect from the server we are done oASServer.Disconnect() End Try
A reference toMicrosoft.AnalysisServices.Core assembly exists in my Project.
What is the correct Syntax to create a instance of Microsoft.AnalysisService.Server class?
Appreciate any help on how to troubleshoot.
Thanks
Bodo
We have two servers with the same specifications and configurations:
SSIS server | QA Server | |
RAM | 8.00 GB | 8.00 GB |
System Architecture | 64-bit | 64-bit |
Excel Driver | 32-bit | 32-bit |
Excel Driver Version | 14.0.6015.1000 | 14.0.6015.1000 |
Folder Structure | \Stored Packages\MSDB\Preprod Packages | \Stored Packages\MSDB\Preprod Packages |
Schedule of Job | Runs Every 5 mins | Runs Every 5 mins |
We recently installed 32-bit excel driver on the QA server and the job on the QA server is not working as expected even though it has the same specifications and configurations as that of the SSIS Server which is working as expected.
The job fails with the following error:
End Error Could not load package "\Preprod packages\pkg_xxxxx" because of error 0xC0010014. Description: One or more error occurred. This message is used as a return value from functions that encounter errors. Source: Started: 06:30:00 Finished: 06:30:02 Elapsed: 1.11 seconds. The package could not be loaded. The step failed.
We would like to understand the error better.
Thanks in advance.
I am using VS 2012 to create SSIS.
I have a Script that has a reference to Excel 2013 - Microsoft.Office.Interop.Excel (Add Reference - Assemblies - Extensions, then select Microsoft.Office.Interop.Excel 15.0). In the Reference Properties, the path is C:\Program Files (x86)\Microsoft
Visual Studio 12.0\Visual Studio Tools for Office\PIA\Office15\Microsoft.Office.Interop.Excel.dll.
I run the SSIS package by going to SQL Server Management Studio - Integration Services Catalogs - SSISDB, right click on the package and Execute.
The SSIS package runs fine on my machine, but when running it on the server (we already installed Excel 2013 on the server), I get this error:
Retrieving the COM class factory for component with CLSID {...} failed due to the following error: 80070005 Access is denied.
I can't find Microsoft.Office.Interop.Excel.dll on the server (even though Excel 2013 was already installed on the server).
How can I fix this error ?
Thank you.
Hi,
We currently use Attunity SSIS Connectors v2.0 for Oracle with SQL Server 2012 Integration services within the Visual Studio 2012 IDE.
We are moving to SQL 2014 and want to leverage Visual Studio 2015 SSDT as this now includes all the BI projects (SSIS, SSAS, SSRS) + SSDT and integrated with Visual Team Services. We are testing the dev tools prior to the upgrade.
I have installed the version 3.0 Attunity SSIS Connectors for Oracle (both 32bit and 64bit) which states that is works for VS 2013+, but the Connection type is not available within my Visual Studio 2015 SSIS project.
So my question is - are the Attunity SSIS Connectors v3.0 for Oracle supposed to be compatible with VS 2015, and if not, is there expected to be an update in the future?
Kind Regards,
James
Hi,
we are developing a data flow custom component for SSIS 2014 on Visual Studio 2013. Once the component is compiled, signed with a strong name and added to the GAC, it can be added to a VS2013 Data Flow designer, but properties cannot be edited: We get a"data stream cannot be null" error, which is originating in the constructor of the icon class to be shown in the designer.
Following some resources, we have added a DtsPipelineComponentAttribute IconResource, together with a resource fiel and icon bitmap. Resource and icon are embedded resoures, and we are using the namespace to reference the IconResource, but this is not working. I am quite sure the probelm is that we are not referring correctly or able to retrieve somewhat the embedded resources, but I have no clue on the reason.There are some workarounds (like forcing the designer use a system icon), but I would prefer to avoid them
I am not sure if this is an old question, but any reference would be appreciated
Thanks in advance
Angel
I have got around 35 tables whose data need to be migrated from SQL Server to MySQL. I am using SSIS for this project and I have set up a control flow (using Load Multiple Tables) with a Script Task and a Foreach Loop Container that iterates through all the tables in my database. What I now need to do is convert the data type for some of the columns, in some of the tables, to 'Unicode String [DT_WSTR]' before I dump them in my destination tables. Is this something that can be done through SSIS? If so, any pointers or a set of instructions would be great.
Thanks,
Pratik Gandhi
I have requirement where i have records in flat file and need to grouped and stored in root table for parent records and un-grouped records in to another child table. What would be the best way to load this information ? I can think of loading the grouped records in to root table and then doing a second pass where i will find all records per group but i don't think this would be efficient way. Is there any simpler way ? Below in first table i have actual data coming from source and in following i have what it needs to transform in to.
ACTUAL DATA
| USER ID | USER | ADDRESS | CITY | STATE | LIMIT |
| 1 | JAMES | ADDRESS 1 | NEW YORK | NY | 12 |
| 1 | JAMES | ADDRESS 1 | NEW YORK | NY | 3 |
| 1 | JAMES | ADDRESS 1 | NEW YORK | NY | 12 |
| 2 | LINK | ADDRESS 2 | NEW JERSEY | NJ | 15 |
| 2 | LINK | ADDRESS 2 | NEW JERSEY | NJ | 15 |
| 3 | FRANK | ADDRESS 3 | BOSTON | MA | 1 |
| TABLE 1 DBO.USER_INFO | |||||
| USER ID | USER | ADDRESS | CITY | STATE | |
| 1 | JAMES | ADDRESS 1 | NEW YORK | NY | |
| 2 | LINK | ADDRESS 2 | NEW JERSEY | NJ | |
| 3 | FRANK | ADDRESS 3 | BOSTON | MA | |
| TABLE 2 DBO.USER_LIMIT | |||||
| USER ID | LIMIT | ||||
| 1 | 12 | ||||
| 1 | 3 | ||||
| 1 | 12 | ||||
| 2 | 15 | ||||
| 2 | 15 | ||||
| 3 | 1 | ||||
Today I suddenly faced with an issue - after hitting F5 for SSIS package it returned
Text version of error messages looks like:
TITLE: Microsoft Visual Studio ------------------------------ Unable to start debugging. The debugger is not properly installed. Run setup to install or repair the debugger. ------------------------------ ADDITIONAL INFORMATION: Unable to start debugging. An error occurred that usually indicates a corrupt installation (code 0x80040155). If the problem persists, repair your Visual Studio installation via 'Add or Remove Programs' in Control Panel. (Microsoft Visual Studio Debugger) ------------------------------ BUTTONS: OK ------------------------------
I repaired both VS (in Control Panel) and SSDT (by downloading SSDT web installer) - no positive changes. I completely repaired VS with VS web installer. The packages is executed OKwithout debugging (Ctrl+F5). But with debugging even single task (like Execute SQL Task) fails. It's extremely weird since yesterday everything was OK. But today....
Any ideas how to fix the issue?
I have a source table which has about 3m records, need to load few columns from source table into table1 and few columns into table2. table1 and table2 are foreign key related(parent-child tables), So when table1 is loaded I should retrieve the primary key from table1 and load it into table 2 along with the columns coming from source table. How do I do this?
Any help is appreciated.
Thanks
sree
I need your help... again!!! I am getting crazy over this!!!
I created a SSIS package used to import data into SQL table. Import files are in .xls or .xlsx format. So depending on which file is selected by the user, the program is using one of the two connections that I have created for the execution. So far, so good... everything is working perfectly when executing the package in visual studio.
The problem is happening when I call the package via a SQL Agent job. When the file selected is .xls, there are no problems at all. However, I can't get it to work with .xlsx format.
ERROR MESSAGE:
Executed as user: STATCAN\BR_SQLDEV. Microsoft (R) SQL Server Execute Package Utility
Version 10.50.6000.34 for 32-bit Copyright (C) Microsoft Corporation 2010. All rights reserved.
Started: 1:49:59 PM
Error: 2016-07-20 13:50:01.67
Code: 0xC0209302
Source: CriticalSRP Load Connection manager "CriticalListXLSX" Description: SSIS Error Code DTS_E_OLEDB_NOPROVIDER_ERROR.
The requested OLE DB provider Microsoft.ACE.OLEDB.12.0 is not registered.
Error code: 0x00000000.
An OLE DB record is available.
Source: "Microsoft OLE DB Service Components" Hresult: 0x80040154
Description: "Class not registered". End Error
Error: 2016-07-20 13:50:01.67
Code: 0xC020801C
Source: Load XLSX Data into StagingTable 1 1 XLSX DB Source [665] Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.
The AcquireConnection method call to the connection manager "CriticalListXLSX" failed with error code 0xC0209302.
There may be error messages posted before this with more information on why the AcquireConnection method call failed. End Error
Error: 2016-07-20 13:50:01.67
Code: 0xC0047017
Source: Load XLSX Data into StagingTable 1 1 SSIS.Pipeline
Description: component "XLSX DB Source" (665) failed validation and returned error code 0xC020801C. End Error
Error: 2016-07-20 13:50:01.67
Code: 0xC004700C
Source: Load XLSX Data into StagingTable 1 1 SSIS.Pipeline
Description: One or more component failed validation. End Error
Error: 2016-07-20 13:50:01.67
Code: 0xC0024107
Source: Load XLSX Data into StagingTable 1 1
Description: There were errors during task validation. End Error
DTExec: The package execution returned DTSER_FAILURE (1).
Started: 1:49:59 PM Finished: 1:50:01 PM Elapsed: 2.234 seconds.
The package execution failed. The step failed.
The execution option has been set to 32 bit in the SQL Agent job.
Any idea what this can be?
Thanks a lot in advance for your help :-)
Mylene Chalut