Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Access database engine cannot open or write to the file

$
0
0

Dear All, 

I have created package in SSDT and I can execute package in SSDT -  load data in excel to sql database - it works. However after deployment to server it does not work, I have following error:

"An OLE DB record is available. Source: "Microsoft Access Database Engine" Hresult: 0x80004005 Description: "The Microsoft
Access database engine cannot open or write to the file '\\KKK001\TEST\Template.xlsx'. It is already opened exclusively by another user, or you need permission to view and
write its data."

In job there is a proxy user which have access to the excel file. 

Apart from job I have tried to execute the package from Integrated Service Catalog, so from my user (I have also access to excel file) and can see the same error. 

Can you help with the issue? 


Object out of line

$
0
0

Hi, 

I have the following error when refreshing a database:

Se ha especificado el objeto fuera de línea 'DataSource', que hace referencia a los identificadores 'e3e1f661-4288-4a6e-a83e-a17a4c890418', pero no se ha usado.
Error de OLE DB u ODBC: [DataFormat.Error] No se puede convertir a numérico..

anybody knows how to fix this?

Is it possible to run multiple Data Flow tasks simultaneously?

$
0
0

Imagine that I have to move 10 Human Resource related "master" tables from Oracle to SQL Server. 

It is clearly possible to run Table1, then Table2, then Table3, etc. in an SSIS package. I could create a Control Flow with 10 Data Flows, with each Data Flow containing a source and destination.  The Control Flow could then link the Data Flows together in sequential manner.

Is there a way to have the Control Flow launch multiple Data Flows in parallel or simultaneously?

The idea being to move non-interdependent data tables in parallel and dependent data tables in sequence of their dependence.

Thanks.

SSIS logging Malicious file upload. My application security team

$
0
0

Malicious file upload.

 

Observation: Attacker can directly upload an executable file or use a double extension file to upload in to the server.

 

Impact: The web server can be compromised by uploading and executing a web-shell which can run commands, browse system files browse local resources attack other servers and exploit the local vulnerabilities. This may also result in defacement

 

Recommendation: The application should validate the type of file that is uploaded by the user prior to accepting and parsing the file.

Proof of concepts and steps to reproduce:

  1. 1.       Create one ‘sample file with .com’ extension in physical drive.

 2.       In created SSIS package right click on empty place and select logings to create loggings. And click on the Add button under ‘Providers and Logs’ tab as shown bellow

 

3. Click on the configuration dropdown and select New connection. Then ‘file connection manager editor’ window will open. Click on ‘Browse’ button and select ‘test file .com’ file which is created already. 

4. Click on Ok button. Now we can see .com file under connection managers.

Can you please check weather it is really harmful to application?


Sudhan

Possible Buffer Overflow Attack. My application testing team asking clarification

$
0
0

Possible Buffer Overflow Attack

 

Observation: It was observed that application accept very large input which could possibly lead to buffer overflow attack

 

Impact: Buffer overflow can often lead to crashing of the whole application which could impact user experience and possibly lead to business loss

 

Recommendations from security team: It is recommended that proper input validation should be implemented.

 

Proof of concepts and steps to reproduce


Sudhan

Check and re-insert data

$
0
0

Hi, 

I am trying to move data from the staging database to the prod database, but my table doesn't have primary key so how can I create a SSIS process? which compares a data from staging db to prod db then delete the existing data from prod and insert new data from staging. Can you please help me with this issue?  

I have same rows in both databases, and I want to compare a data based on the date. 

Thank you,

How load data row by row to destination tables using SSIS for each loop container

$
0
0

Hi Team,

1. Have 20 tables in my database. 

2. In one table having two reference keys (empId,SubCatID) with associated with remain 19 tables.

3. Each table have primary key

4. Want to load data row by row in each table 

for example:

Have one record as empId=1. Want to load this record into table2,table3...table20.

after that empId=2 process to load table 2 to 20.

If it is possible using SSIS foreach loop container, please help on same


Thanks Bala Narasimha

Execute Powershell script on remote server

$
0
0

I have two servers A and B.

A is the DB server with no front-end access (i can't install or change anything)

Server A doesn't have powershell but B has. powersshell. I want to execute a powershell script (located on server B), using a SQL Agent job on Server A.

First approach was invoke command but since server A doesn't have powershell, it doesn't work.

Please advise (if ) how can I achieve this?

Thanks in advance.


ADO NET Source has failed to acquire the connection {----} with the following error message: "Could not create a managed connection manager."

$
0
0

SSIS package and sql server are both on different server. By using proxy i am executed package on another server.

but it provides me error while executing through sql agent job 

ADO NET Source has failed to acquire the connection {----} with the following error message: "Could not create a managed connection manager."

Script Component issues : SSIS 2014 to SSIS 2017 migration

$
0
0

Hi,

I am trying to migrate our SSIS 2014 packages from SQL Server 2014 to 2017:

The Extract packages have all been upgraded with the help of the SSIS Package Upgrade Wizard and manual (!) recompile of all .NET scripts in each package. The extract layer is running without any issues and pulling data from its sources.

The TransformLoad layer packages are proving to be a major problem. It appears thatScript Component is missing as can be seen from the first image below. Examining the source of one of the package, the Script Component version is still SQL Server v10 i.e. SQL Server 20108 R2 which was the original version of SQL Server used for this solution.

Does anyone know why these script components are not being upgraded by the wizard? More importantly, is there a workaround without having to delete, add, edit every problem script component in every package?

SSIS Package runs fine on Visual Studio, but fails on executing with SQL Server or DTExec

$
0
0

Hi.

I'm having trouble with executing my SSIS packages automatically on SQL Server and also with DTExec. Compared to other packages that run without problem, this in particular, has a C# task script which runs as a webservice to exctract data from Oracle Cloud, keeping it locally as XML and later on uploading that data to an SQL Server.

This is the error message that appears to me the moment i execute it on SQL Server:

"Message
Executed as user: WIN2K8SQL03SRV\SYSTEM. ...0.2000.8 for 64-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  5:16:52 PM  Error: 2019-10-01 17:17:06.08     Code: 0x00000005     Source: Script Analisis Gasto Script Analisis Gasto     Description: Failed to compiled scripts contained in the package. Open the package in SSIS Designer and resolve the compilation errors.  End Error  Error: 2019-10-01 17:17:06.08    Code: 0x00000005     Source: Script Analisis Gasto Script Analisis Gasto     Description: MSB3086 - Task could not find "sgen.exe" using the SdkToolsPath "" or the registry key "HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Microsoft SDKs\Windows\v8.0A\WinSDK-NetFx40Tools-x86". Make sure the SdkToolsPath is set and the tool exists in the correct processor specific location under the SdkToolsPath and that the Microsoft Windows SDK is installed, C:\Windows\Microsoft.NET\Framework64\v4.0.30319\Microsoft.Common.targets, 2769, 5  End Error  Error: 2019-10-01 17:17:06.18     Code: 0x00000005     Source: Script Analisis Gasto Script Analisis Gasto     Description: The binary code for the script is not found. Please open the script in the designer by clicking Edit Script button and make sure it builds successfully.  End Error  Error: 2019-10-01 17:17:06.68     Code: 0xC00490F7     Source: STG a DW STG a DW (ora_analisisgasto [2])     Description: The managed pipeline component "Microsoft.SqlServer.Dts.Pipeline.ADONETDestination, Microsoft.SqlServer.ADONETDest, Version=15.100.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91" could not be loaded.  The exception was: Could not load file or assembly 'Microsoft.SqlServer.ADONETDest, Version=15.100.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91' or one of its dependencies. The system cannot find the file specified."

I'm using Windows Server 2008 R2 with SQL Server 2012 and Visual Studio 2017 with the corresponding versions of SDDT.

The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009

$
0
0

I have deployed my packages into Sql Server and I am using Configuration File. As my Data Source is Excel, I have changed the connection string during deployment with Server Path. But I am getting the following errors. Actually the File Exist in Path. May I know What is cause of the issue? Do I need to give any permission to execute the package.

 

SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed. 

 

component "Excel Source Service Contract Upload" (1) failed validation and returned error code 0xC020801C. 

One or more component failed validation. 

 

There were errors during task validation. 

DTS_E_OLEDBERROR, Error Code: 0x80004005 Source: "MS JET DB Engine" Description : Path is not valid


 

Project/Package deployment (MSDB) vs Catalog (SSISDB)

$
0
0
On SQL Server 2016, which is a better option (more secure, best practice, recommended, etc.), deployment of SSIS to MSDB (project or package) vs Catalog deployment. I've used both, personally prefer Catalog, but, was told recently that it has more security issues and it's harder to manage by the DBAs. Was surprised by this answer from the DBA team.

Adrian Hernandez

limit the number of rows to flow from ole db in ssis DFT

$
0
0

Hi,

I have a situation where I have a DFT with :

  • Ole db source from a variable contains MDX query
  • Derived column
  • Excel Destination Plus (cozyroc)

The query runs for each iteration of employee and dumps all rows in to excel file with their names.I am stuck at a place where ,for an employee,there are numerous rows outputted from the query >1,048,576 .It exceeds the number of rows permitted by Excel 2010 version.I want to check if the rows exceeds 50% of this number or greater than a specific number of rows,the flow shouldnt proceed downstream to derived column and cozyroc component 

(OR)

Somehow the DFT should fail upon on error of the ole db query so i can handle this with on task failed handler and proceed with next iteration

I tried the below but it doesnt work as expected :

  • ole db->rowcount->conditonal split->excel destination  : Rowcount calculates the rows as they pass through and allow the rows downstream to conditional split ,here the condition that rowcount>100000(for testing)doesnt seem to have any effect.Irrespective of conditions applied here ,the rows flow downstream into the Excel.
  • I have applied a on error event handler to try and see if the error fails the DFT,but unfortunately,the on error handler does write the message that the rows exceed but it doesnt fail the DFT and DFT keeps running indefinitely without stopping whole day.

Picking earliest date in multiple dates in same colum( it is NVARCHAR files in staging table )

$
0
0

HI,

I have Dates column( NVARCHAR )datatype in sql table which contains multiple dates concatenated with space like following

 ID                 Dates 

1                1993-09-30   1994-09-22  1993-09-26  2003-09-20

I want pic Earliest date and migrate to one column through ssis package. is it possible from derived transofmation or any other process. is it possible from inside data folw task ? I have already mapped these other columns to my detination table. but I want to filter this from source table and migrate onely one date to destination column. is it possible ?

please help me on this scenario. 

Thanks,

Sriraj


Cannot connect to SSIS ,dtsruntimewrap exception 0xC00160AC

$
0
0

How Can I Fix This Issue:(?
Cannot connect to ..

===================================

Failed to retrieve data for this request. (Microsoft.SqlServer.Management.Sdk.Sfc)

For help, click: http://go.microsoft.com/fwlink?ProdName=Microsoft%20SQL%20Server&LinkId=20476

Program Location:

at Microsoft.SqlServer.Management.Sdk.Sfc.Enumerator.Process(Object connectionInfo, Request request) at Microsoft.SqlServer.Management.SqlStudio.Explorer.ObjectExplorerService.ValidateConnection(UIConnectionInfo ci, IServerType server) at Microsoft.SqlServer.Management.UI.ConnectionDlg.Connector.ConnectionThreadUser()

===================================

Exception from HRESULT: 0xC00160AC (Microsoft.SqlServer.DTSRuntimeWrap)

For help, click: http://go.microsoft.com/fwlink/?LinkId=506689

Program Location:

at Microsoft.SqlServer.Dts.Runtime.Application.GetServerInfo(String server, String& serverVersion) at Microsoft.SqlServer.Dts.SmoEnum.DTSEnum.GetData(EnumResult erParent) at Microsoft.SqlServer.Management.Sdk.Sfc.Environment.GetData() at Microsoft.SqlServer.Management.Sdk.Sfc.Environment.GetData(Request req, Object ci) at Microsoft.SqlServer.Management.Sdk.Sfc.Enumerator.GetData(Object connectionInfo, Request request) at Microsoft.SqlServer.Management.Sdk.Sfc.Enumerator.Process(Object connectionInfo, Request request)

===================================

Exception from HRESULT: 0xC00160AC (Microsoft.SqlServer.DTSRuntimeWrap)

Program Location:

at Microsoft.SqlServer.Dts.Runtime.Wrapper.ApplicationClass.GetServerInfo(String bstrMachineName, String& serverVersion) at Microsoft.SqlServer.Dts.Runtime.Application.GetServerInfo(String server, String& serverVersion)





I also Fix The Grant Permission But Still Have This Error

error when migrating SSISDB to new server of newer version of SQL

$
0
0

I tried to move SSIS database catalog on SQL server 2014 to a new server SQL 2017.

I created the catalog first on new server, and then restored the database SSISDB from old server to new server.

And restored the master key.

Then I run the following stored procedure and got an error:

Use SSISDB

go

EXECUTE   [catalog].[check_schema_version]
   @use32bitruntime=1

 Msg 10314, Level 16, State 11, Procedure catalog.check_schema_version, Line 117 [Batch Start Line 2]
An error occurred in the Microsoft .NET Framework while trying to load assembly id 65536. The server may be running out of resources, or the assembly may not be trusted. Run the query again, or check documentation to see how to solve the assembly trust issues. For more information about this error:
System.IO.FileLoadException: Could not load file or assembly 'microsoft.sqlserver.integrationservices.server, Version=12.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91' or one of its dependencies. An error relating to security occurred. (Exception from HRESULT: 0x8013150A)
System.IO.FileLoadException:
   at System.Reflection.RuntimeAssembly._nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.RuntimeAssembly.InternalLoadAssemblyName(AssemblyName assemblyRef, Evidence assemblySecurity, RuntimeAssembly reqAssembly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.RuntimeAssembly.InternalLoad(String assemblyString, Evidence assemblySecurity, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean forIntrospection)
   at System.Reflection.RuntimeAssembly.InternalLoad(String assemblyString, Evidence assemblySecurity, StackCrawlMark& stackMark, Boolean forIntrospection)
   at System.Reflection.Assembly.Load(String assemblyString)

If I use  parameter @use32bitruntime=0, it is also the same error.

It seems it tried to find 2014 version of  assembly. But my new server is newer version of 2017,

Basically I follow the instruction on this page:

https://blog.pythian.com/how-to-restore-ssisdb-to-another-server-and-migrate-the-ssis-catalog/

Now what I should do to fix this error?

Thanks much!


Thanks



How to clean data in a ssis derived column using an expression

$
0
0

Hello,

I stuck trying to strip away unnecessary characters in my SSIS package. How can i accomplish this?  

Setting TypeGuessRows for excel ACE Driver

$
0
0

I set the TypeGuessRows registry value to 0 in this location:

HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Office\14.0\Access Connectivity Engine\Engines\Excel

Is that the correct location where it would be set when creating excel files through SSIS 2012 using the ACE driver like this one:

Provider=Microsoft.ACE.OLEDB.12.0;Data Source=D:\myfile.xlsx;Extended Properties="EXCEL 12.0 XML;HDR=YES;IMEX=1";

I'm still having problems with fields over 255 characters and thought maybe that I had set TypeGuessRows in the wrong location.

Thanks


Why does manual project validation fail while execution succeeds?

$
0
0

Hi All,

We have numerous SSIS projects deployed to an SSIS server and they execute successfully, but whenever I try to manually validate them [by right-clicking the project and selecting "Validate" from the pop-up menu], they fail validation.  A common message that shows up in the Failed validation reports "Login failed for user 'NT AUTHORITY\ANONYMOUS LOGON'."  Is this the SSIS service account?  I can't tell because I don't know how how to find out without logging into the machine itself.

Thanks,
Eric

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>