Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Issue in Deploying ssis packages to a folder in Integration Services Catalog

$
0
0

Issue in Deploying ssis packages to a folder in Integration Services Catalog


I am getting the below mentioned error message WHEN i tried to deploy SSIS package.

The Select Permission was denied on the Object 'projects',database 'SSISDB',schema 'catalog'. (Microsoft SQL Server ,Error :229).

I had given ssis permissions to deploy the SSIS package,  i have database owner, ssis_Admin role, sysadmin also. I don't see any db_denydatareader or db_denydatawriter roles also . I don't see any denied permissions . 

Can anyone give suggestions.

Environment:

Microsoft SQL Server 2014 - 12.0.4213.0 (X64) Jun  9 2015 12:06:16 
Copyright (c) Microsoft Corporation Enterprise Edition (64-bit) on Windows NT 6.3 <X64> (Build 9600: ) (Hypervisor)

Windows Server 2012 R2 Datacenter 64 bit edition

I had given select permissions on  Object 'projects',database 'SSISDB',schema 'catalog' . But that did not help either

Connection Manager - Windows Authentication via Service Account

$
0
0

This might be an easy solution, but I cannot find how to accomplish this. 

Our DB Server has IS installed for us to do SSIS development.  Inside my SSIS Package, I need to make a connection to our SQL Server.  Not a big deal if using SQL Login accounts, or even windows authentication.  The problem I am having is as follows.  Access to our servers is only granted through a TPAM user account, so when on the server, Windows credentials are passed as the TPAM user, which does not have access to our databases.  All database access is granted through a different service account (domain/dbServiceAccount). In order for me to start building the SSIS package, I need to set a connection for SQL Server, which only has the options for "Windows Authentication" and "SQL Server Authentication". 

How can I get a connection inside my SSIS package when the logged in user is not the one with database access? 

How to remove carriage return to unwrap flat file

$
0
0

Hey yall,

So I am starting to create a process where I will be loading some info from a file to SQL tables. The problem is the vendor sends us wrapped files. Currently our process consists of manually doing a find and replace where we find '~clm' and replace it a blank. This is our way of unwrapping the file. 

Does anyone know of a way to unwrap this within an ssis package?

Here is a preview of some data. 



so when we do a  find '~clm' that we have to type in to remove the carriage return at the end of each line. 

Please let me know if you know of any ways to do this!

Thanks,

Lyndsey


Lyndsey Cupit


Archive File File System Task Error "Access to the path is denied.".

$
0
0

I am sorry to be redundant as I have seen many posts on this topic but none describe my situation. I have a package that runs on a local server (on my computer). It accesses data stored on a NAS. The package runs fine when I tested it in 2008 BIDS. It runs in SQL Job Agent Right to the last step that moves the imported file to a archive folder. I have created credentials with my network ID, then created a proxy using said credentials. One would think that means when a job is runs it has the privileges  assigned through the credentials so in essence my rights network and otherwise. The only thing I can think of is I have changed my password since I created the credentials. Is there something else or a step I am missing? Thanks for any help. 

05/27/2016 07:17:25,GMS_Load_CT1_History,Error,2,O2WJBURKE\SQL2008R2,GMS_Load_CT1_History,CT1 Import History,,Executed as user: TORCHMARKCORP\O2WJBURKE$. Microsoft (R) SQL Server Execute Package Utility  Version 10.50.6000.34 for 64-bit  Copyright (C) Microsoft Corporation 2010. All rights reserved.    Started:  7:17:25 AM  Error: 2016-05-27 07:29:28.63     Code: 0xC002F304     Source: Archive File File System Task     Description: An error occurred with the following error message: "Access to the path is denied.".  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  7:17:25 AM  Finished: 7:29:28 AM  Elapsed:  723.315 seconds.  The package execution failed.  The step failed.,00:12:03,0,0,,,,0


SSIS 2012R2 - Crash running SSIS Package

$
0
0

Hi,

I have an SSIS package with a Flat File Source that gets inserted into SQL Server. Whenever I try to run the package, dtexec crashes and dumps a file. I have two identical environments (one test, another production) and the package crashes only in production. Has anyone seen this before?

Stack trace:

00000000`239dfbb0 00007ffc`42283c9c : 00000000`00000000 00000000`1fb04a70 00000000`00000002 00000000`00000000 : FlatFileSrc!CImportStream::SeekNextColumn<unsigned short,0,1>+0x377
00000000`239dfc20 00007ffc`42282cbb : 00000000`1fb0cc58 00000000`1fb0ece0 00000000`00000000 00000000`0139f490 : FlatFileSrc!CParser::SkipDataRows+0x6c
00000000`239dfc60 00007ffc`4225bedf : 00000000`00000000 00000000`00000000 00000000`1faa18f0 00000000`239dfd30 : FlatFileSrc!CParser::FillBuffer+0x5b
00000000`239dfca0 00007ffc`491e933a : 00000000`1faa18f0 00000000`00000000 00000000`00000000 00000000`00000002 : FlatFileSrc!CFlatFileSrc::PrimeOutput+0x13f
00000000`239dfd20 00007ffc`491e5d74 : 00000000`1fa809e0 00007ffc`67ec3dba 00000000`00000001 00000000`00000000 : DTSPipeline!COutputExecutionItem::DoWork+0x38a
00000000`239dfe10 00007ffc`491e5e77 : 00000000`1faab400 00000000`1faab4f0 00000000`1fad0fd0 00000000`00000000 : DTSPipeline!CSchedulerThread::ProcessWork+0x74
00000000`239dfe60 00000000`5e4d1d9f : 00000000`1faab4f0 00000000`00000000 00000000`00000000 00000000`00000000 : DTSPipeline!CSchedulerThread::ProcessWorkThreadProc+0x27
00000000`239dfe90 00000000`5e4d1e3b : 00000000`5e562ac0 00000000`1faab4f0 00000000`00000000 00000000`00000000 : msvcr100!_callthreadstartex+0x17
00000000`239dfec0 00007ffc`689213d2 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : msvcr100!_threadstartex+0x7f
00000000`239dfef0 00007ffc`6a4454e4 : 00007ffc`689213b0 00000000`00000000 00000000`00000000 00000000`00000000 : kernel32!BaseThreadInitThunk+0x22
00000000`239dff20 00000000`00000000 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : ntdll!RtlUserThreadStart+0x34

Info:

PROCESS_NAME:  DTExec.exe

ERROR_CODE: (NTSTATUS) 0xc0000005 - The instruction at 0x%p referenced memory at 0x%p. The memory could not be %s.

EXCEPTION_CODE: (NTSTATUS) 0xc0000005 - The instruction at 0x%p referenced memory at 0x%p. The memory could not be %s.

SQL Server version is 11.0.6020.


I should note that it seems to only crash on a particular file although it's the same format as all other files it ingested successfully (csv).

Attunity 1.2 Data Connector for Oracle Error (Failed to load OCI method)

$
0
0

System Configuration: 32 bit Windows 7 machine

Server: SQL Server 2008 R2

Background: I am trying to use the Attunity data connector with SQL Server 2008 R2 to import data from Oracle to SQL database.  Using the out of the box MS SQL Server 2008 R2 Oracle oledb data connector doesn't work for our situation as it doesn't import correctly unicode characters.  This is why we had to move to a new data connector.  Using the Oracle provided connector we were able to get the package to work, but the MS Engineer recommended the Attunity Data Connector because it has better performance.

Working solution, but not desired: Oracle 11g data connector.  (This has me to believe the Oracle_Home is setup correctly).

Error:

Attunity Error

Possible solution: http://forums.attunity.com/forums/microsoft-ssis-oracle-connector/error-failed-load-oci-dll-1308.html

I found the above link from the Attunity forum, but was unsure what to do for my situation as mine is 32 bit and the link primarily relates to 64 bit.  As I mentioned above I believe the Oracle_Home directory is setup correctly as I am able to connect and run an SSIS package with the same configuration using a different provider.  Also because of this fact of being able to run it with a different provider, I would assume permissions are configured correctly.  I believe it to be a configuration issue with possibly the registry, but I'm not sure where to look.

Failed solutions: Uninstalling and reinstalled Attunity 1.2 connector.

Thanks for you help in advance,

Paul

can VS 2008 and SQL 2008 R2 Std products coexist with VS 2013 and SQL 2014 Enterprise products

$
0
0

Hi. I have to support two different ssis environs.  The legacy stuff typically matches up VS 2008 (I think aka bids) and sql 2008 r2 std.  The newer stuff typically matches up VS 2013 and sql 2014 enterprise.   Right now I'm doing it from two different pc's and I believe my "bitness" on both is 64.

My experience has been that bids (VS 2008) cant open an ssis pkg created in VS2013.  I suspect the opposite is possible with ssis offering some sort of translation if you agree.

My goal is to install vs2013 (and sql 2014 if it matters) side by side on the machine that already has bids 2008 and sql 2008 std r2 installed.   Should it work?  R there any gotchyas?   By any chance does the community know of a way to get bids (VS 2008) to open and run a pkg created in VS 2013?  

SSIS Error after package execution

$
0
0

This package is scheduled to run daily - reads files from network drive and copies the data to sharepoint list, renames and moves file to different folder. After the package execution is see this error in data source.

Error at Data Flow Task [Excel Source [1]]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E37.
Error at Data Flow Task [Excel Source [1]]: Opening a rowset for "Data$" failed. Check that the object exists in the database.




Loop through Excel workbooks and sheets.

$
0
0

Hi

I've been working through the following link http://stackoverflow.com/questions/7411741/how-to-loop-through-excel-files-and-load-them-into-a-database-using-ssis-package so I can loop through excel workbooks and sheets.

My excel data that I want to use for all workbooks actually begins on row 6 so I changed the sheetname Variable to this

Hourly_Call_ALL_01_Apr_2016$A6:j

Now there is actually some text in the cells in A1 etc so when I run the package I get errors stating the External columns for the Excel source are out of syncrhonization.

When I manually delete the text from A1 etc so I am just left with the data from A6 onwards the package runs fine.

How can I get around this issue.

Regards

Execute remote process on the remote server itself

$
0
0

Hello,

Is there a way to execute a process on the remote server itself?

Here is the scenario that I'm trying to implement:

1. An input file is put on the remote server B from server A.

2. python script is invoked on the remote server B and is executed on the remote server which generates output file on remote server B

3. The output file is then copied from the remote server B to the server A

I want all of this to be orchestrated using SSIS on server A. I know how 1,3 can be done. Is it possible to do #2 specifically invoking a python script on the remote using the python.exe on the remote server (so that all load is on the remote server).

Can you please share some ideas and possibly some sample links on how this can be accomplished?

Thanks for your help!

Interop issues only seen when running through SQL Agent

$
0
0

I have a SSIS package that generated a 9 MB workbook, then runs a script task that deletes a single row.  When running in BIDS it works no matter how big the file is.  When I run it in SQL Agent with a small sample set of the data it works.  When I run the full report through SQL Agent, I get the message "Document not Saved"

I have tried changing the save to a save s, and still get the same error. 

Appears that the script cant save a large file, but works fins with the smaller file.

Win 2008 R2

SQL 2012

Interop - Microsoft Excel 15.0 Object Library

C# script

all of a sudden dts run time variables cant be indexed in script tasks

$
0
0

Hi. I have 2014 enterprise and 2008 r2 std installed side by side on a desktop. I was under the impression that is a safe thing to do.

All of a sudden, after working with both for months, and executing script tasks often under each, I get an error in new and existing pkgs complaining about dts runtime indexing issues in the scripts.

Why is this?  What can I do about it?  Can I export a failing one to my catalog when the binary for such scripts wont build locally?   And get it to run there on the server anyway?

The only thing I've done a bit out of the ordinary recently with this pc was to vpn into our parent company's domain and run (run as) ssms using the creds I use there.


failed validation with status VS_ISBROKEN

$
0
0

After completing development of a project, I ran is successfully on my development machine to test everything, before deploying it to our test environment. I then deployed the project, installed my customized assembly, and ran the package on the test server. One data flow task returns the "failed validation and returned validation status of VS_ISBROKEN."  When I run the all executions report and view the context details for the failure, there really isn't anything useful listed to help narrow down the troubleshooting.

So, I copied the solution to the test server and opened it up with VS, and below is a screenshot of the task executing.  As you can see, there was an OLEDB error, but the task executed and completed successfully.

I'm not certain, if the initial OLEDB error is causing the validation failure, and if it is, how do I resolve it because the task on its own completes successfully, when I execute it in VS.  I'm a little confused.

Any insight would be greatly appreciated.

Thanks,

Chris


Staging table vs temp table

$
0
0

Hi All,

I am looking for a best approach to adopt while developing SSIS packages.

Should we load data into final table using temp table instead of actual staging table?

If we use actual staging table, should we use one staging table or twice?

If any one has a good blog, please share with me.

"SSIS Server Maintenance job" missing

$
0
0

I am using SQL Server 2012 SP2. I have enabled SSIS catalog and deploy some SSIS packages.

I noticed that SSISDB is not purging \ cleaning old records as per retention period.

I found that SSIS Server Maintenance job is missing from server.

Can anybody help why job got missed?


Regards,
Rohit Garg
(My Blog)
This posting is provided with no warranties and confers no rights.
Please remember to click Mark as Answer and Vote as Helpful on posts that help you. This can be beneficial to other community members reading the thread.


Switching to Dynamic Excel Manager Fails

$
0
0

I have a peculiar problem with Excel files and FOREACHLOOPs that is driving me insane!

The following portion is a small part of my ETL package I am designing for my own personal project. Most of the data is in CSV as it, but the following are unstructured and work best through Excel to my knowledge. I'll bullet point observations that may be helpful in diagnosing this 12-hour problem of mine, and I really appreciate any help I can get.

- I am querying the files through SQL  since I have been having horrible problems with XLSX files being self-referential in the validations.

- Only the default settings are in place; DelayValidation set to True on the FOREACHLOOP and Connection Manager; Collections uses a 'Name' Property (for the derived column) and two variables in the script that do not replace any default properties.

- For the dynamic connection string, I used a local variable on property ExcelFilePath. This works for CSV just fine, and in fact everything was perfectly normal even after switching to a dynamic connection string. It is only when I put the Data Flowsin the FOREACHLOOP that the issues occur.

ERRORS FROM CLIENT THAT CONTINUE TO PERSIST:

1)  "SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Tr_Ex_Owners" failed with error code 0xC0202009"

2) [SSIS.Pipeline] Error: Executives failed validation and returned error code 0xC020801C.

3) [Connection manager "Tr_Ex_Owners"] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft JET Database Engine"  Hresult: 0x80004005  Description: "Could not use ''; file already in use.".

- Note this last error throws me for a loop since this whole problem started on a fresh reboot. What would cause the connection file to be in use still? Or should I not be using JET for this type of connection?

 


Inner FOREACHLOOP

- Note these errors are when I first set the Excel files to a dynamic string. Although the client throws me DTS_E_OLEDBERROR; Error Code 0x80040E4D, this is not fatal nor actually triggers a warning when the package is run. Why is that? Are they related?

Outer_FOREACHLOOP

unable to update records

$
0
0

Hi i am trying to update records and make sure that they are captured in update part i.e oldedb command 

code:

create table company_source ( ID int, total_sales money, sales_desc varchar(1000),created_date datetime ,updated_date datetime) insert into company_source values(1,200,'This is for company A',GETDATE(),getdate()) insert into company_source values(2,400,'This is for company B',GETDATE(),getdate()) insert into company_source values(3,600,'This is for company C',GETDATE(),getdate()) insert into company_source values(4,800,'This is for company D',GETDATE(),getdate()) create table company_dest ( ID int, total_sales money, sales_desc varchar(1000),created_date datetime ,updated_date datetime) /* lookup parameters*/ create table lkp_parameters ( Parameter_name varchar(100), Parameter_value datetime ) INSERT INTO lkp_parameters VALUES('Company_source_load',getdate()-1) select parameter_value from lkp_parameters where Parameter_name='Company_source_load'; update lkp_parameters set Parameter_value=GETDATE() where Parameter_name='Company_source_load';

UPDATE company_dest SET total_sales=?, sales_desc=?, created_date=?, updated_date=? WHERE ID=?

source

I couldnot attach the .dtsx file here, i updated the source 3rd line as 751 but in destination it is not updated , how to debug this one ?


m123

Oracle OLEDB Provider not saving password: package fails

$
0
0

Hi All,

I am running a package which gets data from Oracle source to SQL destination. The problem is each time the connection manager is asking for password even though i tried all setting in the data link of the provider (made security info persist true and allow save password) but whenever connection manager is closed and open again it will again ask for password.

I tried with storing the password in config file and sql tables but no luck.Also the package security level I changed from EncryptsensitivewithuserKey to Encyrptsensitivewith password.

ours is a 64 bit installation and I need to schedule the package on SQL Agent.

My problem is very much similar to this post which i found:

http://www.bigresource.com/Tracker/Track-ms_sql-c50sjIVM/

Please help to proceed further.Thanks in Advance.

Vinay

How to send a hard link to file path in an email using ssis?

$
0
0

I have ssis package which generates error in a network file location . \\network\ddrive\error20160529 11201.text

I want to send the actual hard link -\\network\ddrive\error20160529 11201.textalong with the email but not the file

In send mail task there is only attachment feature which points to file but how to send a hard link to file  path in an email using ssis?




Microsoft.SqlServer.Dts.Runtime.Application.LoadPackage does not execute package from remote server

$
0
0

Hello,

I'm try to execute the SSIS package using the following code in the script task(C#)

      Package myPackage;

  Microsoft.SqlServer.Dts.Runtime.Application integrationServices = new Microsoft.SqlServer.Dts.Runtime.Application();

myPackage = integrationServices.LoadPackage("\\\\servername\\D$\\folder\\packagename.dtsx",null);

int retcode = (Int32)myPackage.Execute()

this code returns retcode =1 when loading the remote package but succeeds when the package path is on the same server as the SSIS package on the script task. Does any one know if the LoadPackage can load a remote package.

Basically I want to run the SSIS package stored on the file system of a server remotely and not on the server where it is triggered to run.

Thanks!

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>