SQL 2012 Project Deployment Model best practices question

December 10, 2013, 2:35 pm

≫ Next: How to neutralize default setting that directed to Dts config file

≪ Previous: Using SQL Server 2012 SSIS to Extract Data From SAP

$

0

0

SQL 2012 dtexec automation operations logging  DTSER_SUCCESS

Hi, just a question about 'retraining" ourselves in the SQL 2012 Project deployment model.  We have a number of developers, who would in the past develop their 'packages' and when ready for deployment would send a single dtsx file to the DBA team. That team would deploy it to the MSDB repository on a qual environment typically, schedule SQL agent jobs as needed etc.

So question #1 is what steps can the developers take in the SQL 2012 model to provide the DBA's the easiest deployment method.  If the developer provides just a .dtsx file, then the DBA's have to run through the "Integration Services Project Conversion Wizard" to generate an .ispac file correct?  Then you use the (automatically linked) "Integration Services Deployment Wizard" to deploy to where the project will be located in the Integration Services catalog?

We understand that the developers can be given permissions to create a project folder and deploy the project themselves right out of Visual Studio, but we don't want to grant the user membership to the ssis_admin role and our security model is not to allow them to deploy directly to the server especially in Prod.

What are we missing?
Thanks
Matt

---

How to neutralize default setting that directed to Dts config file

December 8, 2013, 3:10 am

≫ Next: SQL 2012 Integration Services Catalog and DTEXEC

≪ Previous: SQL 2012 Project Deployment Model best practices question

$

0

0

Hi All ,

I currently have a SSIS project , that uses SSIS package configuration directed to some dtsConfig file (C:\MyLocation ), default setting,

If i copy .dtsx file to test server, and execute it's dtsx package via Batch file contains (DTExec.exe util and /CONFIGFILE flag) that direct to new dtsConfig file located on server (T:\ServerLocation) , the executed package  still looking for old DtsConfig file located on C:\MyLocation.

How do I solve this, that Top priority will be for the /CONFIG flag setting of .bat file ?

Regards , Evgeniy.

SQL 2012 Integration Services Catalog and DTEXEC

December 10, 2013, 2:58 pm

≫ Next: Package takes forever to load- keeps validating

≪ Previous: How to neutralize default setting that directed to Dts config file

$

0

0

Hi, 

We are deploying projects to the SQL 2012 Integration Services Catalog and then turning the execution of those jobs over to an operations team who use a scheduling and automation tool to execute the jobs on a schedule using DTEXEC commands.

Prior to SQL 2012, when they did execute such projects, the automation tool was able to capture results from the job execution that included results like 'DTSER_SUCCESS'.  

All we get now seems not to even include a success or failure?

• Microsoft (R) SQL Server Execute Package Utility
  Version 11.0.2100.60 for 64-bit
  Copyright (C) Microsoft Corporation. All rights reserved.
  Started:  3:15:48 PM
  Execution ID: 20536.
  To view the details for the execution, right-click on the Integration Services Catalog, and open the [All Executions] report
  Started:  3:15:48 PM
  Finished: 3:15:51 PM
  Elapsed:  2.73 seconds

I've read some on Logging Levels and What Events are Included in the SSIS Catalog Log Levels as well as "/Par "$ServerOption::LOGGING_LEVEL(Int32)";3" but all of those options still make it necessary for the operator to go either query a table like [catalog].[operation_messages] or run the All Executions report?

Is there some other way to get basic success / failure when using the DTEXEC tool?

Thanks
Matt

Package takes forever to load- keeps validating

December 11, 2013, 2:14 pm

≫ Next: Not Execute specific T-SQL code

≪ Previous: SQL 2012 Integration Services Catalog and DTEXEC

$

0

0

I'm using SSIS 2012 on a windows sever 2008 R2 OS.  I have an SSIS package that contains some 14 views for 14 separate extracts that will run one after the other. I created the views on the database and have a separate connection to each view. Problem is it is taking forever to just open the solution to work on it. I can't work offline and need to figure a way to do this. I have done this same process in SSIS 2008 R2 and it works fine, so why so slow in 2012? Server resources  are fine-  it seems specific to ssis 2012 to me.

thanks

kam

Not Execute specific T-SQL code

November 28, 2013, 6:12 am

≫ Next: DQS Cleansing Component Mismatching fields

≪ Previous: Package takes forever to load- keeps validating

$

0

0

Goal:
If the file do not exist the code for openrowset and @XML.nodes shall not be executed.

Problem:
What and how should the syntax code be if the file do not exist by using T-SQL code?

DQS Cleansing Component Mismatching fields

December 2, 2013, 10:05 am

≫ Next: Packages run faster on BIDS and slower on Agent Job

≪ Previous: Not Execute specific T-SQL code

$

0

0

Howdy,

I have been working on a SSIS/DQS project that has worked with many fields as far as the basic cleansing that DQS can do.  However, As I have added more fields, the DQS Cleansing Component seems to have an issue that I can not find any other questions/documents.  

I was cleaning a few fields appropriately, however, once I went from say 20 to 100 fields (I didnt figure out what number of domains this changed at)... the Cleansing component seems to be applying rules of unmatched domains to the incoming field. 

When I run the field through the DQS UI ... it seems to work appropriately.  However, with the SSIS transformation, even DataSets of 6 rows, come up with errors because FieldA fails a rule in DomainB.

Any ideas?

- Roger

Packages run faster on BIDS and slower on Agent Job

December 11, 2013, 3:25 pm

≫ Next: Maint Plan - Failed to acquire connection "Local server connection"

≪ Previous: DQS Cleansing Component Mismatching fields

$

0

0

Hi,
When running my packages through in BIDS, take shorter. And when I run it through Agent on the SQL Server where data actually resides, it take around 70% longer time. If I disable the task script (simple script), it run faster.

Anybody knows why this happen ? Do I need to tune up something ?

Any input in this will sincerely be appreciated.

---

Thiago Faria

Maint Plan - Failed to acquire connection "Local server connection"

February 15, 2008, 12:33 pm

≫ Next: Products to laod Exchange email into SQL database

≪ Previous: Packages run faster on BIDS and slower on Agent Job

$

0

0

I created a single step plan that does integrity checks.  It fails with the error below.  I created a new connection using our clusters virtual sql name. 

 

Executed as user: MYDOMAIN\agentaccount. ...n 9.00.3042.00 for 64-bit  Copyright (C) Microsoft Corp 1984-2005. All rights reserved.    Started:  1:10:06 PM  Error: 2008-02-15 13:10:49.02     Code: 0xC00291EC     Source: {0CF32F3D-A8D1-492A-9C0F-AD4E0FC67D14} Execute SQL Task     Description: Failed to acquire connection "Local server connection". Connection may not be configured correctly or you may not have the right permissions on this connection.  End Error  Warning: 2008-02-15 13:10:49.02     Code: 0x80019002     Source: OnPreExecute      Description: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED.  The Execution method succeeded, but the number of errors raised (1) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.  End Warning  Error: 2008-02-15 13:11:31.26     Code: 0xC0024104     Source: Check Database Integrity Ta...  The package execution fa...  The step failed.

 

The agent and db are running under domain accounts.

 

Thanks for your help.

 

 

---

Products to laod Exchange email into SQL database

December 11, 2013, 1:39 am

≫ Next: RDP Connection Issues

≪ Previous: Maint Plan - Failed to acquire connection "Local server connection"

$

0

0

Is there an easy way to load email messages (exchange 2010) into a SQL Server 2012 database?  I simply want to load the email text, so that I can analyze it and then update a few existing tables.

RDP Connection Issues

December 11, 2013, 5:08 pm

≫ Next: Failure saving package

≪ Previous: Products to laod Exchange email into SQL database

$

0

0

Setting up RDP User

New User created on Server. (just local user). 

System/Remote Settings 'Allow connections from computers running any version..."

New User Added to Remote Desktop; and is now a  Member of 'Remote Desktop Users' 

ipconfig shows the server static IP

Subnet Mask: 255.255.255.248 (provided by ATT)

and router assigned static ip

When trying to login from the Client, I enter the static ip of the server, and get; 

"RD can't connect to the remote computer for 1 of these reasons: 

1) Remote Access to the Server is Not Enabled

2) The Remote Computer is turned off

3) the Remote computer is not available on the network

Make sure turned on, connected to network, and remote access is enabled" 

remote is enabled, 

computer is on

Server can access the internet

Does anyone have any ideas on how to get this connection made? 

thanks

Spatio

Failure saving package

June 13, 2006, 5:21 am

≫ Next: Conditional Split using row counts

≪ Previous: RDP Connection Issues

$

0

0

Hello All, 

I have a package in the SQL 2000 environment that works fine. I have migrated this DTS Package to a SSIS Package using the Visual Studio 2005.

After that, i made some changes in this package and now I'm trying to save it but I am facing with this error message below:

TITLE: Microsoft Visual Studio
------------------------------

Failure saving package.

------------------------------
ADDITIONAL INFORMATION:

Invalid at the top level of the document.
 (Microsoft OLEDB Persistence Provider)

------------------------------

Invalid at the top level of the document.
 (Microsoft OLEDB Persistence Provider)

------------------------------
BUTTONS:

OK
------------------------------

Could someone please help me with this ?  

Thanks in advance.

Thiago

Conditional Split using row counts

December 11, 2013, 3:02 pm

≫ Next: Flat file – misalignment of column values on export to CSV

≪ Previous: Failure saving package

$

0

0

I would like to count the number of rows from a file I fetched and store it into a variable 'InitialRowCount' and then match that record count with another record count variable just before loading data into SQL table. The data should be loaded only if both the variables have same value.

I used a data flow and store the record count into the variable 'InitialRowCount'

I used another data flow and store the record count again in 'FinalRowCount'. Right after this rowcount, I have a conditional split, where I have a condition 'InitialRowCount==FinalRowCount' and records flow ahead only if this condition satisfies, but for some reason, none of the records are flowing ahead. What am I doing wrong here?

Flat file – misalignment of column values on export to CSV

December 11, 2013, 4:39 am

≫ Next: pass a value returned from variable to parameter ssis 2012

≪ Previous: Conditional Split using row counts

$

0

0

I am exporting data from database tables to CVS files. I have noticed that some rows are getting their values misaligned from the original columns and this skews up my data a big time as for example, a date data type value ends up in a decimal data type column in some rows. This is happening in just a handful of rows while the rest of the rows values are aligned properly. What am I supposed to do to maintain the original structure of rows and columns? I am using a simple Data Flow Task in SSIS to do this. All that it has is an OLE DB Source component and Flat File Destination component. Its SQL 2012 SSIS platform.

---

Mpumelelo

pass a value returned from variable to parameter ssis 2012

December 11, 2013, 5:55 pm

≫ Next: How to import csv file with encoding UCS-2 Little Endian in SSIS 2012?

≪ Previous: Flat file – misalignment of column values on export to CSV

$

0

0

DECLARE

@var1sql_variant=@DatabaseName

EXEC

[SSISDB].[catalog].[set_execution_parameter_value]@execution_id,@object_type=30,@parameter_name=N'DatabaseID',@parameter_value=@var1hi all, is it possible to pass the variable value to the parameter instead of the value like above instead of value, in the above case @database holds value of the database

How to import csv file with encoding UCS-2 Little Endian in SSIS 2012?

December 12, 2013, 9:06 am

≫ Next: SSIS job performance issues

≪ Previous: pass a value returned from variable to parameter ssis 2012

$

0

0

I've a file with encoding UCS-2 Little Endian and i need to import this file to SQL Server 2012 Database with SSIS 2012.

You know if exists a encoding to use to this import?

---

SSIS job performance issues

December 13, 2013, 4:11 am

≫ Next: How to pass parameters from Excel to an SSIS package?

≪ Previous: How to import csv file with encoding UCS-2 Little Endian in SSIS 2012?

$

0

0

Hi,

I have an SSIS job that runs a view and the data output from that view is populated into a table on a different database on the same server.

Until about two weeks ago this was taking less than 45 minutes to run but it now takes over 9 hours.

So far in my investigation it seems that the slow part of the process is in the populating of the data into the table on the other database. When I run the view query on it's own it completes in 57 seconds.

How do I investigate this and hopefully speed it up?

Oh, by the way I'm using SQL Server 2008 R2

Thanks

Paul

How to pass parameters from Excel to an SSIS package?

November 24, 2013, 10:29 pm

≫ Next: Compare two tables on different server without using Linked Servers

≪ Previous: SSIS job performance issues

$

0

0

How to pass parameters from Excel to an SSIS package?  The package needs 3 parameters before it can be executed. After the execution of the package, results will be populated in multiple Excel worksheets. What's the simplest approach? 

Compare two tables on different server without using Linked Servers

December 13, 2013, 7:28 am

≫ Next: Error in running package with config file

≪ Previous: How to pass parameters from Excel to an SSIS package?

$

0

0

I have an SSIS package that needs to compare a table to another table on another server.  Then only delete data from the first table if it exists in the second table.  

I know this is possible with Linked Servers but we are doing away with them in my company.  Is there a way inside of SSIS to do this?

Oh and I can't use a Data Flow since I don't know the table names or columns at run time (the whole package is dynamic) so I can't map the columns ahead of time.  

So no MERGE JOIN unless it can be used outside of a Data Flow.  

Error in running package with config file

December 13, 2013, 1:23 pm

≫ Next: Excel file load in ssis table

≪ Previous: Compare two tables on different server without using Linked Servers

$

0

0

I have a 2012 package and it is referring to a config file which has the DB connectionstring. This config file was created through the "Package Configuration Organizer". When I execute the package through VS 2012, it works fine(Reads the config from config file), but I get the below error when I run from DTEXEC. 

Command: 

C:\Program Files\Microsoft SQL Server\110\DTS\Binn>dtexec /f "C:\user\admin\Test\Pack1.dtsx /Conf "C:\user\admin\Test\P1.dtsconfig"

Microsoft (R) SQL Server Execute Package Utility
Version 11.0.2100.60 for 64-bit
Copyright (C) Microsoft Corporation. All rights reserved.
Started:  4:13:06 PM

Warning: 2013-12-13 16:13:07.19
   Code: 0xC0048000
   Source: Process File Process File (SSIS.Pipeline)

   Description: The registry key "SOFTWARE\Classes\CLSID\{7F88F654-4E20-4D14-84F4-AF9C925D3087}\DTSInfo" cannot be opened.

End Warning

Warning: 2013-12-13 16:13:07.19

   Code: 0x8004801E

   Source: Process File Process File (SSIS.Pipeline)

   Description: Cannot find the "CurrentVersion" value for component {7F88F654-4E20-4D14-84F4-AF9C925D3087}. The CurrentVersion value for the

t cannot be located. This error occurs if the component has not set its registry information to contain a CurrentVersion value in the DTSInfo

 This message occurs during component development, or when the component is used in a package, if the component is not registered properly.

End Warning

Progress: 2013-12-13 16:13:08.00

   Source: Select the latest Vendor file from mailMonitor

   Executing query "select top 1 (ea.attachment_path), ea.attachment_f...".: 100% complete

End Progress

Progress: 2013-12-13 16:13:08.03

   Source: Check if file has already been processed

   Executing query "select count(*) from myTable where FileName...".: 100% complete

End Progress

Error: 2013-12-13 16:13:08.03

   Code: 0xC000F427

   Source: Unprocessed File? (This is an Expression Task)

   Description: To run a SSIS package outside of SQL Server Data Tools you must install Unprocessed File? of Integration Services or higher.

End Error

Excel file load in ssis table

December 13, 2013, 9:04 am

≫ Next: Enabling a Windows user to Only Run One Package

≪ Previous: Error in running package with config file

$

0

0

Hello Everybody,

I have excel file with around 300 fields in it. I do want to load it in the database table using any easiest way

I am using Office 2010 and SQL SERVER 2008 R2.

Please suggest me.

Thanks