Queries in SSIS packages executing late

April 16, 2015, 11:14 pm

≫ Next: Error: The Task has failed to load on Execute Package Task using TFS Build and MSBuild.exe on dedicated Build Machine.

≪ Previous: BIDS 2008: Error HRESULT E_FAIL has been returned from a call to a COM component.

Hi,

We have ETL achitecture like ODS, STAGE and DWH in this we have around 250 ssis packages, for the couple of months we are facing an issue , some of the select queries and update queries are running slow, For each select statement or update statement i can see running , runnable and suspended threads in activity monitor while running . Actually these queries normally run in seconds of time , day by day they are increasing time .

If any one faced this type of issue , please let me know solution for this looking forward for a resolution.

Thanks in Advance.

↧

Error: The Task has failed to load on Execute Package Task using TFS Build and MSBuild.exe on dedicated Build Machine.

April 17, 2015, 11:39 am

≫ Next: Corrupted package file?

≪ Previous: Queries in SSIS packages executing late

I'm trying to automate my building and deployment of SSIS packages using TFS build definitionss in conjunction with MSBuild.exe on a separate build machine.

I have successfully built and deployed my projects but receive the following error:

Error: Failed to load task "etl_UWP_Stage_tstg_7_Large",type "". The contact information for this task is "Microsoft Corporation: Microsoft SQL Server .... "

This error happens at runtime as well as if I perform a "Validate..." on the SSIS Catalog on the server.

This only occurs when trying to execute a package that contains an Execute Package Task. Any other packages that are doing the actual work are working just fine.

In addition, when I do the MSBuild from my developer machine with the same deployment process everything works fine, even the Execute Package Task.

I can even open up the project on the build machine in VS2012, rebuild all, then deploy and everything works fine.

Some things I've considered/verified:

1) Visual Studio 2012 and Visual Studio Data Tools 2012 are both on the build machine and my local machine.

2) The .NET version being used by VS2012 is the same on the build machine and my local machine.

3) I find it suspicious that the "Type" referenced in the error above is blank...but not sure where to go with that.

4) Obvious difference is that during the TFS Build and Deploy on the build machine, everything is running under the TFS Service account, rather than my account...once again...not sure where to go with this, but it is a significant difference.

Has anyone had similar issues or have any thoughts on things to try?

Thanks,
Jason

↧

Corrupted package file?

April 17, 2015, 6:05 am

≫ Next: how to find package replace date time

≪ Previous: Error: The Task has failed to load on Execute Package Task using TFS Build and MSBuild.exe on dedicated Build Machine.

Hi, just opening this package (and a few others) I get this screen...has anyone else met this problem?

screenshot

Cheers,

Colin

↧

how to find package replace date time

April 17, 2015, 1:06 pm

≫ Next: Multiple Expressions in Precedence Constraints

≪ Previous: Corrupted package file?

hi, We frequently send changed ssis packages to our DBA's to replace the one's in the msdb folders. They then do the import/replace using sql studio. We use sql server 2008. Sometimes they forget or miss a package and we need some way to check/validate. When we do a right click generate report on the package the package creation date is always the same. What is the best way to find out if a package was replaced and when ? Is there any sys tables we can query for this info. Thank you

↧

Multiple Expressions in Precedence Constraints

June 20, 2007, 8:22 am

≫ Next: Converting String to datetime in ssis

≪ Previous: how to find package replace date time

Is it possible in a precedence constraint to have multiple expressions evaluated? IE

Operation set to Expression and expression to evaluate is: @File = x or @File = y

Thanks

↧

Converting String to datetime in ssis

April 17, 2015, 1:36 pm

≫ Next: MS ssis service: registry setting specifying configuration file does not exist. attempting to load default configuration file. SQLIService100 - event id 274

≪ Previous: Multiple Expressions in Precedence Constraints

Source column is char in the format mmddyyyy and the destination is datetime, how to achieve I used derived column and used the below

(DT_DBDATE)(SUBSTRING(end_dt,1,2) + "-" + SUBSTRING(end_dt,3,2) + "-" + SUBSTRING(end_dt,5,4))

But I get the following error

[OLE DB Destination [22]] Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.

An OLE DB record is available. Source: "Microsoft

SQLServerNativeClient 11.0" Hresult: 0x80004005 Description:

"Invalid

charactervalueforcastspecification".

An OLE DB record is available. Source: "Microsoft

SQLServerNativeClient 11.0" Hresult: 0x80004005 Description: "Invalid charactervalueforcastspecification".

An OLE DB record is available. Source: "Microsoft

SQLServerNativeClient 11.0" Hresult: 0x80004005 Description: "Invalid charactervalueforcastspecification".

sree

↧

MS ssis service: registry setting specifying configuration file does not exist. attempting to load default configuration file. SQLIService100 - event id 274

April 17, 2015, 3:15 pm

≫ Next: SSIS 2008 – Read roughly 50 CSV files from a folder, create SQL table from them dynamically, and dump data.

≪ Previous: Converting String to datetime in ssis

window 2008 R2 server ---- after installing SQL 2008 R2 then applying sp2 / sp3 I noted a warning -

Note this server had SQL 2008 R2 uninstalled previously.

MS ssis service: registry setting specifying configuration file does not exist. attempting to load default configuration file.

SQLIService100 - source

event id- 274

user - N/A

Task category - service control.

Do we need to fix something and how do we fix this warning event?

dsk

↧

SSIS 2008 – Read roughly 50 CSV files from a folder, create SQL table from them dynamically, and dump data.

April 18, 2015, 6:17 am

≫ Next: Appending _x003C_none_x003E_ string to data, SSIS project is copied to a different env

≪ Previous: MS ssis service: registry setting specifying configuration file does not exist. attempting to load default configuration file. SQLIService100 - event id 274

Hello everyone,

I’ve been assigned one requirement wherein I would like to read around 50 CSV files from a specified folder.
In step 1 I would like to create schema for this files, meaning take the CSV file one by one and create SQL table for it, if it does not exist at destination.
In step 2 I would like to append the data of these 50 CSV files into respective table.
In step 3 I would like to purge data older than a given date.

Please note, the data in these CSV files would be very bulky, I would like to know the best way to insert bulky data into SQL table.
Also, in some of the CSV files, there will be 4 rows at the top of the file which have the header details/header rows.

According to my knowledge I would be asked to implement this on SSIS 2008 but I’m not 100% sure for it.
So, please feel free to provide multiple approaches if we can achieve these requirements elegantly in newer versions like SSIS 2012.

Any help would be much appreciated.

Thanks,
Ankit

Thanks, <b>Ankit Shah</b> <hr> Inkey Solutions, India. <hr> Microsoft Certified Business Management Solutions Professionals <hr> http://ankit.inkeysolutions.com

↧

Appending _x003C_none_x003E_ string to data, SSIS project is copied to a different env

April 15, 2015, 10:54 pm

≫ Next: Attention All SSIS Gurus! Time to SPRING Into Action!

≪ Previous: SSIS 2008 – Read roughly 50 CSV files from a folder, create SQL table from them dynamically, and dump data.

Hi,

I'm exporting data from MS SQL Server 2008 into a bar delimited flat file using SSIS package. In the connection properties I set text qualifier as none. in Dev machine data is populating into flat file as per expectation.

When I copied the project to another environment, the text qualifier became _x003C_none_x003E_ is appending to data.

Expected Output from SSIS: D|GOOD|Morning

After Execution of package data looks:

_x003C_none_x003E_D_x003C_none_x003E_|_x003C_none_x003E_GOOD_x003C_none_x003E_|_x003C_none_x003E_MORNING_x003C_none_x003E_

Can some one help on this.

Thanks,

Praveen C

Regards, Praveen

↧

Attention All SSIS Gurus! Time to SPRING Into Action!

April 7, 2015, 1:23 pm

≫ Next: NameSpace for XML But in SSIS Script Task

≪ Previous: Appending _x003C_none_x003E_ string to data, SSIS project is copied to a different env

April fools out of the way, now let's find an April genius!

The name "April" is derived from the Latin verb "aperire", meaning "to open", as it is the season when trees, flowers AND MINDS start to open! And.. I can't wait to OPEN and read this month's community contributions! (groan, tenuous link!)

Things are indeed heating up around TechNet. The Wiki has become a shining example of what the community has to offer, and talent is SPRINGING FORTH from all corners of our garden of knowledge.

If you can find the time to enrich us with your latest revelations, or some fascinating facts, then not only will you build up a profile and name for yourself within the gaze of Microsoft's very own glitterati, but you will be adding pages to the most respected source for Microsoft knowledge base articles. This could not only boost your career, but would benefit generations to come!

So don't be an April fool. Please realise the potential of this platform, realise where we are going, and join us in growing this community, learning more about you, and opening the minds of others!

All you have to do is add an article to TechNet Wiki from your own specialist field. Something that fits into one of the categories listed on the submissions page. Copy in your own blog posts, a forum solution, a white paper, or just something you had to solve for your own day's work today.

Drop us some nifty knowledge, or superb snippets, and become MICROSOFT TECHNOLOGY GURU OF THE MONTH!

This is an official Microsoft TechNet recognition, where people such as yourselves can truly get noticed!

HOW TO WIN

1) Please copy over your Microsoft technical solutions and revelations toTechNet Wiki.

2) Add a link to it on THIS WIKI COMPETITION PAGE (so we know you've contributed)

3) Every month, we will highlight your contributions, and select a "Guru of the Month" in each technology.

If you win, we will sing your praises in blogs and forums, similar to the weekly contributor awards. Once "on our radar" and making your mark, you will probably be interviewed for your greatness, and maybe eventually even invited into other inner TechNet/MSDN circles!

Winning this award in your favoured technology will help us learn the active members in each community.

Feel free to ask any questions below.

More about TechNet Guru Awards

Thanks in advance!
Pete Laker

#PEJL
Got any nice code? If you invest time in coding an elegant, novel or impressive answer on MSDN forums, why not copy it over toTechNet Wiki, for future generations to benefit from! You'll never get archived again, and you could win weekly awards!

Have you got what it takes o become this month's TechNet Technical Guru? Join a long list of well known community big hitters, show your knowledge and prowess in your favoured technologies!

↧

NameSpace for XML But in SSIS Script Task

April 7, 2015, 9:32 am

≫ Next: reading multiple excel sheet with different table schema

≪ Previous: Attention All SSIS Gurus! Time to SPRING Into Action!

Hello,

I am creating an xml Document that pulls information from a staging table in sql. However the issue I am having is that i need a namespace or a start element to handle a ':' but i keep getting its not a hexadecimal blah blah.

I feel like I have tried everything for this.

So maybe someone can help me

writer.WriteStartDocument()

writer.WriteComment("edited with XMLSpy v2010 rel. 3 (http://www.altova.com) by MESMERiZE (MSM)")

writer.WriteComment("Samply XML file generated by XMLSpy v2010 rel. 3 (http://www.altova.com)")

So i have the comments show up fine but then i need it to show

<mssext:sendWarrantyContractBatch xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:mssext="http://jlrint.com/mss/message/sendwarrantycontract/1" xsi:schemaLocation="http://jlrint.com/mss/message/sendwarrantycontract/1 FRS_000143-SendWarrantyContractMessages.xsd">

I can get the websites and all the xmlns to show up fine that is not the issue the issue is the mssext:sendWarrantyContractBatch

IS there any way to get the Colon to show up ??

Remember this is in a ssis script task with visual basic 2008 code

↧

reading multiple excel sheet with different table schema

April 15, 2015, 3:55 pm

≫ Next: export xml column in ssis

≪ Previous: NameSpace for XML But in SSIS Script Task

Hi how to read multiple excel sheets in same excel file with different table schema.

Basically need to load data into tables from these excel sheet.

So I know how to dynamically read multiple excel sheets in same excel file with same table schema and load into one table.

But how to do this dynamically for multiple excel sheet with different table schema and load into different tables?

↧

export xml column in ssis

April 19, 2015, 5:36 am

≫ Next: SSIS Script task to read overridden config file

≪ Previous: reading multiple excel sheet with different table schema

we have a table with xml column. This column has a large xml data . I am trying to use ssis to import xml from sql column (table a) to destination (another table).

steps which i did in ssis:

1. execute sql task:

fetch the xml column by query and store "full result set" into an object variable.

2. foreach loop:

select Ado enumerator option and select variable which has reset set of execute sql task.

In variable mapping selected a new variable of type string.

when I run package I get below error:

"Error: ForEach Variable Mapping number 1 to variable "User::variable" cannot be applied".

Does anyone has any idea and solution for this ?

↧

SSIS Script task to read overridden config file

April 19, 2015, 2:18 pm

≫ Next: Load data from sharepoint list to database

≪ Previous: export xml column in ssis

I have a SSIS job which send a config file path as a commandline to the SSIS package. I want to read the command line for config file path sent in the SSIS Scripting task. I am using VS 2008. Thanks in Advance.

↧

Load data from sharepoint list to database

April 14, 2015, 11:25 pm

≫ Next: Failed to retrieve SSIS package

≪ Previous: SSIS Script task to read overridden config file

hi All,

I am trying to load data from sharepoint to Database.

when i try to execute the package, am getting below error.

[SHAREPOINT_SRC_SLTS_FIELDS [286]] Error: Microsoft.Samples.SqlServer.SSIS.SharePointUtility.SharePointUnhandledException: Unspecified SharePoint Error. A possible reason might be you are trying to retrieve too many items at a time (Batch size) ---> System.ServiceModel.FaultException: Exception of type 'Microsoft.SharePoint.SoapServer.SoapServerException' was thrown.

can you please guide me to resolve this issue.

Thanks & Regards,

Raghavendra

↧

Failed to retrieve SSIS package

April 19, 2015, 8:57 pm

≫ Next: Create Fiat File Using Trigger in SQL Server

≪ Previous: Load data from sharepoint list to database

Hi , When I would like to browse the package in MSDB, it failed.

And also can't import Package

↧

Create Fiat File Using Trigger in SQL Server

April 19, 2015, 9:46 pm

≫ Next: COPIING DEPLOYMENT FOLDER

≪ Previous: Failed to retrieve SSIS package

Dear All,

How to Create a Flat File using Trigger in SQL Server?

↧

COPIING DEPLOYMENT FOLDER

April 14, 2015, 12:20 am

≫ Next: SSIS OLEDB data source : query vs stored procedure for flat file generation

≪ Previous: Create Fiat File Using Trigger in SQL Server

Hello,

having on mind that this is my Target server:

what is the way of creating shared folder in order to perform operation from the title (and, of course, to continue with installation of packages etc...)? SQL SERVER 2008 R2

thanks

↧

SSIS OLEDB data source : query vs stored procedure for flat file generation

April 20, 2015, 8:31 am

≫ Next: The package failed to load due to error 0xC0011008

≪ Previous: COPIING DEPLOYMENT FOLDER

I am working to archive some old data from a data warehouse using SQL server and SSIS. The data will be read and denormalized, then shipped out to a delimited text file.

The rowcount of the incoming data is significant, call it 10M+ rows per unit of work (one text file).

There are development advantages of using a stored proc for the data source - mainly ease of changing the denormalization logic as required. Wondering if there are performance advantages of an embeded query for the data source instead?

It was mentioned by one developer that when using a stored procedure, the output stream from the proc and subsequent SSIS steps cannot start until the full procedure processing is complete; i.e. the proc churns out its' result set in one big chunk. He hinted that an embedded query does not have this same effect, but I am not sure that is accurate. Can anyone offer guidance in this area?

Cheers

↧

The package failed to load due to error 0xC0011008

April 15, 2015, 7:55 am

≫ Next: logging to file system when pkg is run from catalog

≪ Previous: SSIS OLEDB data source : query vs stored procedure for flat file generation

I am trying to run a SSIS Package from SQL Server BI Studio. I receive the error "The package failed to load due to error 0xC0011008". SQL Server 2008 R2 installed (32bit Win 7), along with Integration Services. The Package connects to a SQL Server DB.

Here is the full error taken from consol in BI Studio:
SSIS package "CreateDynSSIS_DB_RunDynSSiSDB.dtsx" starting.
Error: 0x1 at ST_Gen_Pkg_Src_SqlServ: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> Microsoft.SqlServer.Dts.Runtime.DtsRuntimeException: The package failed to load due to error 0xC0011008"Error loading from XML. No further detailed error information can be specified for this problem because no Events object was passed where detailed error information can be stored.". This occurs when CPackage::LoadFromXML fails.
---> System.Runtime.InteropServices.COMException (0xC0011008): The package failed to load due to error 0xC0011008 "Error loading from XML. No further detailed error information can be specified for this problem because no Events object was passed where detailed error information can be stored.". This occurs when CPackage::LoadFromXML fails.
   at Microsoft.SqlServer.Dts.Runtime.Wrapper.ApplicationClass.LoadPackage(String FileName, Boolean loadNeutral, IDTSEvents100 pEvents)
   at Microsoft.SqlServer.Dts.Runtime.Application.LoadPackage(String fileName, IDTSEvents events, Boolean loadNeutral)
   --- End of inner exception stack trace ---
   at ST_0f39f89613ca43e9a6660953aa72fa2c.csproj.ScriptMain.Main()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle._InvokeMethodFast(Object target, Object[] arguments, SignatureStruct& sig,       MethodAttributes methodAttributes, RuntimeTypeHandle typeOwner)
   at System.RuntimeMethodHandle.InvokeMethodFast(Object target, Object[] arguments, Signature sig, MethodAttributes methodAttributes, RuntimeTypeHandle typeOwner)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture, Boolean skipVisibilityChecks)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at System.RuntimeType.InvokeMember(String name, BindingFlags bindingFlags, Binder binder, Object target, Object[] providedArgs, ParameterModifier[] modifiers, CultureInfo culture, String[] namedParams)
   at System.Type.InvokeMember(String name, BindingFlags invokeAttr, Binder binder, Object target, Object[] args, CultureInfo culture)
   at Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTATaskScriptingEngine.ExecuteScript()
Task failed: ST_Gen_Pkg_Src_SqlServ
Warning: 0x80019002 at CreateDynSSIS_DB_RunDynSSiSDB: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED. The Execution method succeeded, but the number of errors raised (1) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
SSIS package "CreateDynSSIS_DB_RunDynSSiSDB.dtsx" finished: Failure.