Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

2008 SSIS Designer stops working after installing VS11 Dev Preview

$
0
0

Immediately after installing the Visual Studio 11 Developer Preview, I was no longer able to open a SSIS package in VS 2008. I uninstalled it and all the .NET 4.5 associated packages, reinstalled both VS 2008 and SQL 2008, but still it refuses to work. 

This is the specific error I get when attempting to open one. 

 

===================================

An error prevented the view from loading. (Microsoft Visual Studio)

===================================

The specified module could not be found. (Exception from HRESULT: 0x8007007E) (System.Windows.Forms)

------------------------------

Program Location:

   at System.Windows.Forms.UnsafeNativeMethods.CoCreateInstance(Guid& clsid, Object punkOuter, Int32 context, Guid& iid)

   at System.Windows.Forms.AxHost.CreateWithoutLicense(Guid clsid)

   at System.Windows.Forms.AxHost.CreateWithLicense(String license, Guid clsid)

   at System.Windows.Forms.AxHost.CreateInstanceCore(Guid clsid)

   at System.Windows.Forms.AxHost.CreateInstance()

   at System.Windows.Forms.AxHost.GetOcxCreate()

   at System.Windows.Forms.AxHost.TransitionUpTo(Int32 state)

   at System.Windows.Forms.AxHost.CreateHandle()

   at System.Windows.Forms.Control.CreateControl(Boolean fIgnoreVisible)

   at System.Windows.Forms.Control.CreateControl()

   at Microsoft.DataWarehouse.Design.ComponentDiagram.CreateDdsView(Control parentControl)

   at Microsoft.DataTransformationServices.Design.DtsComponentDiagram.CreateDdsView(Control parentControl)

   at Microsoft.DataWarehouse.Controls.DdsDiagramHostControl.set_ComponentDiagram(ComponentDiagram value)

   at Microsoft.DataTransformationServices.Design.ControlFlowControl.set_ComponentDiagram(ComponentDiagram value)

   at Microsoft.DataTransformationServices.Design.DtsPackageView.CreateControlFlowEditor(VsStyleToolBar pageViewToolBar)

   at Microsoft.DataWarehouse.Design.EditorWindow.EnsureViewIsLoaded(EditorView view)

 


ETL Master SQL job got a “Login Time Out “ error again

$
0
0

Below error coming randomly Sometimes it works perfectly fine and sometimes it goes down with following error message. The connectivity between two servers are seamless there is not a single drop of packet.

Please suggest what is wrong happening here. One server is on Windows 2003 x64 and another is on Windows 2008 R 2.

Executed as user: xyz\user1. Microsoft (R) SQL Server Execute Package Utility  Version 11.0.3393.0 for 64-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  12:00:07 AM  Error: 2013-12-27 01:01:57.58     Code: 0xC0202009     Source:DailySync_I Connection manager "OLE_SRC2_"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description:"Login timeout expired".  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "Unable to complete login process due to delay in login response".  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "TCP Provider: Timeout error [258]. ".  End Error  Error: 2013-12-27 01:01:58.58     Code: 0xC020801C     Source: Load Lookup Tables OLE DB Source [699]     Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "OLE_SRC2_" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.  End Error  Error: 2013-12-27 01:01:59.67     Code: 0xC0047017     Source: Load Lookup Tables SSIS.Pipeline     Description: OLE DB Source failed validation and returned error code 0xC020801C.  End Error  Error: 2013-12-27 01:02:00.81     Code: 0xC004700C     Source: Load Lookup Tables SSIS.Pipeline     Description: One or more component failed validation.  End Error  Error: 2013-12-27 01:02:01.95     Code: 0xC0024107     Source: Load Lookup Tables      Description: There were errors during task validation.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  12:00:07 AM  Finished: 1:20:13 AM  Elapsed:  4805.61 seconds.  The package execution failed.

SSIS - Migration of attachments from one project to another project in Quality

$
0
0
You cannot vote on your own post
0

Hi All,

I would require some technical help on SSIS, which
requires migration of attachments from one project to another project in Quality
center.

I have tried various possible ways of migrating the
attachments. But only the icon appears with no file present.  This is stored as
a system file hence requires migration of the files as well. Therefore I would
like to know if there is any way to solve this issue.

Please refer site as well for reference .

Thanks in advance .

Thanks & Regards,

Anand Gavle.

Merging and editing rows in SSIS

$
0
0

Hello guys,

Maybe the questions have already be answered but I'm not sure. 

This is my problem: I'm retrieving data from two different databases and I have to mix them into a single one. In the process I have to make sure that the data are cleaned (using the cleansing component in SSIS) and not duplicated (I use a dqs matching component found on code plex). The raw data (retrieved from databases) will be updated (new clients added, existing clients updated) on a regular schedule (maybe every hour). 

My questions are:

- What is the best practice to update clients informations ? For example, In my raw base I will have :

Id [...] phone_number  Adress

1           123                   ABC

1           134                   ABC

Result

Id [...] phone_number  Adress

1           134                   ABC

I know that there is the sort component but we can't choose the row we want to keep. Maybe I can create a new Database (before the raw one) to store temporally the incoming data and add a component checking for columns (here ID) and if the ID is already in my raw database it removes the old row to put the new one.

- Same question but this time I have to update a column. For example:

Client Table

Id  Name  First_name ...

1   AB       AB

2   AB       AB

Orders Table

Id  Id_Client  Product ...

1   1               A

2   2               A

In that case, the two clients will be considered as equal by the dqs matching component, thus, one of the client will be removed because they are duplicates. So what is the best practice to have this result : same Id_client in the order table

Client Table

Id  Name  First_name ...

1   AB       AB

Orders Table

Id  Id_Client  Product ...

1   1               A

1   1               A

I'm not asking for entire pieces of code (if you can provide it then huge thank you) but indications of how this should be done, because I'm new to sql server.

Thank you

vs 2012 using wrong version of dts.Runtime

$
0
0

I have an existing ssis package that I opened from TFS in Visual Studio 2012.  When I try to execute the package I receive and xml error and I notice that DTS.Runtime is using version 100 instead of 110.

Is there a place in Visual Studio 2012 to update the program to use sql 2012 (version 110) instead of Sql 2010 (version 100)?

thanks

scott

how to create a dynamic SSIS package for multiple flat file destinations

$
0
0

Hi,

I have to create a ssis package which has single data flow task and inside that I have 23 source (sql- select * from - statements)- destination (flat files, 23 distinct) connection.

Now for each product I have to create separate SSIS package (i.e. if prod=abc then these read select * from abc_tables and 23 abc_ txt files)

I want to do it dynamically, means only single package and inside that variables will take select * values for each source-dest connection (so i believe 23 variables) and same for destination flat files.

Let me know. :)


ANK HIT - if reply helps, please mark it as ANSWER or helpful post

Parsing domain names form URL

$
0
0

I have a need to parse domain names out of URL strings, Has anyone done this before or can point me to the right directions?

 

 

thanks,

Rok

Out Of Memory Issue When Running Multiple Packages

$
0
0

Hi All,

I'm running into memory issues while trying to execute packages from a C# application.  The packages already exist in the SSIS catalog.  Ultimately I'd like to run up to 6000+ of these.  They are quite small packages, each only containing an Execute SQL Task and Data Flow Task in the control flow, and in the Data Flow just a Source, Destination, and single Derived Column component.  When I call Package.Execute(false, null) which runs in 32 bit mode on 64 bit servers I get out of memory errors in SSMS execution reporting at around 30 packages.  When calling Package.Execute(true, null) the same thing happens but not until about 60 packages.   Here is an example of the error.  

Exception of type 'System.OutOfMemoryException' was thrown.;   at Microsoft.SqlServer.Dts.Runtime.Project.OpenProject(IProjectStorage storage, String projectPassword, IDTSEvents events)
   at Microsoft.SqlServer.Dts.Runtime.Project.OpenProject(Stream projectStream, AccessMode accessMode, String projectPassword, IDTSEvents events)
   at Microsoft.SqlServer.IntegrationServices.Server.Shared.ServerProject.LoadProject(SqlConnection connection)
   at Microsoft.SqlServer.IntegrationServices.Server.Shared.ServerProjectLoader.GetServerProject()
   at Microsoft.SqlServer.IntegrationServices.Server.ISServerExec.ProjectOperator.StartPackage()
   at Microsoft.SqlServer.IntegrationServices.Server.ISServerExec.ProjectOperator.PerformOperation()

On top of that, many packages become stuck in the 'Created Execution' stage.  I figured SSMS/SSIS would automatically take care of the load balancing aspect but I guess that's not the case, or perhaps I need to work on the settings somewhere? 

Any thoughts? 

P.S. To anybody reading this in the next 48 hours Merry Christmas/Christmas Eve! :)


Simple question - compare Strings with SSIS expression language

$
0
0

SSIS variables - strOne = YES, strTwo = YES. I want to compare strings using ssis expression language (ie inside a variable's expression box, constraint of task flow arrow etc).

Will @strOne == @strTwo be true ? I hope its not like programming languages where you need to do@strOne.Equals(@strTwo) instead of ==. Also is @strOne == "YES" true ?


Failed to create an IDataAdapter object. This provider may not be fully supported with the Execute SQL Task

$
0
0

I executed a simple query inside an execute SQL task - 

SELECT col1, col2
from thetable
where code = ?
order by id asc

Exec sql task - ADO.NET connection
parameter "code" is an int32 in SSIS and int32 in parameter mapping of exec sql task.

It works fine in SQL server, but in SSIS it causes the error - 

[Execute SQL Task] Error: Executing the query "SELECT col1, col2
from thet..." failed with the following error: "Failed to create an IDataAdapter object. This provider may not be fully supported with the Execute SQL Task. Error message 'Incorrect syntax near '?'.'.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.

How do I fix this error ? 


Generate file on data flow task

$
0
0
I have a data flow task with flat file as a destination and source is OLEDB . Everytime i run the dataflow task I want new file to be generated.

SSIS 2012 - NT AUTHORITY\ANONYMOUS LOGON failure

$
0
0

I have a SSIS package which I have deployed to the Integration Services Catalog. When I execute the package it fails on validation of the destination database with the : 

SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E4D.
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80040E4D  Description: "Login failed for user 'NT AUTHORITY\ANONYMOUS LOGON'.".

This package is attempting to connect to a database on a different server running with windows authentication.

For the Integration Services DB, where my package is deployed, the database (SSISDB) service runs under a user which has permission on the destination db on the other server. I thought that this would mean when the package is run, this user would be used for windows authentication. I'm not sure why it's trying to use: NT AUTHORITY\ANONYMOUS LOGON to connect, as this is not specified anywhere. 

Does anyone know how to fix this?

Sending mail with C# in SSIS

$
0
0
I don't want to use SSIS e-mail task to send e-mail because it is too basic and you cannot send e-mails to servers that need authentication. So I need to know what are all the possible things (passwords, port numbers, server ip addresses, protocols etc) that one needs to know to send an e-mail to any e-mail address using C# in script task. Please tell me what they are. 

As an aside, here is a video which clearly shows why SSIS send mail task is almost useless - 
http://www.youtube.com/watch?v=IlUzkMPYDSk

Better to use a single Execute SQL Task for multiple queries against a single database?

$
0
0

Hi All,

In our SQL 2008 R2 environment, we have several stored procedures that need to be executed in successession.  All of these stored procedures are in a single database on a single server.  Whether I call these stored procedures from one or multiple Execute SQL Tasks, they need to be called in such a way that one does not start until the previously-called sproc succeeded.

Should I call these in a single Execute SQL Task?  (For example, "EXEC dbo.sproc1; EXEC dbo.sproc2; EXEC dbo.sproc3".)  Or should I call each sproc from it's own Execute SQL Task?

I never gave this much thought and typically broke multiple procedure calls into multiple Execute SQL Tasks so that, in development, I could see exactly which procedure caused an error, but somebody much smarter than I recently told me that each Execute SQL Task requires it's own connection (or was it a session?) and therefore combining the calls into a single Exec SQL Task was preferable.

Could somebody provide some insight, or perhaps a link where I can go to learn about this?

Thanks,
Eric

execute process task argument is not working for sph file and ogr2ogr.exe

$
0
0

Hi All,

I am trying to load shape file into a sql spatial table. A execution process task is used to run the ogr2ogr.exe program.

This is how the process tab looks like .

Executable : C:\gdal_ogr2ogr\bin\gdal\apps\ogr2ogr.exe

Argument :  -f MSSQLSpatial   MSSQL:server=SQL-ABC-DEV;database=MYSIMPLE_Dev;Trusted_Connection=True;\\mypath\files\shares\Data\www.mypage.htm\my_sample_file.shp

Success value : 1 (I am not sure why I need to change this value from 0 to 1.

For above settings, package runs fine. However the spatial table is not created always. It is created once in a while after switching Success value from 1 to 0 and 0 to 1 again. (After the spatial table is created, it is dropped using a execute sql statement). 

I am running this in VS 2012.I saw in an article that we need to convert shp file to csv before we load it into sql server.I even tried to convert shp to csv using execute sql task and ogr2ogr.exe. Still the package runs successfully after changing Success value from 0 to 1 but no csv file is created. If the success value is 0, it throws the following error.

[Execute Process Task] Error: In Executing "C:\gdal_ogr2ogr\bin\gdal\apps\ogr2ogr.exe" " -f CSV \\xxxxxxxxr.rdn\files\shares\xxx_Data\ImportData\www.xxxxxxx.hapepage.htm\xxxxxx\Watches\Warnings\myfile\CSV \\xxxxxxxxr.rdn\files\shares\xxx_Data\ImportData\www.xxxxxxx.hapepage.htm\xxxxxx\Watches\Warnings\myfiles\www.shp" at "", The process exit code was "1" while the expected was "0".

Could long file name be a problem too?

Thanks for your help in advance..


shamen





Not able to expand msdb database after SSIS 2012 connected

$
0
0

I Have only one SSIS instance in my system and try to access msdb database after connecting integration services Getting below error message. Please help

TITLE: Microsoft SQL Server Management Studio
------------------------------

Failed to retrieve data for this request. (Microsoft.SqlServer.Management.Sdk.Sfc)

For help, click: http://go.microsoft.com/fwlink?ProdName=Microsoft%20SQL%20Server&LinkId=20476

------------------------------
ADDITIONAL INFORMATION:

The SQL Server instance specified in SSIS service configuration is not present or is not available. This might occur when there is no default instance of SQL Server on the computer. For more information, see the topic "Configuring the Integration Services Service" in SQL Server 2012 Books Online.

The .Net Framework Data Providers require Microsoft Data Access Components(MDAC).  Please install Microsoft Data Access Components(MDAC) version 2.6 or later. (MsDtsSrvr)

------------------------------

The .Net Framework Data Providers require Microsoft Data Access Components(MDAC).  Please install Microsoft Data Access Components(MDAC) version 2.6 or later. (System.Data)

------------------------------

Retrieving the COM class factory for component with CLSID {2206CDB2-19C1-11D1-89E0-00C04FD7A829} failed due to the following error: 8007045a A dynamic link library (DLL) initialisation routine failed. (Exception from HRESULT: 0x8007045A). (mscorlib)

------------------------------
BUTTONS:

OK
------------------------------


Flat file Destination VS Raw file Destination ??

$
0
0

Team ,

Can some help me understand few differences and similarities  between Flat File Destination and Raw File Destination ? Thanks in advance .


Rajkumar Yelugu

VB coding in script task

$
0
0

Hello,

My question is about VB.NET code within a Script task.

I have completed an exercise in SSIS where the aim was to extract,transform and load data from several excel files to sql tables. It was done by a Foreach container ,which stored the path to each Excel file in a variable during each iteration. A script task within the container was updating the Excel Connection Manager by using the value of the variable at each iteration. This is the code from the exercise:

dts.connection("excel connection manager").connectionstring()=_

"Provider = Microsoft.Jet.OLEDB.4.0;Data Source=" + _

Dts.variables("Variableholdingthepath").Value.ToString() + _

";Extended Properties=""Excel 8.0;HDR=YES"";"

It all worked fine but can you please help me with the meaning of the following signs at the end of lines 1,2 and 3:

" + _

what is the use of the + and _ signs? Sorry I am not a VB.NET expert and I know some basics but not sure about these signs

Thanks alot

Open File - Security Warning

$
0
0
The publisher could not be verified. Are you sure you want to run this software?
This is my first SSIS package and the first for my employer. Under DTS we run some overnight tasks that bin with a .Net console application that downloads data. Several of these run in parallel.

Looked to me that the Execute Process Task was a good fit for the requirements. When I executed the step, the program did begin to execute in that a DOS window opened. But when, I clicked the run button on the warning dialog, the task step ended.

Questions:
1.- How to tell the Execute Process Task not to open the Security Warning dialog?
2.- Have you any suggestions about my approach?

Thanks,
IanO

Microsoft employees, SSIS gurus and blog authors please read - A request to Microsoft

$
0
0

It would be great if we could have some  "beginner level" or "intermediate level" ETL scenarios in the forum or on a separate website. Newcomers could learn/test SSIS skills using these scenarios. We could have a problem statement and a system (DB servers, VMs etc) in which to practice these problems. MS could charge a REASONABLE fee for this. Perhaps people could be paid to give the problems which they had to solve in a company, without violating their NDA's ofcourse.

The benefit to learners is obvious - They can get some real-world experience and explore the power of the tool.

The benefit to Microsoft - Your tool can become more popular, improving your position in the BI space. People will post problems over here or post feature improvement suggestions as they learn the tool in greater depth. So, MS can improve its tool further.

If you actually do these things, then please make it at a reasonable price. Please don't make it like those 3-5 day SAP/<Any big corporation> courses which offer junk value for $3500.

If you see any problems with this idea, please discuss them here.

Thanks :)  




Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>