Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Import multiple tables to multiple destination tables - same database schema

$
0
0

Hi there,

I have got two databases with same schema. I would like to achieve something like this.

Step1. Transfer data from ProductTable(s) to ProductTable(d) where ProductID of ProductTable(s) = x

Step2. Transfer data from OrderTable(s) to OrderTable(d) where ProductID of OrderTable(s) = x

Can I achieve this using SSIS?


Sending mail to more addresses with SSIS 2005

$
0
0

Hi,

I need to implement a SSIS 2005 pkg to send a mail, by using the send mail task, for more addresses. I think to create a table with the username and the related mail addresses, but how can I read row by row this table to value the mail address for the send mail task?

Any suggests to me, please? Thanks

Excel formatted text into Varchar / Text column datatype

$
0
0

Hi,

I would like to know if it's possible to keep the excel formatting of cells like bold / italic while exporting it's content through SSIS.

The goal was to keep all the formating that would be read directly with SSRS reading SQL content.

Thank you

ADO.NET Connection Manager , Transaction Management in SSIS packages

$
0
0

Hi ,

I am migration data from MySQL to MS SQL server and want to Implement TRASACTION Management means if any error occurs in packages transaction will ROLLBACK.

I have used ADO.NET as a MySQL DataSource when i am enable TransactionOption : Required, It throws below Error

[ADO NET Source [1]] Error: System.NotSupportedException: MySQL Connector/Net does not currently support distributed transactions.

   at MySql.Data.MySqlClient.ExceptionInterceptor.Throw(Exception exception)
   at MySql.Data.MySqlClient.MySqlConnection.EnlistTransaction(Transaction transaction)
   at Microsoft.SqlServer.Dts.Runtime.ManagedHelper.GetManagedConnection(String assemblyQualifiedName, String connStr, Object transaction)
   at Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSConnectionManager100.AcquireConnection(Object pTransaction)
   at Microsoft.SqlServer.Dts.Pipeline.DataReaderSourceAdapter.AcquireConnections(Object transaction)
   at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostAcquireConnections(IDTSManagedComponentWrapper100 wrapper, Object transaction)

Migration Of MySQL data to MS SQL Server 2008 R2

$
0
0

Hi,

I am loading MySQL data to MSSQL  Server by using SSIS,

1. having ADO.NETODBC connection for MySQL server (ADO.NET:System.Data.Odbc.OdbcConnection)

2. OLEDB Connection for SQL Server ()

I am getting error on "ADO.NET Source" when loading souce(MYSQL) table's data having mysql datatype  "longtext" , I want to push this data into destination(MSSQL) with mapping datatype is "nvarchar(max)".

But It throw direct below error on ADO.NET source

[ADO NET Source [1]] Error: An error occurred executing the provided SQL command: "SELECT PageID,
UserData ,
ImageData,
UnitID,
DateReceived,
DateProcessed,
PageType,
FacilityID,
Processing 
FROM ORDERS WHERE ID= 7;". Arithmetic operation resulted in an overflow.
[SSIS.Pipeline] Error: "component "ADO NET Source" (1)" failed validation and returned validation status "VS_ISBROKEN".

Thanks in advance

C dll integration with C# SSIS Custom Component

$
0
0

I have created an SSIS data flow custom component which performs postal address cleansing using webservice which is integrated with a 3rd party C dll.  The web service works fine but its completely under performing.  It's taking around 20 minutes to cleanse 2.5 thousand addresses which is far to slow. Using an old GUI interface it can process around 400,000 records in 20 minutes.  So I've been asked to see if I can integrate the 3rd party C dll into the SSIS control flow component.

I've transfered the required code from the web service into the SSIS custom component but when it comes to making the first call to the 3rd party dll.  I get this error.

[QAS PAF [338]] Error: System.BadImageFormatException: An attempt was  made to load a program with an incorrect format. (Exception from  HRESULT: 0x8007000B)    at UnifyQAS.PAFTask.QABatchWV_Clean(Int32  iHandle, String stSearchAddress, Int32& iSearchHandle, String&  stReturnedPostCode, Int32 iPostCodeLength, String& stIso, String&  stReturnedCode, Int32 iCodeLength)    at  UnifyQAS.PAFTask.CleanAddress(String Address)    at  UnifyQAS.PAFTask.ProcessInput(Int32 inputID, PipelineBuffer buffer)
  at  Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostProcessInput(IDTSManagedComponentWrapper100  wrapper, Int32 inputID, IDTSBuffer100 pDTSBuffer, IntPtr  bufferWirePacket)

I did receive a similar error when I first published the Web Service but this was fixed by setting the "Enable 32 bit applications" setting to true.  The 3rd party dll is 32 bit.  I'm trying to run the SSIS custom component on a 64 bit windows 7. I'm at a total loss as to what I can try next.  I dont have access to the source code for the 3rd party dll so I can't compile it to a 64 bit application.  If anyone has any experience with this type of scenario, I would love to hear your suggestions.  Apart from banging my head off the desk I'm at a total loss.  Thanks

error information for failed SSIS job [error event id: 12291 and keyword: 0x80000000000000]

$
0
0

Please let me know what EventID 12291 and keywords 0x80000000000000 means from below event details.<o:p></o:p>

<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event"> <o:p></o:p>

<System>

<Provider Name="SQLISPackage110" /><EventID Qualifiers="16385">12291</EventID><Level>2</Level><Task>0</Task>

<Keywords>0x80000000000000</Keywords>

<TimeCreated SystemTime="2012-11-09T07:29:48.000000000Z" /> <o:p></o:p>

<EventRecordID>969873</EventRecordID>

<Channel>Application</Channel>

<Computer>xxx-xx.xx-xx.com</Computer>

<Security UserID="xxxxxxxxxxxxxxxxxxxxxxxxx" /></System>

<EventData>

<Data>LoadFTData</Data>

</EventData>

</Event><o:p></o:p>

Whereas the job throws below error message<o:p></o:p>

Executed as user: xx-xxx\xxx. Microsoft (R) SQL Server Execute Package Utility Version 11.0.2100.60 for 64-bit Copyright (C) Microsoft Corporation. All rights reserved. Started: 7:29:32 AM Error: 2012-11-09 07:29:48.32 Code: 0x00000006 Source: SCR_Process FT File Description: The script returned a failure result. End Error DTExec:The package execution returned DTSER_FAILURE (1). Started: 7:29:32 AM Finished: 7:29:48 AM Elapsed: 15.35 seconds. The package execution failed. The step failed.<o:p></o:p>

how to resolve it in Excel

$
0
0

hi ,

I have Created a package for dynamic loading of excel  file  in  2005.

in Expression  i have given "Connection String" and value is  "@[User::FileRoot]+ @[User::FileFolder]+ @[User::Filename]" and  while saving package its showing error as

Error: The result of the expression "@[User::FileRoot] + @[User::FileFolder] +  @[User::Filename]" on property "ConnectionString" cannot be written to the property. The expression was evaluated, but cannot be set on the property.
[Connection manager "Excel Connection Manager"] Error: The connection string format is not valid. It must consist of one or more components of the form X=Y, separated by semicolons. This error occurs when a connection string with zero components is set on database connection manager.

Thank  u 

Sathiya.s




Execute SSIS SQL2008R2 Package on Visual Studio 2010 Win Aplication

$
0
0

Hi 

I have create SSIS package from BIDS 2008, and its working fine when executing at BIDS studio as well on SQL Job.

But my requirement is to call the SSIS package from Win Form , so I have create simple Win Application from Visual Studio 2010 which will execute SSIS package run time using ( Microsoft.SqlServer.Dts.Runtime;) DLL.

I have added DLL reference from (C:\Program Files (x86)\Microsoft SQL Server\100\SDK\Assemblies\Microsoft.SQLServer.ManagedDTS.dll)

 private void BtnExecuteSSIS_Click(object sender, EventArgs e)
        {
            try
            {
                                  Package pkg;
                    Microsoft.SqlServer.Dts.Runtime.Application app;
                    DTSExecResult pkgResults;

                    app = new Microsoft.SqlServer.Dts.Runtime.Application();
                    
                    pkg = app.LoadPackage("D:\SSIS\DataMigration.dtsx", null);


                    Status = pkg.Execute();

                    pkg.Dispose();

                    MessageBox.Show(Status);
                }

            }
            catch (Exception exc)
            {
                MessageBox.Show(exc.Message,"",MessageBoxButtons.OK, MessageBoxIcon.Error); 
            }
        }

When i am trying to runn from VS 2010 studion it crashes as in below images

Error

Error:ADO.NET source connection issue

$
0
0

Hi,

I am using ADO.net source in ssis package to pull the tablesto destination.But I am getting the error as attached document.

Can anyone help me on this.This si svery urgent requirement;


sudha

SSIS package fails to excute when i replace the old dtsx package with new one but same name

$
0
0

Hi

I'm trying to run a package but it keeps on failing giving me an error but it only works with the previous package that was deployed. I added a new column to the table and to the extraction in the command text in visual studio, mapped the columns and when i execute the package manually it completes successfully and loads the data in the table and new column. However, there was a job that was created on this package in SQL Server agent and the job still runs succesfully on the old package. Now, when i replace the old package with the new one the job step fails. I get this error

Executed as user: Userpc\admin. Microsoft (R) SQL Server Execute Package Utility  Version 10.50.2500.0 for 32-bit  Copyright (C) Microsoft Corporation 2010. All rights reserved.    Started:  11:49:52 AM  Error: 2012-11-09 11:49:52.28     Code: 0xC0011007     Source: {B072BD98-C0A6-4D84-9FE5-9EAFC3B5B250}      Description: Unable to load the package as XML because of package does not have a valid XML format. A specific XML parser error will be posted.  End Error  Error: 2012-11-09 11:49:52.28     Code: 0xC0011002     Source: {B072BD98-C0A6-4D84-9FE5-9EAFC3B5B250}      Description: Failed to open package file "C:\Projects\Integration Packages\CollectionBBA.dtsx" due to error 0x80070005 "Access is denied.".  This happens when loading a package and the file cannot be opened or loaded correctly into the XML document. This can be the result of either providing an incorrect file name was specified when calling LoadPackage or the XML file was specified and has an incorrect format.  End Error  Could not load package "C:\Projects\Integration Packages\CollectionBBA.dtsx" because of error 0xC0011002.  Description: Failed to open package file "C:\Projects\Integration Packages\CollectionBBA.dtsx" due to error 0x80070005 "Access is denied.".  This happens when loading a package and the file cannot be opened or loaded correctly into the XML document. This can be the result of either providing an incorrect file name was specified when calling LoadPackage or the XML file was specified and has an incorrect format.  Source: {B072BD98-C0A6-4D84-9FE5-9EAFC3B5B250}  Started:  11:49:52 AM  Finished: 11:49:52 AM  Elapsed:  0.032 seconds.  Process Exit Code 4.  The step failed.

The RPC Server is unavailable - Tried almost everything!

$
0
0

Hi.

Im trying to access Integration Services on a server via SQL Server Management Studio through my local machine, and when I hit connect I get the error 'The RPC Server is unavailable'.

 

I've turned firewalls on my machine and the server off, so I dont think its related to firewalls. Also, 2 users in the office are able to connect with no problem at all, its just my machine. However, if I remote desktop into the server and connect to Integration Services, it works!

Im totally confused as to where to go now. I've checked all the RPC services are running, I've turned off firewalls, whats next?

 

Please help!

 

Check missing values in CSV and if there is stop process

$
0
0

Hi all,

I am new to SSIS, if any help would be great. What we need is to check any missing values before loading CSV file
The details are :
if the csv file exists(already implemented), check inside CSV file
1. Check missing columns/missing values. There is only one column can be nullable, if other five columns don't have value
2. move csv to a different folder if anything missing
3. Generate a log file saying why this csv not processed

The control flow and data flow are as followed, will implement checking missing values based on these flows:


How is my understanding with stored procedure in sql server 2005?...please read

$
0
0

Hi to all,

I just want to ask if my understanding in stored procedure is correct. Like...

i made a command button in visual basic in vs2008. When i press the button the information in the textbox will stored in sql database where the table is in there. and updates and updates when ever i input new information in textbox. . . is that the stored procedure?? Please help 

Thanks in advance.


jocker > i'm learning

Export multiple tables to multiple excel workbooks

$
0
0

Hello,

I need to export several (30) tables/views to Excel workbooks.

Using the foreach loop container I can iterate over the tables or over the workbooks.

The probleem is that the structure of each table is different.

How can I make the "mapping" of columns dynamically ?

Oh and if the data is varchar it must be converted to nvarchar. Any suggestions ?

Constantijn


SSIS 2012 Environment Variables - How to deploy

$
0
0

Hi,

Is there some way that I can add a script into the SSIS project that runs post-deployment (a la SSDT) to create the reference between the environment and the project (i.e. exec catalog.create_environment_reference)?

What I want to do is deploy the environment variables via a TSQL script as part of an SSDT project at that point the SSIS Project may or may not be deployed if it's not then I want to be able to create the reference automatically as part of the SSIS deployment.

It seems to me that the environment variables are so intrinsically linked to a project that they should be able to be deployed as part of it.

Cheers

Leyton

error information for failed SSIS job [error event id: 12291 and keyword: 0x80000000000000]

$
0
0

Please let me know what EventID 12291 and keywords 0x80000000000000 means from below event details.<o:p></o:p>

<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event"> <o:p></o:p>

<System>

<Provider Name="SQLISPackage110" /><EventID Qualifiers="16385">12291</EventID><Level>2</Level><Task>0</Task>

<Keywords>0x80000000000000</Keywords>

<TimeCreated SystemTime="2012-11-09T07:29:48.000000000Z" /> <o:p></o:p>

<EventRecordID>969873</EventRecordID>

<Channel>Application</Channel>

<Computer>xxx-xx.xx-xx.com</Computer>

<Security UserID="xxxxxxxxxxxxxxxxxxxxxxxxx" /></System>

<EventData>

<Data>LoadFTData</Data>

</EventData>

</Event><o:p></o:p>

Whereas the job throws below error message<o:p></o:p>

Executed as user: xx-xxx\xxx. Microsoft (R) SQL Server Execute Package Utility Version 11.0.2100.60 for 64-bit Copyright (C) Microsoft Corporation. All rights reserved. Started: 7:29:32 AM Error: 2012-11-09 07:29:48.32 Code: 0x00000006 Source: SCR_Process FT File Description: The script returned a failure result. End Error DTExec:The package execution returned DTSER_FAILURE (1). Started: 7:29:32 AM Finished: 7:29:48 AM Elapsed: 15.35 seconds. The package execution failed. The step failed.<o:p></o:p>

2008 SSIS Designer stops working after installing VS11 Dev Preview

$
0
0

Immediately after installing the Visual Studio 11 Developer Preview, I was no longer able to open a SSIS package in VS 2008. I uninstalled it and all the .NET 4.5 associated packages, reinstalled both VS 2008 and SQL 2008, but still it refuses to work. 

This is the specific error I get when attempting to open one. 

 

===================================

An error prevented the view from loading. (Microsoft Visual Studio)

===================================

The specified module could not be found. (Exception from HRESULT: 0x8007007E) (System.Windows.Forms)

------------------------------

Program Location:

   at System.Windows.Forms.UnsafeNativeMethods.CoCreateInstance(Guid& clsid, Object punkOuter, Int32 context, Guid& iid)

   at System.Windows.Forms.AxHost.CreateWithoutLicense(Guid clsid)

   at System.Windows.Forms.AxHost.CreateWithLicense(String license, Guid clsid)

   at System.Windows.Forms.AxHost.CreateInstanceCore(Guid clsid)

   at System.Windows.Forms.AxHost.CreateInstance()

   at System.Windows.Forms.AxHost.GetOcxCreate()

   at System.Windows.Forms.AxHost.TransitionUpTo(Int32 state)

   at System.Windows.Forms.AxHost.CreateHandle()

   at System.Windows.Forms.Control.CreateControl(Boolean fIgnoreVisible)

   at System.Windows.Forms.Control.CreateControl()

   at Microsoft.DataWarehouse.Design.ComponentDiagram.CreateDdsView(Control parentControl)

   at Microsoft.DataTransformationServices.Design.DtsComponentDiagram.CreateDdsView(Control parentControl)

   at Microsoft.DataWarehouse.Controls.DdsDiagramHostControl.set_ComponentDiagram(ComponentDiagram value)

   at Microsoft.DataTransformationServices.Design.ControlFlowControl.set_ComponentDiagram(ComponentDiagram value)

   at Microsoft.DataTransformationServices.Design.DtsPackageView.CreateControlFlowEditor(VsStyleToolBar pageViewToolBar)

   at Microsoft.DataWarehouse.Design.EditorWindow.EnsureViewIsLoaded(EditorView view)

 

Packages Fails then Works

$
0
0

When we run a package in production we are getting intermittent errors.  When we run the package it will fail but not in the same place. Below are some of the errors we receive.  We also will rerun the package and it will complete successfully......

The package is pulling data from SQL Server 2005 and dumping the data into an excel template.

Errors we get......

Execute SQL Task Failure
SSIS Error Code DTS_E_THREADFAILED.  Thread "SourceThread0" has exited with error code 0xC0047038.  There may be error messages posted before this with more information on why the thread has exited.

SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "OLE DB Source" (5585) returned error code 0xC0209017.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

Setting the end of rowset for the buffer failed with error code 0xC0047020.

SSIS Error Code DTS_E_THREADFAILED.  Thread "WorkThread0" has exited with error code 0xC0209029.  There may be error messages posted before this with more information on why the thread has exited.

SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Report Destination" (889) failed with error code 0xC0209029. The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "input "Excel Destination Input" (900)" failed because error code 0xC020907B occurred, and the error row disposition on "input "Excel Destination Input" (900)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.

SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft JET Database Engine"  Hresult: 0x80004005  Description: "Operation must use an updateable query.".


DBA Developer

Limitations of the Send Mail Task

$
0
0
I was wondering if people use the Send Mail Task much because of its limitations. I like that I can use a variable for the body of the email, but not having this functionality on the Subject and Recipient is a little limited. In several cases this would not work and require a script task or something else. I'm not sure why microsoft wouldn't make this task more robust. Do you usuaully use a Script Task instead or is there a better way?
Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>