Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

OST to PST Conversion

$
0
0

I have tried a lot of tools for conversion but found OST to PST Converter one of the best, it is ads free , easy to use, fast in processing, please recommend me any other tool also that can help me in  easy conversion from ost to pst conversion online.

coolutils dotcom slash OSTtoPSTConverter



Converting rtf to html in SSIS

$
0
0

Hi guys,

Please I need to convert rtf column to html in SSIS. 

Can someone help me with a code that hep me achieve this using script component.

Thanks


me

Script Task - Sharepoint.Runtime.Dll Related Error - Throwing [File Copy Task] Error: Could not find file 'Microsoft.SharePoint.Client.Runtime.resources'.

$
0
0

Hi Friends
I am getting error when I run the SSIS package using Script Task like sharepoint dll support error.

Script Task - Sharepoint.Runtime.Dll Related Error - Throwing [File Copy Task] Error: Could not find file 'Microsoft.SharePoint.Client.Runtime.resources'.

Error: The script returned a failure result. 

Task Download Conversion Files from share point to local C drive import_decoder_vs2012 folder failed

Please HELP at the earliest

Error testing Lesson 2 SSIS Tutorial

$
0
0

I am working through the SSIS Tutorial and have got an error when trying to test Lesson 2.

https://docs.microsoft.com/en-us/sql/integration-services/integration-services-tutorials?view=sql-server-2017

Here are the lines with the error messages:

[Sample OLE DB Destination [77]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "The statement has been terminated.".
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "Violation of PRIMARY KEY constraint 'PK_FactCurrencyRate_CurrencyKey_DateKey'. Cannot insert duplicate key in object 'dbo.FactCurrencyRate'. The duplicate key value is (3, 20050701).".
I have not made any changes to the PK and have deleted the dbo.NewFactCurrencyRate as instructed.

Why am I getting this error?


TEH

Merge join or lookup

$
0
0

Hi,

  • I have a requirement.I have 5 different oracle queries,pulling 5 different types of info.I have 5 OLE DB sources and respective lookups to check if the combination(username,app,logon_date) exists in the destination SQL table  B,then ignore the rows ,else insert them into table B.This works fine and solves my purpose  of ~1000 rows.The input oracle queries are pulling columns username,app,logon_date(max logon) each day.I am running this package daily.The idea is to load only those records where logon_date changed from yesterday to today to preserve the history (daily snapshot).The number of records are smaller today but with daily snapshot ,i am not sure if lookup will be costly or good.

Is my approach good performance wise or something else would be better?

  • Another implementation where for the similar requirement,i chose merge join to insert new rows and update existing using OLE DB command for change capture.This package has been running for over a year and these days it runs for ~1hr for 45000 records.I am not sure why and if merge join performing poorly ,i have to adopt another method.

I read a lot about merge join vs lookup,but unable to decide which is best for above use cases.If neither merge join or lookup,pls suggest an alternative.

NOTE: Case-1: The username,Application,logon_date is used as key for comparison in lookup

Case-2: username,license,start_date are used as key in merge join.A stage table is used to hold daily records coming from csv and i search for match/no match with the destination table using merge join.

Dataflowtask shows wrong entries from SAP - MBEW fields

$
0
0

Hello community,

I am fetching different tables from SAP via ODBC and everything works fine. But when I am touching MBEW or MBEWH with the fields LBKUM or SALK3 I am getting just 0.00 or completely wrong entries, and that in just those two fields. Same amount of rows which perfect match together, except those two fields.

Has anyone an idea?

Thanks

Mario

SSIS export to Excel 2016 fails

$
0
0

I have two SSIS packages that are exactly the same except for the data being exported. Both run manually in Visual Studio 2017\SSDT 15.1.61901.24070. One of them runs just fine in a SQL 2014 Agent job, the other does not. Both are running 32-bit, I have the ACE 16.0 ODBC 32 bit engine installed, permissions the same, same proxy account. delay validation set to true. I turned on verbose logging, the last message in the one that fails is : DFT_SalesInventoryCosts: Data flow engine will call a component method.  The one that runs has a small output data set (about 300 rows), the one that fails has 204,000 rows. But - I changed the stored procedure to only pass the first 1000 records, and that failed too, so I don't think it is the size of the output. ANY ideas are appreciated!

Log:

DFT_SalesInventoryCosts:Data flow engine will call a component method.
DFT_SalesInventoryCosts:Data flow engine has finished a call to a component method.
ExternalRequest_post: 'IDBCreateSession::CreateSession succeeded'. The external request has completed.
ExternalRequest_pre: The object is ready to make the following external request: 'IDBCreateSession::CreateSession'.
ExternalRequest_post: 'IDBInitialize::Initialize succeeded'. The external request has completed.
ExternalRequest_pre: The object is ready to make the following external request: 'IDBInitialize::Initialize'.
ExternalRequest_post: 'IDataInitialize::GetDataSource succeeded'. The external request has completed.
ExternalRequest_pre: The object is ready to make the following external request: 'IDataInitialize::GetDataSource(NULL, CLSCTX_INPROC_SERVER, ConnectionString: Provider=Microsoft.ACE.OLEDB.16.0;Data Source=\\spdcsvxsqlbxp01\w\ssis\anaplan_extracts\ExcelWorkFiles\Costs_work.xlsx;Extended Properties="EXCEL 12.0 XML;HDR=YES";,...)'.
DFT_SalesInventoryCosts:Data flow engine will call a component method.
DFT_SalesInventoryCosts:Progress: Validating - 25% complete.
DFT_SalesInventoryCosts:Data flow engine has finished a call to a component method.
DFT_SalesInventoryCosts:Data flow engine will call a component method.
The Costs_csv spent 0 milliseconds in Validate.
DFT_SalesInventoryCosts:Data flow engine has finished a call to a component method.
DFT_SalesInventoryCosts:Data flow engine will call a component method.
DFT_SalesInventoryCosts:Data flow engine has finished a call to a component method.
DFT_SalesInventoryCosts:Data flow engine will call a component method.
DFT_SalesInventoryCosts:Progress: Validating - 0% complete.
DFT_SalesInventoryCosts:Information: Validation phase is beginning.
DFT_SalesInventoryCosts:Validation has started.
Anaplan_Costs:Validation has started.

Lori

Integration Services project lesson Questions - Instructions not understood!

$
0
0

Don't understand point 5, as lesson 3 weas copied and pasted in the previous section?  When I did that a file Lesson 4.dtsx was created??

Add the completed Lesson 2 package

Open SQL Server Data Tools and open the SSIS Tutorial project.

In Solution Explorer, right-click SSIS Packages and selectAdd Existing Package.

In the Add Copy of Existing Package dialog, in Package location, selectFile system.

Select the browse (...) button, navigate to Lesson 2.dtsx on your machine, and then selectOpen.

Copy and paste the Lesson 3 package as described in steps 3-8 in the previous section.

Also, Lesson 3-2 point 9,  Containers pane??

In the Containers pane, expand all nodes of the package container hierarchy, and then clear all check boxes, including theExtract Sample Currency Data check box. Now select the check box forExtract Sample Currency Data to get only the events for this node.

What Containers pane, There isn't one.  Thought they were refering to ForEach container, but can't see anything with check boxes.

When I write instructions, which I have had to during my career, I write instructions for IDIOTS, how else can idiots become experts?  I also believe that a picture saves a thousand words.

 


TEH


Data Loss issue while transferring data from Source(Oracle) to Data Warehouse Staging Database(SQL Server)

$
0
0

Project Overview

Loading data from Oracle Database to Datawarehouse Staging Database(SQL Server). Using ETL process we are loading data from Oracle to SQL Server. Staging Database in SQL server is an exact replica of Source Oracle schema.

We have developed an SSIS package to initially load complete data into Staging Database and then apply data cleaning and load the data to Data Warehouse(SQL Server). In SSIS Package for migrating data from Source to Staging, we are using "Data Flow Task" in SSIS package and we are splitting the table data into 20 batches and loading batch-wise into Stage database in a sequential order

Issue:

We will build the .ispac file and deploy in PROD Server scheduled a package execution in SQL server agent. After package complete execution. The count of the source tables is not matching with the stage tables.

But when we are running the same package in the local machine the count of source tables are matching with stage tables.

As we are loading the data in Batch-Wise. In some cases, we are missing a few records in every batch or only a few batches. But we are not sure why the records are missing while transferring the data only in PROD Server

SSIS job is getting failed.

$
0
0

Hi Experts,

Please help with the below issue -

Detailed Error Description:

Executed as user: PRODGRP\!bd_production. Microsoft (R) SQL Server Execute Package Utility  Version 12.0.2430.0 for 32-bit  
Copyright (C) Microsoft Corporation. All rights reserved.    Started:  11:25:28 AM  Error: 2019-08-16 11:25:32.98   
  Code: 0xC0202009     Source: CustomerSiteGroupLoad Connection manager "ExcelSrcFile"    
  Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
  An OLE DB record is available.  Source: "Microsoft Office Access Database Engine"  Hresult: 0x80004005  
  Description: "External table is not in the expected format.".  End Error  Error: 2019-08-16 11:25:32.98    
  Code: 0xC020801C     Source: (DFT) Stg_CustomerSiteGroup (ES) Customer Site Group [31]    
  Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.
  The AcquireConnection method call to the connection manager "ExcelSrcFile" failed with error code 0xC0202009.  
  There may be error messages posted before this with more information on why the AcquireConnection method call failed.
  End Error  Error: 2019-08-16 11:25:32.98     Code: 0xC0047017   
  Source: (DFT) Stg_CustomerSiteGroup SSIS.Pipeline    
  Description: (ES) Customer Site Group failed validation and returned error code 0xC020801C.
  End Error  Error: 2019-08-16 11:25:32.98     Code: 0xC004700C    
  Source: (DFT) Stg_CustomerSiteGroup SSIS.Pipeline     
  Description: One or more component failed validation.  
  End Error  Error: 2019-08-16 11:25:32.98    
  Code: 0xC0024107     Source: (DFT) Stg_CustomerSiteGroup      
  Description: There were errors during task validation.  
  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  
  Started:  11:25:28 AM  Finished: 11:25:32 AM  Elapsed:  4.297 seconds.  The package execution failed.  The step failed

Version of SSIS : 2013

Deployment mode  : Package Deployment

Bit version : 32 bit

We have deployed using do not save sensitive

We have saved the excel file in .xlsx format.

one other observation : SSIS Job failing to ingest data from excel to stage table with row count 191246 , but successful in loading same file with row count 76510 .

Requesting you help.


Abhisek Mondal


Is there a way to launch a SQL procedure before and after every SSIS package?

$
0
0

I'm looking for a way - either using in-built SSIS functionality or custom-built (3rd party software or internally-coded) - to "wrap" every executed SSIS bundle with specific code, e.g. launch certain SQL procedures prior to and after all execution steps.

These are meant to log flow steps, handle errors, set up notifications, etc.

The key idea here is to avoid editing and adding this code manually to every single SSIS bundle manually - albeit doable, it's a pain in the neck to maintain if anything were to change in above setup.

Any advice on the topic from you SSIS / SQL Server gurus would be highly appreciated.

EDIT: alternatively, is there a way to easily refactor existing deployed SSIS packages and add / modify that code quickly and easily in one go?

SSIS failing for VARCHAR(16500) column from AS400 Table

$
0
0

SSIS failing for VARCHAR(16500 length) column from AS400 Table.  How to handle please?

Best Regards


Raghavendra Narayana

SSIS connection to netezza help needed

$
0
0

Hi All,

Did any one tried to netezza data base using SSIS as source or destination. Need help for the connection string or oledb provider configurations.

Thank you In Advance


Sri.Tummala

Problems using SSIS to transfer data to Excel Template

$
0
0

Hi,

I’m currently trying to use SSIS to export data into an Excel Template. Once the data is there, I need to format it and add formulas to certain rows using a Script Task. While I didn’t encounter any errors while working on my own computer, I did run into some errors once the package was moved to the server. Fortunately, I found a workaround to everything.  However, the “workarounds” are not ideal. I would like to know if there were any “easier” things I could have done instead of my final workarounds (which I’ll explain as I go).

My initial error occurred when using an Excel Destination task to put the data into the spreadsheet:

The requested OLE DB provider Microsoft.ACE.OLEDB.15.0 is not registered. If the 64-bit driver is not installed, run package in 32-bit mode. Error code: 0x00000000.

An OLE DB record is available. Source: "Microsoft OLE DB Service Coomponents"  Hresult: 0x80040154  Description: "Class not registered".

Our network people had installed Excel 2013 on the server, and went back and registered “Microsoft.ACE.OLEDB.15.0”. However, the error still persisted.  To get around this, I decided to get rid of theExcel Destination task, and use a Flat File Destination task to create a CSV file. I then use a Script Task to have the Excel Template import the CSV. This currently works well, but it is an extra step.  

The second set of errors occurred when trying to format the Excel Template (now that the data had been imported) using a Script Task. It worked for a few formatting statements, but then at a certain point, I would get the following error:

Exception from HRESULT: 0x800AC472  at System.RuntimeType.ForwardCallToInvokeMember(String memberName, BindingFlags flags, Object target, Int32[] aWrapperTypes, MessageData& msgData)

  at Microsoft.Office.Interop.Excel.Range.set_NumberFormat(Object )

After doing some digging, I found out that 0x800AC472 (VBA_E_IGNORE) was being sent when Excel was too busy to process the next command. I tried putting in “Sleep” commands to give it time to process, as well as using TRY-CATCHES to try multiple times to execute a statement (while sleeping a bit between each try). In the end, none of these helped.  The solution I found was to close and reopen the Excel Template between small “batches” of commands. While this isn’t ideal, it does work.  

Has anyone else encountered these problems before?  Did you find other solutions that worked?

Thank you for any insights you may have.

MS server connect to MySQL (ODBC)

$
0
0

I just installed SQL Server 2008 R2.  I added mysql-connector-odbc-5.1.6-win32.msi to connect to MySQLl database. It is not working properly . Please help – what driver can be used?

- (VStudio 2008) when  try to add/remove tables for DATA Source Views , I am getting an error

ERROR [42000] [MySQL][ODBC 5.1 Driver][mysqld-5.1.32-community-log]You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '[ fchclient]' at line 2 (myodbc5.dll)


 -  (VStudio 2008) when try to add ADO.NET with data access mode: table or view, I  am getting an error :

TITLE: Microsoft Visual Studio
------------------------------

Error at Data Flow Task [ADO NET Source [1]]: The component "ADO NET Source" (1) was unable to retrieve column information for the SQL command. The following error occurred: ERROR [42000] [MySQL][ODBC 5.1 Driver][mysqld-5.1.32-community-log]You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '"art"' at line 1

 

------------------------------
ADDITIONAL INFORMATION:

Pipeline component has returned HRESULT error code 0xC02020FF from a method call. (Microsoft.SqlServer.DTSPipelineWrap)

------------------------------
BUTTONS:

OK
------------------------------

 -  (VStudio 2008) when try to add ADO.NET with data access mode: SQL command - is working.

 


How to pass parameter in stored procedure execution for OLE DB source in SSIS

$
0
0

i'm having problems when executing a stored procedure in an OLE DB source in SSIS,

I have set the OLE DB source to SQL command and put the following:

enter image description here

This is the code for the SQL command text:

exec timesheet_r12..TIME_lynx_extract ?,?,?,?,?,?,?,?,?,?,?,?,?WITH RESULT SETS ((
worker_reference    NVarchar(50),
placement_reference  NVarchar(10),
worker_name NVarchar(50),
job_title   NVarchar(100),
authorising_line_manager    NVarchar(100),
timesheet_date  datetime,
company_agent_name  NVarchar(100),
type_of_worker  NVarchar(100),
week_number NVarchar(100),
hours_worked    NVarchar(100),
rate_description    NVarchar(100),
rate_per_hour   NVarchar(10),
job NVarchar(100),
work_stage  NVarchar(100),
project_name    NVarchar(100),
location NVarchar(100)))

The first 2 parameters that I need to send are @startweek and @endweek for these,I need to find out how to send the last friday as "@endweek" and the friday of 4 weeks ago as "@startweek" (4 fridays before).

if I want to execute with hard coded @startweek and @endweek the Stored Procedure in the Database, I can do it with the following command:

exec timesheet_r12..TIME_lynx_extract'19 Jul 2018','16 Aug 2019',null,null,null,null,null,null,null,null,null,null,null

this is the error I'm getting when executing the package in SSIS:

So right now what I would need is to know how to pass the parameters to SSIS, and how to make them dinamyc, @startweek and @endweek can be calculated.

Compatibility of SSIS 2008/2008 r2 to SQL SERVER 2016 databases

$
0
0
Do we have compatibility of SSIS 2008/2008 r2 to SQL SERVER 2016 databases.?

Execute SQL Task is failing in Event Handlers onerror

$
0
0

Hi Guys,

I'm very new to SSIS. I have one package and have an Execute SQL Task named asCall Procedure in which i'm calling a procedure. I want to log data if any error occurs. So I created an Execute SQL Task named asLogging Error SQL Task in Event Handlers for package and added expression 

"INSERT INTO [LabourFlash_OLAP].[dbo].[LoggingError]
([Package_Name]
,[Task_Name]
,[Error_Code]
,[Error_Description])
VALUES
(
'" + @[System::PackageName] + "'
,'" + @[System::TaskName] + "'
," + (DT_WSTR,12) @[System::ErrorCode] + "
,'" + @[System::ErrorDescription] + "'
)"

In Call Procedure I gave wrong procedure name so its failing this task now I want Logging Error SQL Task to execute successfully inEvent Handlers but its failing.

When I right click on Logging Error SQL Task and select Execute Task its working fine and data is inserting. 

But when I run the package then Its failing.

Can any one help me on this. 

Thanks in advance.



Searching error in Script Component SSIS

$
0
0

Hi,

I'm using a script Component to generate a new column in my table. I want to check if the "contactID" is in the "contact" table and generate a "statut" column that is boolean. The problem is the "statut" column is always FALSE. I think it's because the execution of the query is not working in the ProcessInputRow() method, i tried to execute it in the PreExecute() method withe a default parameter "contactID=3" and it's working fine. My problem is i don't know how debug a script component, I can't even use MessageBox in the ProcessInputRow() only in the PreExecute(). I need help please. Thanks

#My Code

public override void PreExecute()
{
        base.PreExecute();
       cmd = new System.Data.SqlClient.SqlCommand("SELECT ContactID FROM  Contact as ot WHERE ContactID =@mi", cn);
param = new System.Data.SqlClient.SqlParameter("@mi", SqlDbType.Int);
cmd.Parameters.Add(param);
}

public override void AcquireConnections(object Transaction)
{
base.AcquireConnections(Transaction);
cnManager = base.Connections.ConnexionADO;
cn = (SqlConnection)cnManager.AcquireConnection(null);
}

public override void Entrée0_ProcessInputRow(Entrée0Buffer Row)
    {
System.Data.SqlClient.SqlDataReader dtr;
cmd.Parameters["@mi"].Value = Row.ContactID;
dtr = cmd.ExecuteReader();


if (dtr.Read())
{
Row.statut = true;
}
else
{
Row.statut= false;
}


dtr.Close();
}

WEB SERVICE IN SSIS

$
0
0
I have a web service that I need to get data from. This web service returns a json format data. I have tried using the web service task but I discovered it works only with web service that returns an XML file, which in my case doesn't. I need a recommendation of the task I an use to get my work done. Preferably an open source task. Thanks
Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>