Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Problem opening an Excel rowset in SQL/T-SQL

March 13, 2014, 12:45 pm
$
0
0

In SSMS ((SS 2008 R2) when I run:

SELECT * FROM 
OPENROWSET (      
  'Microsoft.ACE.OLEDB.12.0',
  'Excel 12.0;Database=C:\test\xltest.xls;HDR=YES;IMEX=1', 
  'SELECT * FROM [Sheet1$]'
)
From this article:

http://social.msdn.microsoft.com/Forums/sqlserver/en-US/3ffcbe7c-cdce-43cd-97b1-ea480bbbfff9/openrowset-excel
I get error:
Msg 7403, Level 16, State 1, Line 1
The OLE DB provider "Microsoft.ACE.OLEDB.12.0" has not been registered.
However, over in SSIS, the Excel Connection Manager connection string property (which works!) is:
Provider=Microsoft.ACE.OLEDB.12.0;Data Source= C:\test\xltest.xls;Extended Properties="EXCEL 12.0 XML;HDR=NO";
Showing that Microsoft.ACE.OLEDB.12.0 is registered on this machine.
What do I need to do in SQL/T-SQL to have the code work?

↧
Search

Header at text file (Destination ) in SSIS

March 14, 2014, 2:38 am
$
0
0
How to give the header while fetching from database source to text files destination (Tab Delimiter)
↧
↧

SSIS accessing a dts package properties with C#

June 20, 2011, 8:33 am
$
0
0

Hello there, 

Please, Could anyone help me and let know how i can access the "DTS package" Proeperties eg. PackageName?

And which namespace does DTS belong to: (as in "using Microsoft.SqlServer. ....")

In C# please!

↧

Remove duplicate records from flat file source in SSIS

June 28, 2012, 11:57 pm
$
0
0

Can any one please tell me the ways to remove the duplicate records from Flat file while taking it as input data source.

I tried with Sort with Remove rows with duplicate sort values but it slows the execution drasticaly.

Is there any way around. it would be greatly helpful.Thanks.

Tamilselvan

↧

Problem connecting to SAP Open Hub

March 14, 2014, 4:31 am
$
0
0

Hi, I am trying to set up a SSIS job  connecting to SAP Open Hub and have with support from the SAP guys been able to get some progress, but it has now stopped up on a error message we're not able to solve. Any suggestion on what can be wrong and how to solve this? When I run the package I get the following error message:

SSIS package "D:\Source\MSBI\SapLoadStaging\Package3.dtsx" starting.
Information: 0x4004300A at Data Flow Task, SSIS.Pipeline: Validation phase is beginning.
Information: 0x4004300A at Data Flow Task, SSIS.Pipeline: Validation phase is beginning.
Information: 0x40043006 at Data Flow Task, SSIS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Data Flow Task, SSIS.Pipeline: Pre-Execute phase is beginning.
Information: 0x4004300C at Data Flow Task, SSIS.Pipeline: Execute phase is beginning.
Information: 0x3E8 at Data Flow Task, SAP BW Source: Process Start Process, variant has status Completed (instance DH88PUV2SZBIFKMIF48K3USME)
Error: 0x3E8 at Data Flow Task, SAP BW Source: Process Data Transfer Process, variant /CPMB/HMIJYDZ -> ZOH_VPL has status Ended with errors (instance DTPR_DH88PUV2SZCA46Y9QNO66A6W6)
Error: 0x3E8 at Data Flow Task, SAP BW Source: The component is stopping because the Request ID is "0".
Error: 0x3E8 at Data Flow Task, SAP BW Source: No data was received.
Error: 0xC0047062 at Data Flow Task, SAP BW Source [41]: System.Exception: No data was received.
   at Microsoft.SqlServer.Dts.SapBw.Components.SapBwSourceOHS.PrimeOutput(Int32 outputs, Int32[] outputIDs, PipelineBuffer[] buffers)
   at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPrimeOutput(IDTSManagedComponentWrapper100 wrapper, Int32 outputs, Int32[] outputIDs, IDTSBuffer100[] buffers, IntPtr ppBufferWirePacket)
Error: 0xC0047038 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on SAP BW Source returned error code 0x80131500.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.
Information: 0x40043008 at Data Flow Task, SSIS.Pipeline: Post Execute phase is beginning.
Information: 0x4004300B at Data Flow Task, SSIS.Pipeline: "OLE DB Destination" wrote 0 rows.
Information: 0x40043009 at Data Flow Task, SSIS.Pipeline: Cleanup phase is beginning.
Task failed: Data Flow Task
Warning: 0x80019002 at Package3: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED.  The Execution method succeeded, but the number of errors raised (5) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
SSIS package "D:\Source\MSBI\SapLoadStaging\Package3.dtsx" finished: Failure.
The program '[6916] DtsDebugHost.exe: DTS' has exited with code 0 (0x0)

Regards
Paal

↧
↧

Unicode Issues with Attunity Drivers for Oracle

March 7, 2014, 9:44 am
$
0
0
Hi -

I am trying to do a data transfer from SQL Server to Oracle . In the data transfer task , I am using "OLE DB source " for SQL Server and using Attunity Oracle destination for Oracle database.
Here is the source table in SQL Server .

CREATE TABLE [dbo].[t_test](
    [FVersion] [nvarchar](25) NULL,
    [R_ID] [nvarchar](15) NULL,    
    [TEM] [nvarchar](10) NULL
    
)

Here is the destiantion table in Oracle .

CREATE TABLE t_test(
    FVersion nvarchar2(25) NULL,
    R_ID nvarchar2(15) NULL,    
    TEM nvarchar2(10) NULL
)


When I run the data transfer task , I am getting the following message . Please advise.



Error at Data Flow Task [OLE DB Source [1]]: Column "FVersion" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [OLE DB Source [1]]: Column "R_ID" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [OLE DB Source [1]]: Column "TEM" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [SSIS.Pipeline]: "component "OLE DB Source" (1)" failed validation and returned validation status "VS_ISBROKEN".

Error at Data Flow Task [SSIS.Pipeline]: One or more component failed validation.

Error at Data Flow Task: There were errors during task validation.

 (Microsoft.DataTransformationServices.VsIntegration)

------------------------------
Program Location:

   at Microsoft.DataTransformationServices.Project.DataTransformationsPackageDebugger.ValidateAndRunDebugger(Int32 flags, DataWarehouseProjectManager manager, IOutputWindow outputWindow, DataTransformationsProjectConfigurationOptions options)
   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchDtsPackage(Int32 launchOptions, ProjectItem startupProjItem, DataTransformationsProjectConfigurationOptions options)
   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchActivePackage(Int32 launchOptions)
   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchDtsPackage(Int32 launchOptions, DataTransformationsProjectConfigurationOptions options)
   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.Launch(Int32 launchOptions, DataTransformationsProjectConfigurationOptions options)
↧

How to see old ssis logs ?

March 7, 2014, 3:59 pm
$
0
0

Hi ! I don't know where or how SSIS (the SSIS tool, not sql server agent) stores logs for old jobs. Is there a way to see the log of SSIS jobs from past day, week, month etc . ?

Thanks.

↧

opening a rowset for failed. check that the object exists in the database

March 14, 2014, 7:29 am
$
0
0

Hello,

I have a SSIS package where im importing data from MS access database file .MDB. I chose Microsoft JET 4.0 OLEDB provider. When i select a table and preview the data, im getting the below error.

Error at Data Flow Task [OLE DB Source [1]]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E09.

Error at Data Flow Task [OLE DB Source [1]]: Opening a rowset for "_tblDateDateEarnedMismatch" failed. Check that the object exists in the database.

But it is working for the other tables . Can someone please help me out with this error?

Regards,

Ravi

↧
Search

SSIS 2005 daily job that processes data is failing due to corrupt .prt.xml files

March 14, 2014, 8:17 am
$
0
0

The daily job has been running for years now. Yesterday, it failed due to corrupt .prt.xml file that belongs to an old partition from 2012:

OnError,PC,NT AUTHORITY\SYSTEM,Update Dim 1,{865AA3E5-2D32-4DF0-86EA-0B76DDE42C43},{AA4713D8-B06D-4287-836B-4DCC54B5CDF9},3/13/2014 9:56:13 AM,3/13/2014 9:56:13 AM,-1055981562,0x,XML parsing failed at line 1, column 4: Unrecognized input signature.
.
OnError,PC,NT AUTHORITY\SYSTEM,IncrementalOLAPUpdatePackage,{F423D795-224C-4060-91D4-39677031038B},{AA4713D8-B06D-4287-836B-4DCC54B5CDF9},3/13/2014 9:56:13 AM,3/13/2014 9:56:13 AM,-1055981562,0x,XML parsing failed at line 1, column 4: Unrecognized input signature.
.
OnError,PC,NT AUTHORITY\SYSTEM,Update Dim 1,{865AA3E5-2D32-4DF0-86EA-0B76DDE42C43},{AA4713D8-B06D-4287-836B-4DCC54B5CDF9},3/13/2014 9:56:13 AM,3/13/2014 9:56:13 AM,-1055653860,0x,Errors in the metadata manager. An error occurred when instantiating a metadata object from the file, '\\?\E:\sqldata\OLAP\Data\OLAP.0.db\Statistics.0.cub\Statistics.2233.det\Statistics Week_15_2012.691.prt.xml'.

To fix this I tried copying the xml from week 14 and updated accordingly (eventually I couldn't update object ID) then restarted SQL Server and as a result, the XML was deleted along with the corresponding partition folder.

Today, the job did not start automatically and when I kicked it manual using Management Studio, it failed again with the following error:

OnError,PC,NEGOLAPPC\rkheir,IncrementalOLAPUpdatePackage,{F423D795-224C-4060-91D4-39677031038B},{E8F46E27-4F46-4A9E-8886-390AD7D94BCA},3/14/2014 2:51:31 PM,3/14/2014 2:51:31 PM,-1055981562,0x,XML parsing failed at line 1, column 1: Incorrect document syntax.
.
OnError,PC,NEGOLAPPC\rkheir,Update Dim 5,{68fe47d1-97bf-40d8-bc23-f791b0ce2ab9},{E8F46E27-4F46-4A9E-8886-390AD7D94BCA},3/14/2014 2:51:32 PM,3/14/2014 2:51:32 PM,-1055653860,0x,Errors in the metadata manager. An error occurred when instantiating a metadata object from the file, '\\?\E:\sqldata\OLAP\Data\NEG OLAP.0.db\Statistics.0.cub\Statistics.2233.det\Statistics_02082010_02092010.1623.prt.xml'.

When I open the XMLs in the error logs they look like binary contents (unreadable). Other XMLs are readable...

Any idea what may be causing this?

NOTE: The partitions with the corrupt XMLs are old ones that are not being processed anymore... currently the partition for statistics is week_12_2014... We're using SQL Server 2005, will be updating to 2008R2 soon but need to resolve this issue first.




↧
↧

Re: How to upload a text file into several tables

March 14, 2014, 8:21 am
$
0
0

Hello everyone,

I have a problem for which I need your help as per follows:

1. I have a text file that basically contains data in denormalised form.

2. I have designed all the tables for the normalised data to go in.

3. I would now like to use SSIS to extract the data and populate the tables.

4. Some tables, eg. list of currency needs to be filled first before populating the other data as there is foreign index.

5. What is the best way to achieve this ?

6. Should the linked tables be filled in first and then the 'main' data table be filled ?

7. Should I have several 'control' each for populating each 'parameter table' first and then a final control for populating the 'main' table data ?

Please do send me a link to any similar solution you might have come acros.

Below are two sample rows from the text file:

Quote, QuoteMonth, QuoteType, QuoteCurrency, QuoteCcyDesc, QuoteDate, QuoteVlaue
XASDFASDFDFF344, April 2004, Spot, USD, US Dollars, 04/01/2013, 455,10.23
ASD334344566,May 2013, Non Spot, GBP, Pound Sterlings, 05/01/2013, 234,456.45

Any help is most welcomed.

Thank you in advance for reading.

rgds


↧

exception has occurred during data insertion ... Wrong number of parameters

March 14, 2014, 9:20 am
$
0
0

I am using an ADO dataflow source and an ADO dataflow destination to move data from a table on an IBM iSeries DB2 database to another IBM iSeries DB2 database on another machine.  The connection managers for source and destination both use .Net Providers\Odbc Data Provider with the Data Source Specification being ODBC connections specified on the Windows Server 2008 r2 machine hosting bids.  All the test connections work...so far so good.

Issue is when I execute the control flow task the rows get picked up from the source DB2 database no problem but it fails on the insert to the destination DB2 table...The progress tab specifies the exceptions...

[ADO NET Destination [601]] Error: An exception has occurred during data insertion, the message returned from the provider is: ERROR [07002] [IBM][System i Access ODBC Driver]Wrong number of parameters.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "ADO NET Destination" (601) failed with error code 0xC020844B while processing input "ADO NET Destination Input" (604). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

I put a data viewer on the data flow connection and the records I expect are  getting picked up and look ok. I checked to make sure the source and destination tables have the same number of columns in their record layout and identical data types and they look fine.

Could someone kindly tell me whats going wrong?  Does the error message indicate that some of the columns are getting dropped from the dataset before the insert?

Thanks much in advance for any help, Roscoe

↧

Handle start and stop date and time in same fact table

March 14, 2014, 11:29 am
$
0
0

I have a fact table for "Treatment".  Each treatment has a start and stop date.  Is it as simple as placing a surrogate key from the date dimension in each of the start and stop fields in the fact table?  Seems simple but I'm guessing there are more things to consider than I am.

Thanks kindly for any thoughts.

↧

SSIS Sort and Hyphens

March 14, 2014, 11:26 am
$
0
0
I have read about issues of collation when sorting in SQL vs. SSIS.

In my case, I am performing two SSIS sorts between 2 datasets:

Dataset1
email id flag
zzz-yyyy.lastname@hotmail.com 1 1
ZZZYYYY.LASTNAME@HOTMAIL.COM 1 2


Dataset2
ZZZYYYY.LASTNAME@HOTMAIL.COM 1

I sorted both datasets in SSIS with ignore case check for email address. I did a merge join (left join between dataset2 and dataset1) between the two datasets based on id,email. The expected result is:

ZZZYYYY.LASTNAME@HOTMAIL.COM 1 2

I am getting:
ZZZYYYY.LASTNAME@HOTMAIL.COM 1 null

The left join is returning null for the flag column as if they do not match.
If I remove row 1 of dataset1, it works fine.
If I have ignore case in the sort unchecked it works but I need it checked for other cases.

I am not mixing SQL and SSIS sorts. Everything is within SSIS sorts.

Any help is appreciated.

Thanks.
↧
↧

Why Is My Custom Task Showing "Task Failed To Load"?

March 14, 2014, 2:13 pm
$
0
0

I developed a custom task to wrap an old program.

Running on dev machine via VS2012, works fine.

Deployed to the server, and now it shows the above error during validation, even when I run it by right-clicking and selecting "Run Package"...

What sort of troubleshooting steps am I looking for?

↧

Change Data Capture: Experiencing Delay

March 14, 2014, 12:35 pm
$
0
0

Hello Community,

I am experiencing an anomaly with Change Data Capture that is turning up empty with online searches.  Essentially, I am attempting to change data, and then immediately call the fn_cdc_get_all_changes_* function to get the changes I just made.

The issue I am running into is that the changes are not immediately available when I make that call.  I have to sleep the current thread 3.5-5 seconds before the changes are registered with SQL Server.

This seems very abnormal to me, so I wanted to check in with the forums here to see if maybe someone can shed some light on the matter.  Is CDC scheduled, perhaps?  I'd like to see if there's a "force refresh" mechanism that I can call to ensure CDC is caught up before I make the call.

Thank you for any assistance you can provide!

Michael

↧
Search

Precompiled script failed to load on SP4

March 14, 2014, 5:52 pm
$
0
0

We have an environment that is using SSIS 2005 packages that are executed on remote servers. The remote servers have SQL Server 2005 with Integration Services installed. SQL Server has been patched with:

  • GDR 5057 for SQL Server Tools and Workstation Components 2005 (64-bit) ENU (KB2494120)
  • GDR 5057 for SQL Server Integration Services 2005 (64-bit) ENU (KB2494120)
  • Service Pack 4 for SQL Server Tools and Workstation Components 2005 (64-bit) (KB2463332)
  • Service Pack 4 for SQL Server Integration Services 2005 (64-bit) (KB2463332)

When we run our set of packages there are certain packages with script tasks that get the following error and fail:

  • Precompiled script failed to load. The computer that is running the Script Task does not have a compiler capable of recompiling the script. To recompile the script, see the Microsoft Knowledge Base article, KB931846 (http://go.microsoft.com/fwlink/?LinkId=81885).

While it is possible to open and recompile the package, this is not practical for multiple packages running on multiple servers when we don't know which package or server combination will experience the issue. Also over time, as we make changes to the packages this issue tends to re-occur randomly.

We have tried all of the resolutions listed in KB931846 but none of them work because we already have SP4 applied. We have tried a number of other patches that have been listed in various KB's but all to no avail.

How do we patch this so that it no longer happens?

↧

Oracle oledb SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER error code 0xC0209303

March 16, 2012, 8:37 am
$
0
0

Hello There...

I faced one issue while I was working on the project to migrate data from Oracle to SQL Sever and I thought I should share it here.

I had created a SSIS package in VS2008 and had installed Oracle10g (32 bit) and SQL Server 2008 (32 bit). It was working fine until I changed my machine. I upgraded my laptop to 64 bit (I7) so I had to reinstall everything and there came the main problem. I couldn't run SSIS package at all after I installed Oracle 10g (64 bit) and SQL Server 2008 (64 bit)

It was tough to establish all connections successfully but I was able to do that with proper TNS entries (for Oracle) and SQL Server settings.

If you ever face issue in running SSIS package having Oracle and SQL connections, here is the checklist I would suggest:

  1. Make sure Oracle listener service is started (in order to start oracle listener run "lsnrctl start" without double quotes in command window) and system is listening Oracle (to do it run in command window: tnsping <ListenerName> e.g. tnsping XE or tnsping orcl). If it fails, please refer sample TNS files and correct yours.
  2. To check listener status of Oracle command to run in command window is "lsnrctl status" (without double quotes)
  3. Make sure you are getting connected to the SQL Server and Server name is correct
  4. You may need to update your Oracle oledb drivers which are available on Oracle site (I downloaded ODAC112030Xcopy_x64.zip)
  5. Open SSIS package and test your connections in connection manager. If they succeeds then great if not check above steps again.
  6. After you have successfull connections, make sure that property value of "AlwaysUseDefaultCodePage" is True in OLE DB Source (in data flow task). You can see this flag in Data Flow Component in Properties window
  7. In Visual studion, go to your Package properties (right click on Package in Solution explorer) and select False as the value for "Run64BitRuntime" Debug Options

These were the changes/checks which I did in order to run my SSIS package successfully.

FYI, version of softwares in my machine is:

Oracle: Oracle Database 10g Enterprise Edition Release 10.2.0.3.0
SQL Server: SQL Server 2008 Enterpise Edition (patch SP1 applied)
Microsoft Visual Studio 2008 Version 9.0.30729.4462 QFE
Microsoft .NET Framework Version 3.5 SP1
SQL Server Integration Services Microsoft SQL Server Integration Services Designer Version 10.0.2531.0 ((Katmai_PCU_Main).090329-1015 )

I hope this information would help someone....Happy Coding, cheers!!!


↧
↧

fetch data from prod servers

March 12, 2014, 7:08 am
$
0
0

Hi all,

can anyone help me in developing package with below requirement:

requirement

 Excel sheet contains all the  emp_ids ..these emp_ids should be searched in Emp DB and return the output to an new excel sheet.

Excel sheet

Emp _ID

111

  222

33

 ------à         SQL Server-------------à    Output(another excel sheet)

Emp _ID

NAme

111

aaa

  222

bbb

33

cccc


Whenever package runs output of excel sheet should be with current date.

Input values (ie. Emp_id ) keeps on changing).  So It has to be generalised.

↧

SSIS and SAP HANA

March 5, 2013, 7:26 am
$
0
0

I am trying to Load data from Sql server 2012 using SSIS 2010 into an HANA Instance and this seems impossible.   I have managed to connect up using ODBC but it runs without error and inserts nothing.

SAP Just recommend there Data services application as expected but on this occasion I would like to make use of SSIS.

Firstly is it possible to do this ?  and How is this achieved can anyone please advise?

I have considered and looked for adapters if an upgrade of SSIS might help ?

↧

Tanslate expression

March 16, 2014, 1:19 am
$
0
0

I appreciate if someone translate the following expression. Thanks.

ISNULL(CustomerName) == FALSE && TRIM(CustomerName) != “”
Regards

Muz

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>