Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SCD task and Sequence generator (Next Value) dependancy

$
0
0

We have Sequence generator (Next Value) enabled for surrogate keys (SQL Server 2012). When we use the new SCD task, we get the following error:

[Insert Destination [42]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.

An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "NEXT VALUE FOR function cannot be used if ROWCOUNT option has been set, or the query contains TOP or OFFSET. ".

Is there any know issue that these two features [SCD task and Next Value] cannot be used together?


Bose


SSIS Service (2008 R2) failed to start

$
0
0

I've been trying to install SQL Server 2008 R2 Developer on my development system for a while now.  My system has Visual Studio 2010 on it. Repeatedly, I have received errors during the SQL install process. I finally was able to get it to install this morning with no errors by NOT selecting the SSIS feature.  After the successful install, I then tried to add the SSIS feature independently.  It failed when it tries to start the SSIS service.  (It fails at this point every time.)  Event Viewer doesn't give detailed error message. Just this:

Microsoft SSIS Service failed to start.
Error: Configuration system failed to initialize

I searched around and found an article (http://blogs.msdn.com/b/ajaykumarks/archive/2010/11/13/a-short-story-about-the-quot-ssis-service-that-failed-to-start-quot.aspx) on enabling the sqldumper to generate minidumps for SSIS. But it seems that post was for SQL 2005 and I can't find the right registry key to enable sqldumper for the SSIS service.

Right now, it seems SQL server is running, but the SSIS service does not start. Each time it gives the nondescript error message in the event viewer.  The installation logs simply have the same message.

Where do I go from here? Please help!

OS: Win 7 Pro x64 SP1

CDC Control Task: "Timeout expired" (when Transaction is required)

$
0
0

To complete CDC Mark Initial Load Start and End, two CDC control tasks are added into a Sequence Container, if Transaction is not supported for the container, everything works fine. However, Transaction is required on the other hands, the "Mark Initial Load End" will fail raising "Timeout expired" error.

Based on tracing, the following statement is suspending. It might be waiting for the lock placed by the first CDC task "INSERT INTO [dbo].[cdc_states] ([name] ,[state])" that was running in another session.

exec sp_executesql N'SELECT count(*) FROM [dbo].[cdc_states] WHERE Upper([name]) = Upper(@name)',N'@name nvarchar(9)',@name=N'CDC_State'


Any solution to this, the initial requirement is to rollback all changes, including CDC , if "Load Dimension Table" or something else between these two CDC tasks failed.

Thanks,
NetDNA

Oracle Provider for OLEDB SSIS Datatype conversion

$
0
0

I am experiencing data type issues when using Oracle Provider for OLEDB.  The error that I get is Error: 0xC002F210 at Execute SQL Task: Executing the query "SELECT CODE_DOC_TYPE.NAME, CODE_DOC_TYPE.VALUE, D..." failed with the following error: "ORA-00923: FROM keyword not found where expected". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.   Task failed:  The query runs fine from TOAD and connection is established. 

I am updating an SSIS package to use the Oracle database instead of extracting data from oracle, saving as an excel file, then loading the excel file to a temp table on sql server 2012 table.  I changed my datasource initially to Microsoft Provider for Oracle, experienced some issues but then was advised to use Oracle Provider for OLEDB.  As far as best practice should I load my results in a temp table then use the execute sql task to query the temp table to form the resultset?

My data fields are of type number and char on oracle.  on the Advanced editor of the Data Flow tasks they were the number fields were defaulting to DT_WSTR.  Since then using info I found in forum, I changed my number fields to CAST(MY_FIELD AS NUMERIC(5,0)) so that the number is precise and when i look at the Advanced Editor Input/Ouput properties for output columns the SSIS Datatype is DT_NUMERIC....but I have a question on what datatype to use in my variable.  Prior to updating the connection manager to oracle, I was using variable as double datatype.  The variable helps in ending a loop that's setup up later in the process flow.

automatically on button click get SSIS configuration wizard

$
0
0

I am doing automation of SSIS deployment, I create folder structure have *.Manifest file in it

I want to call SSIS DEPLOYMENT WIZARD on Button Click, how to do it?, I am not getting any help till now


--Himanshu Kulkarni

SSIS - use Error Redirect output in the same package

$
0
0

I have one question, I want to use redirected error output file or table in the same package after correcting the error. suppose I have input file which have the bad rows which I get in the redirected error output file/table, then I will manually correcting all bad records, then when I run the same package it will automatically detect the error record and process the all error records else process normally.

Please suggest some mechanism which can do this thing.

Suggestion and guidance invited.

XML Source giving blues while fetching data

$
0
0

Hi All,

I have a webservice from which i need to populate my database tables.

As of now i have used a webservice task to fetch data from web service in an XMl file.

But this XML has Multiple Namespaces which is not supported by SSIS (Supports only single namespace).

So to overcome this issue i used XML task with opeartion type as "XSLT" And used following code in XSLT file:

<?xml version="1.0" encoding="utf-8" ?> <xsl:stylesheet version="1.0"         xmlns:xsl="http://www.w3.org/1999/XSL/Transform">   <xsl:output method="xml" indent="no" />   <xsl:template match="/|comment()|processing-instruction()">     <xsl:copy>       <xsl:apply-templates />     </xsl:copy>   </xsl:template>   <xsl:template match="*">     <xsl:element name="{local-name()}">       <xsl:apply-templates select="@*|node()" />     </xsl:element>   </xsl:template>   <xsl:template match="@*">     <xsl:attribute name="{local-name()}">       <xsl:value-of select="." />     </xsl:attribute>   </xsl:template> </xsl:stylesheet>

 

Using this i am able to generate a new XML file with Single NameSpace.

Now i have used XML SOurce which is using this new XML file and also generated XSD file.

But now the problem is that i am getting a long list in OUTPUT NAME(all the coulmn names individually and some other names like counter, sequence etc.) field when i click on Columns TAB of XML Source.

Please let me know how can i combine all these columns to populate a single table and where i am wrong.

Using FuzzyLookUp in a SSIS package and when updating referencing table 'sp_FuzzyLookupTableMaintenanceInvoke' gives error

$
0
0

Hello,

We have made an SSIS package which is using Fuzzy Lookup. We have filled in an Reference table and marked Store new index and marked Maintain stored index (Fuzzy Lookup properties).

The package works fine, but updating the reference table doesn't work. We get the following error:

Msg 6549, Level 16, State 1, Procedure sp_FuzzyLookupTableMaintenanceInvoke, Line 0
A .NET Framework error occurred during execution of user defined routine or aggregate 'sp_FuzzyLookupTableMaintenanceInvoke':
System.Data.SqlClient.SqlException: User defined routine, trigger or aggregate tried to rollback a transaction that is not started in that CLR level. An exception will be thrown to prevent execution of rest of the user defined routine, trigger or aggregate.
System.Data.SqlClient.SqlException:
   at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
   at System.Data.SqlClient.SqlInternalConnectionSmi.ExecuteTransaction(TransactionRequest transactionRequest, String transactionName, IsolationLevel iso, SqlInternalTransaction internalTransaction, Boolean isDelegateControlRequest)
   at System.Data.SqlClient.SqlInternalTransaction.Rollback()
   at System.Data.SqlClient.SqlTransaction.Rollback()
   at Microsoft.SqlServer.Dts.TxBestMatch.TableMaintenance.TranWrap(DataCleaningOperation c)
. User transaction, if any, will be rolled back.
The statement has been terminated.

We get this error when we fire a update or delete statement on the table. For testing I inserted a record en that works fine. Even deleting the records works fine, but deleting the inserted record works only before executing the package. After executing the package I get the same error.

The machine runs on Windows XP, SQL Server 2008 Standard SP1.

We have a test machine with the same specs. On this machine I installed SP2, but that didn't resolve the problem.

I thought the problem could be Standard vs Enterprise. So I did a test on a SQL Server 2008 Enterprise SP2, but this machine gave the same error.

Does anyone have a solution?

Thanks!

With kind regards,

 

Michaël


Michaël

Help regarding migration of DTS2000 to SSIS 2008/2012

$
0
0
I want to migrate a project done in DTS 2000  to SSIS 2008/2012.Is there any tool which we can use for
the conversion? What are advantage of using such conversion tools?
Will using free tools cause any licensing issues when the packge is used in production environments?                 

How much % re work will be needed after the conversion is done through the tool?


SSIS 2008 package to be opened in SQL 2005

$
0
0

Hi,

I have developed a SSIS package using SQL 2008 database in VS 2008, I want to open the same package in SQL 2005. Is it possible?If possible what are the settings that need to be changed in SQL 2008 environment.

Regards,

Vijetha

Problem: Triggering SSIS package (Excel to SQL Server) from a Windows Service (WMI)

$
0
0

Hello everyone,

I've just started with SSIS and my mission is to insert Excel-data to SQL Server 2012.

I've read quite a few blogs, articles about the problem that I have with SSIS but I'm not sure where to start to get this one fixed.

What do I do: So I have a package in a Windows Server 2008R2 environment that has a for each container which will go through all the excel files in a folder and insert the data to a sql table. Having set the "Run64BitRuntime" to false, this works from within BIDS. Even if I use the 32-bit DTEXEC this also works.

What doesn't work is this: I have created a WindowsService (with WMI) that watches over the specified folder and triggers the package when new files arrive. I created this service for x86-platform and when I check with corflags the 32-bit is set to 1. The service does trigger the package but creates errors.

Here are the errorcodes that I am getting:

Translated from German:

when the windows service is running:


SSIS-Errorcode 'DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER'.Error calling AcquireConnection-Method through Connection-Manager 'OLEDB_Destination_Conn'

and  sometimes I get the following error: (I can't replicate it right now)

Error: 0xC0202009 at SSIS Load Excel, Connection-Manager 'Excel_Source': SSIS-Errorcode'DTS_E_OLEDBERROR'. OLE DB-Error.Errorcode: 0x80004005....Source: 'Microsoft Office Access Database Engine' HRESULT: 0x80004005Description: 'Unexpected error from external database driver (????????).'.

I use a variable to set the connection string, which looks like this: Provider=Microsoft.ACE.OLEDB.12.0;Data Source=C:\SSISLoad\NewData\Files\Test\imaginary.xlsx;Extended Properties="EXCEL 12.0 XML;HDR=YES;IMEX=1";

Within the service I run the package like so:

pkg.Execute();

I've noticed that when I use a different SSIS package with a SQL-Task to simply insert some test data I can't get a connection with the WindowsService but it works again with BIDS and DTEXEC.

Could this be 64-bit related, maybe an authentication problem or is one of the drivers messed up but why can I run the package within BIDS or from the command line?

I will probably create another Excel project and see if the same error appears again. Maybe I should also try and see if I can use a job agent to get the package to execute.

Hopefully you have some tips in the meantime.

thanks a lot.


How to load data

$
0
0

Hi,

 

i have two folders 2011 and 2012 having 12 spread sheets in 2011 and in 2012 spreadsheets  upto current month.

in 01-2011 spreadsheet i have many sheets in which i am not in need of the data present in 1st sheet  only 2nd sheet data is need. likewise for all excel sheets .

now when i load first time it should load all data . and when i load next time it should run only current year and current month spread sheet data. all the data of other spread sheets loaded should be as it is.


vandana

SSIS 2012 Assembly Reference Error

$
0
0

We are in the process of upgrading our SSIS packages from 2008 to 2012.  I was able to import an existing package and I'm getting this error with all Script Tasks that use Microsoft.SqlServer.DTSRuntimeWrap.

Assembly 'Microsoft.SqlServer.ManagedDTS, Version=11.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91' uses 'Microsoft.SqlServer.DTSRuntimeWrap, Version=11.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91' which has a higher version than referenced assembly 'Microsoft.SqlServer.DTSRuntimeWrap, Version=10.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91'

I did some looking around and found this http://svenaelterman.wordpress.com/2012/05/05/using-ssis-2008-components-in-sql-server-data-tools-with-ssis-2012/

I did exactly as it said, but I still have the same error.  Has anyone seen this or have any suggestions on how to fix it?  I've spend many hours trying to figure it out but no luck.

Thanks for the help!  If you need more information please ask.

Insert varchar data into Oracle Blob datatype

$
0
0

Hi All,

I designed one SSIS package that is load data from SQL Server table to Oracle table.

In Sql Server I have one column with name  "Description" Datatype for this column is Nvarchar(225).

In Destination  (Oracle) for the same column(Description) having datatype as Blob Datatype.I want to Insert varchar values into Blob datatype.

                      Can you Please tell me how to resolve this issue.This is road block my next activity,can any one help on this.

Regards,

Praveen C


Regards, Praveen

PipeLineComponentTime calculating incorrectly?

$
0
0

Hi, I'm trying to find out exactly how much time each of my tasks did take. I'm using PipeLineComponentTime logging feature. And the numbers in the logs confuses me as they are very big. Here is the sample (these rows are for the same task in the same execution):

id	event				starttime		endtime			message
68	User:PipelineComponentTime	2012.08.14 09:38	2012.08.14 09:38	The component "Merge INNER JOIN 2" (27492) spent 0 milliseconds in Validate.
203	User:PipelineComponentTime	2012.08.14 09:38	2012.08.14 09:38	The component "Merge INNER JOIN 2" (27492) spent 16 milliseconds in Validate.
339	User:PipelineComponentTime	2012.08.14 09:38	2012.08.14 09:38	The component "Merge INNER JOIN 2" (27492) spent 16 milliseconds in Validate.
484	User:PipelineComponentTime	2012.08.14 09:38	2012.08.14 09:38	The component "Merge INNER JOIN 2" (27492) spent 15 milliseconds in PreExecute.
628	User:PipelineComponentTime	2012.08.14 09:58	2012.08.14 09:58	The component "Merge INNER JOIN 2" (27492) spent 0 milliseconds in PostExecute.
629	User:PipelineComponentTime	2012.08.14 09:58	2012.08.14 09:58	During last execution the pipeline suspended output "Merge Join Output" (27495) of component "Merge INNER JOIN 2" (27492) for 1148021 milliseconds to limit the number of in-memory buffers.
808	User:PipelineComponentTime	2012.08.14 09:58	2012.08.14 09:58	The component "Merge INNER JOIN 2" (27492) spent 1153375 milliseconds in ProcessInput.
887	User:PipelineComponentTime	2012.08.14 09:58	2012.08.14 09:58	The component "Merge INNER JOIN 2" (27492) spent 2894071 milliseconds in PrimeOutput filling buffers on output "Merge Join Output" (27495).

Now the whole package took 20 minutes (I have my own logging), also you can see the same 20 minutes in StartTime, Endtime columns (from 4th to 5th rows). But if I calculate by the milliseconds which are in the message -  I get total of 67 minutes.

So the question is  - how do I interpret those messages and do they have a meaning at all?

P.S. using SQL2008



Group by clause not working with Ole DB source

$
0
0
I'm querying the Oracle db via the OraOLEDB.Oracle (Native Oracle driver not the msdaora.1).

I have a select statement that uses the SUM function but I had to wrap theat column with a CAST function since the pkg didn't like the SUM by itself ..it was complaining about precision not being set even if I set it in the advance tab..there is help on the forum about that..

Anyway my issue is that I get a


I can click on the preview button and test the statment also it does return a result set. I also copied the sql statement to oracle sql developer and it runs. So I'm not sure why is not running once I execute the pkg in design mode? any suggestions welcome..
remember though I can see the result set in the preview button.

Approach to packages

$
0
0

Hi All,

I'm (very) new to SSIS and I was wondering whether anyone could offer any advice as to the best approach to structuring my ETL process. I'm extracting a number of tables and loading them into a different database. I'd like to be clear as to whether the best approach would be to create a separate package for each table or to do it all within one package? There are about 15 tables (94MB of data).

If you do it all in one package it seems that a failure in the process for one table causes the others to fail, which is obviously not ideal. I'm wondering if the solution is to create separate packages or whether there is something that can be done to isolate each process from the other within the same package? Any thoughts on best approach would be appreciated.

Thanks,

Tom


SSIS JOb Fails when Schduled from SQL server agent with Connection nd Error Error: Source:PKG Name Description: The connection XXXX is not found But executed when run stand alone

$
0
0

HI ,

When I execute a SSIS Package its executes perfectly but when scheduled thru SQL server agent it fails Error  Error:   Source:PKG Name      Description: The connection XXXX  is not found

I am not sure what could be the reason , the SQL server job log in is the same as the SSIS login

Capturing Execution Results

$
0
0

Hi All

When running an SSIS Package from BIDS, we get to see the "Progress" tab which explains us the progress of the SSIS Package. During production, is there any way to capture this log. I am interested in using this as a log file for each run of my SSIS package.

Thanks,

S Suresh

SSIS - Progress Detail / Execution Result Capture

$
0
0

Hello,

I want to capture Progress detail or Execution Results into text file after executing the each package.

Please tell me how to do this?

Appreciated for your help...

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>