Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Attunity Teradata Source v2.0 Fails due to connection issues and package hangs

January 22, 2014, 12:07 am
$
0
0

Hi All, I am using Attunity V2.0 drivers to fetch data from Teradata and import into SQL Server. Everything works fine but there are intermittent network disconnection issues to the Teradata source and in that case the Teradata source fails, but the package keeps running and appears to be hung when monitoring from SQL Agent.

I have set the properties of Fail Parent on task failure but still the package doesnt fail  (hangs) as shown in the figure above. Any ideas on how to get the package to fail in this case? Is this an issue with the TeraData Source rather than SSIS?

Side Question - In SSDT I can see the number of rows extracted realtime, but is it possible to get the same kind of real time monitoring of record count when the pacakge is deployed on to the SSIS Catalog and being run through Agent. I believe it is possible but do not know the kind of logging and reporting mechanims provided by the SSIS Catalog. Any pointers to this will be appreciated.

Thanks, Ashish Singh

↧
Search

Dynamic columns with Excel Source?

January 22, 2014, 2:02 am
$
0
0

I have Excel file number 1 with columns A ja B.
I have database table with columns A,B,C,D,E,F,G,H etc. (there are 100 columns)

I know how to import normally data with Excel Source and OLE DB Destination with Excel file 1.

Now I have new need.
I should be able to import dynamically Excel files with any combination of columns.
It should be automatic import with For Each Container.
When new files like below is imported, I should not be make any changes to SSIS.

Excel 2) Columns A, G, X (so column A data must be added to column A in database etc)
Excel 3) Columns B, C, G, Y (so column B data must be added to column B in database etc)
Excel 4) Columns D, X

IS THIS POSSIBLE WITH SSIS? HOW?

CUSTOM CODE IS NEEDED? ANY POINTERS TO SOLUTION?

Kenny_I



↧
↧

Why so many connection providers for database ?

January 21, 2014, 11:37 pm
$
0
0

I see several connection types for databases - OLEDB, ADO, ADO.NET etc. AFAIK, ADO.NET has a convenient and easy to use API in scripts. Also, if you want to retainSameConnection inside a .NET script, its easier to use a ADO.NET result set rather than OLEDB as mentioned here - http://stackoverflow.com/questions/11867639/connect-to-sql-database-inside-script-task-in-ssis

Then why do we have so many types of DB connection managers ? Why not choose the most superior one and have only that ? One reason could be that .NET might not be installed on target machines. If yes, then are there any valid reasons for not installing .NET on target machines ?

 

↧

SSIS 2008 - Master Package

January 22, 2014, 9:24 am
$
0
0

Hi,

I am developing an SSIS 2008 project.

The project is to copy data from 7 tables on one server to 7 tables on another.

Each table query shares the same parameters.

What is my best option in 2008 development? Should I create a separate package for each table data copy, and pass variable from master package to each of those packages?

Or should I contain all in a single package?

I want to be able to run the table data queries simultaneously.

Thanks.

↧

SSIS Package execution error from powershell

January 22, 2014, 12:41 pm
$
0
0

Hi I have written a powershell script to exec SSIS packages. I am passing variable values at runtime by reading it from a text file.

But it throws an error.

Here is my script.

#Read Data from Parameter File
#---------------------------------------
$variable=Get-Content D:\Batch\Bin\ETLParameters.txt
$variable.GetType()
 
 $dest_conn_str=$variable[1]
 $mail_cc=$variable[2]
 $mail_from=$variable[3]
 $mail_str=$variable[4]
 $mail_to=$variable[5]
 $pkg_path=$variable[6]
 $ps_exe_path=$variable[7]
 $ps_script_cmd=$variable[8]
 $ps_script_path=$variable[9]
 $src_conn_str=$variable[10]
 $src_sys_id=$variable[11]
 

#Executing SSIS packages from command prompt
#------------------------------------------------
$cmd = 'dtexec /f "' + $pkg_path + 'pkg_ntas_all.dtsx' + '"' + ' /SET \Package.Variables[User::src_conn_str].Properties[Value];"' + $src_conn_str + '"' + ' /SET \Package.Variables[User::dest_conn_str].Properties[Value];"'+ $dest_conn_str + '"' + ' /SET \Package.Variables[User::src_sys_id].Properties[Value];"' + $src_sys_id + '"' + ' /SET \Package.Variables[User::pkg_file_path].Properties[Value];"' + $pkg_path + '"' + ' /SET \Package.Variables[User::mail_str].Properties[Value];"' + $mail_str + '"' + ' /SET \Package.Variables[User::mail_from].Properties[Value];"' + $mail_from + '"' + ' /SET \Package.Variables[User::mail_to].Properties[Value];"'+ $mail_to + '"'+ ' /SET \Package.Variables[User::mail_cc].Properties[Value];"' + $mail_cc + '"' + ' /SET \Package.Variables[User::ps_exe_path].Properties[Value];"' + $ps_exe_path + '"' + ' /SET \Package.Variables[User::ps_script_path].Properties[Value];"' + $ps_script_path + '"' + ' /SET \Package.Variables[User::ps_script_cmd].Properties[Value];"' + $ps_script_cmd + '"'  
 ##################################
$cmd
DECLARE @returncode int
EXEC @returncode = xp_cmdshell @cmd

Types of error that I get -

If I run the $cmd directly. Which is the concatenated string of dtexec command with parameters. It doesn't do anything, not even an error and the pwoershell execution just completes.

If I use exec EXEC @returncode = xp_cmdshell @cmd    ----- Then it throws me the error that the exec is not recognized name of cmdlet.

Please help as I a noob in any kind of scripting.

↧
↧

SQL Server Job that were written in SSIS packages failed

January 21, 2014, 5:01 pm
$
0
0
could not load package files system because of error 0x80070002. Description: could not find file 'C:\program files\microsoft SQL Server\100\DTS\Binn\. The package could not be loaded. The step failed. I found this error on one of my job configured in ssis packages which take a view statement from my production server, which actually is in a cluster environment. Thank you guys
↧

SSIS Job that exports data to a flat file using a view

January 22, 2014, 10:25 am
$
0
0

Dear Expert DBAs

I have a job in my environment written in ssis which exports data to a flat file using a view. The job has five steps and the first step usally takes about max 3 minutes. Starting from a few days ago it is taking 1:30 minutes. we checked the view run it by itself works great. we updated the statistics works great. we run the job on the dev environment and the problem still exists. there is no locking or blocking problem we checked that too. i am just wondering what could be the problem? any ideas or similar experiences please guys? i really appreciate it.

↧

Substring over varchar(max) using SSIS

January 22, 2014, 1:01 pm
$
0
0

Hi,

 I´m facing the next issue: our data source provides a table with a column with varchar(max) datatype (it comes from a BLOB oracle column source system). The content of this column it´s actually string (html text generated by an editor) over which we need to apply some sort of substring to remove undesired characters (the infamous Byte of Mark -BOM-). Unfortunately neither SSIS functions or T-SQL functions can do a substring on a varchar(max) content, so I imagine that I will need some kind of programatically approach creating a custom function. Has anyone done something similar?

Thanks in advance

↧
Search

Slowly changing fact?

January 22, 2014, 9:08 am
$
0
0

Hi,

I have a fact table that can change over time a number of ways.  The reporting output is pretty simple, it just needs to represent what the value is now, and not have to worry about point in time analysis.

My system has an Order and an Invoice.  The invoice is simple, once it has been created, it can only be changed via a credit note (already got that in place - nice and easy). 

My proposed fact table needs to have the lowest level of grain to the order line level.  The problem here is that lines can be added, deleted, quantities changed, discounts changed, prices changed.  So currently i retrieve all order lines from my source system, then execute a merge statement to identify the rows and update any changes or handle deletes.  The problem is that it isnt so efficient and i don't know if its the right way to approach this task.  However i dont know any other way to do it, if there is any other way.

Edit: just as a side note here also, i don't have any CDC ability on my source system, literally just have to grab all rows and perform a business key match.

I am hoping somebody can give me a heads up or some advice.

Thanks in advance,

Dom


↧
↧

basic Script Task (without using Web Service Task or an HTTP Connection ) where I can include the credential certification and allow me to inyect the code CSOM.Net

January 22, 2014, 10:21 am
$
0
0

Hi all

Is there any available basic Script Task (without using Web Service Task or an HTTP Connection ) where I can include the credential certification and  allow me to inject this code in  CSOM.Net  (sharepoint client library) that download the last modified file from sharepoint 2010?

I have installed sharepoint clien library (sharepoint 2010), ssis 2008r, VStudio 2010.

The CSOM.Net code  that allow to indetify  the last modified file from sharepoint 2010 :
>>code start <<

ClientContext clientContext = new ClientContext("your site"); 
Microsoft.SharePoint.Client.List spList = clientContext.Web.Lists.GetByTitle("Document Library"); 
clientContext.Load(spList); 
clientContext.ExecuteQuery(); 

if (spList != null && spList.ItemCount > 0) 
{
   Microsoft.SharePoint.Client.CamlQuery camlQuery = new CamlQuery(); 
   camlQuery.ViewXml = 
      @"<View>  <Query> <OrderBy><FieldRef Name='Modified' Ascending='FALSE' /></OrderBy> </Query> <ViewFields><FieldRef Name='FileLeafRef' /><FieldRef Name='Modified' /></ViewFields> <RowLimit>1</RowLimit> </View>";  

   ListItemCollection listItems = spList.GetItems(camlQuery); 
   clientContext.Load(listItems); 
   clientContext.ExecuteQuery(); 
}

>>code end <<

CRISTINA& MICROSOFT Forum



↧

Connecting to Sybase through SSIS

January 22, 2014, 1:49 pm
$
0
0

Hi,

Can some one tell me the process how I can connect to a Sybase RDMS using SSIS.

Thanks,

Nagesh.

--------This links are not any useful to me--------------

http://social.technet.microsoft.com/wiki/contents/articles/ssis-with-sybase-connectors.aspx

There is further few article which gives you more information.

http://www.fixbug.in/article-zone/item/11-creating-ssis-project-with-sybase-iq-152-using-oledb-connection

http://forums.databasejournal.com/showthread.php?48244-Sybase-Connection-in-SQL-2005-SSIS-Project

↧

SQL query returns value but EXEC SQL Task fails to assign variable

January 22, 2014, 10:32 am
$
0
0

I have an execute SQL task to get an identifier from an Oracle database and assign it to a variable (the variable is used in subsequent query's where clauses to transfer the data to a SQL Server database). If I copy the query from the SSIS package to the Oracle SQL Developer interface and run the query; I get the expected single identifier. If I run the execute SQL task I get the error "[Execute SQL Task] Error: An error occurred while assigning a value to variable "VariableName":"Single Row result set is specified, but no rows were returned."

I can create phony/simpler versions of the query that will return the wrong identifier that will successfully assign the value to the variable, so the problem isn't with the variable itself or the way the result set is set up in the task (Result Set/Single Row in the General panel; Result Name 0/VariableName in the Result Set panel).

How can two queries that return a single value produce different results with respect to the variable assignment process?

 

↧

Visual Studio 2012 and SSDT 2012

December 26, 2013, 9:43 am
$
0
0

Hello and Happy New Year!

I have been using BIDS for a long time. We just upgraded our Visual Studio to 2012. I also just downloaded SSDT for 2012. Is there a doc anywhere or Blog that says how to import the BIDS 2008 SSIS Projects? I don't really know where to get started.

Thanks
Mike

Mike Kiser

↧
↧

data comparion expresion in conditional split

January 22, 2014, 2:52 pm
$
0
0

I have a date filed comparing with another date field like:

expression: 

(ISNULL([StartDate])?" " :(DT_WSTR)([StartDate])) != (ISNULL([StartDate_dest])?" " :(DT_WSTR)([StartDate_dest]))

example : value of Startdate: 2012-10-11 00:00:00.000

Error message: 

[Conditional Split [1089]]: Attempt to parse the expression "(ISNULL([StartDate])?" " :(DT_WSTR)([StartDate])) != (ISNULL([StartDate_dest])?" " :(DT_WSTR)([StartDate_dest]))" failed. The expression might contain an invalid token, an incomplete token, or an invalid element. It might not be well-formed, or might be missing part of a required element such as a parenthesis.

Error at SubscritionService 1 [Conditional Split [1089]]: Cannot parse the expression "(ISNULL([StartDate])?" " :(DT_WSTR)([StartDate])) != (ISNULL([StartDate_dest])?" " :(DT_WSTR)([StartDate_dest]))". The expression was not valid, or there is an out-of-memory error.

Error at SubscritionService 1 [Conditional Split [1089]]: The expression "(ISNULL([StartDate])?" " :(DT_WSTR)([StartDate])) != (ISNULL([StartDate_dest])?" " :(DT_WSTR)([Sub_StartDate_dest]))" on "Conditional Split.Outputs[Case 2]" is not valid.

Error at SubscritionService 1 [Conditional Split [1089]]: Failed to set property "Expression" on "Conditional Split.Outputs[Case 2]".
↧

SSIS file create file is corrupted on server but good from pc

January 14, 2014, 1:07 pm
$
0
0
Still in development so running from VS 2008 not from Integration Services.  The package extracts from SQL to create a file in FTP site.  When I run the package from my pc all is well. But, when I run on the server I get "_x003C_none_x003E_4989_x003C_none_x003E_" for the value in every column and row. The row count seems to match, so I would assume the extract sp is good, but not the file creation.  I'm wandering about an encoding difference between the server and the pc.
↧
Search

Nothing related to SSIS working

January 22, 2014, 8:07 am
$
0
0

It started happening out of nowhere, I did not install or uninstall anything..and started getting this error

Retrieving the COM class factory for component with CLSID {AA40D1D6-CAEF-4A56-B9BB-D0D3DC976BA2} failed due to the following error: 800700c1.

CLSID is related to dts.dll. and as per some other posts I have re-registered it. Repaired my SQL Server installation (which would have repaired SSIS as well). Reinstalled vs2008 with sp1.

but this problem is not going away..

any help would be appreciated!!!!

Thanks

↧

SSIS Auditing on Table

January 22, 2014, 4:55 pm
$
0
0

Hi 

I need to record insert & update changes made to a SQL 2005 table with no primary key, is this possible? The logging events in SSIS seem related purely to validation, execution and errors.

Thanks

↧
↧

Execute package task is not able to pickup the package to execute it from a Foreach Loop Container

January 22, 2014, 9:29 pm
$
0
0

Hi,
I want to execute 5 packages using EXECUTE PACKAGE Task in FOR EACH LOOP Container. I followed the instructions as per the below link
http://microsoft-ssis.blogspot.in/2013/01/master-child-packages-part-1-file-based.html

When I execute the main package it is going to folder where i have that 5 packages and picking up the first one then it is not completing the package keep on executing the same.

What i need to check here, kindly help me here.

Regards,
Sridhar V

Sridhar

↧

Not able to run the SSIS package in SQL Server Agent Job in SQL 2012

January 23, 2014, 2:26 am
$
0
0

Hi,

I scheduled a job (SQL SERVER AGENT) which will call my SSIS package. This package will execute 5 packages in loop.
When I execute this job I am getting error as below
============================================================
Started  : 12:30:19 PM 
Error  : 2014-01-23 12:30:20.37    
Code  : 0xC00220EC    
Source  : Execute Package Task     
Description : Error 0x80070005. Failed to create an instance of empty child package.
    The Distributed Component Object Model (DCOM) configuration or the installation of SQL Server Integration Services,
    may be corrupted on your machine.  End Error 
Error  : 2014-01-23 12:30:20.37    
Code  : 0xC00220DE    
Source  : Execute Package Task     
Description : Error 0x80070005 while loading package file "D:\SSIS\RetailMobileApp\Staging_Pkg\stg_Category_Master.dtsx". Access is denied.End Error 
DTExec  : The package execution returned DTSER_FAILURE (1). 
Started  : 12:30:19 PM 
Finished : 12:30:20 PM 
Elapsed  : 1.123 seconds. 
The package execution failed. 
The step failed.
============================================================

In the STEPS I have selected as follows:
Type  : SQL Server Integration Services Package
Run as: SQL Server Agent Service Account
Package Source: File System

What config I need to check here ? This job is not able to access the package stored in the folder.

Sridhar

↧

Attunity Oracle Source - select with a parameter

September 3, 2009, 2:52 am
$
0
0
Hello,
I have verified the good performances of the Attunity Oracle Source component and for this reason I would like to use it.

The problem is that the query I have to execute needs a parameter.
Indeed I am using this Data Flow inside a Loop.

Is there a way to use a query with a parameter?
Is it possible to keep the sql from a variable that is changed dinamically?
Is it possible to keep the sql from a file that contains the sql ?
Does a workaround exist?

Thanks

Antonio
↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>