Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Custom SSIS Component is not calling the PreExecute and ProcessInput Funtions

April 9, 2015, 6:52 pm
$
0
0

Hi every one, 

I created a Transform Component and I noticed that not calling the functions PreExecute()  and ProcessInput() , when debugging actually does not reach these points, one is calling ProvideComponentProperties and Validate:

  [DtsPipelineComponent(DisplayName = "AdapaComponent", Description = "Test Component", ComponentType = ComponentType.Transform, IconResource = "AdapaComponent.Resources.Icon1.ico")]
    public class AdapaComponent : PipelineComponent
    {

        public override void ProvideComponentProperties()
        {
             RemoveAllInputsOutputsAndCustomProperties();

...

}


   public override DTSValidationStatus Validate()
        {
           base.Validate();

....

}

        public override void PreExecute()
        {

....does not reach here

}

     public override void ProcessInput(int inputID, PipelineBuffer buffer)
        {

....does not reach here

}

Anyone know what can it be?

Thanks! 

↧
Search

Validating numeric value in a filename

April 9, 2015, 10:17 pm
$
0
0

I have a file and the filename  should be like ABC_12345_RES_20150410.txt and i have to validate the filename.I am facing problem in validating the numeric value which can change and its length also can change.

I am using the following expression to validate whether its the numeric value /not:

(DT_I4)(SUBSTRING( @[User::FileName]  ,FINDSTRING( @[User::FileName]  ,"_", 1)+1, FINDSTRING( @[User::FileName]  ,"_", 2)-FINDSTRING( @[User::FileName]  ,"_", 1)-1)) == (DT_I4)(SUBSTRING( @[User::FileName]  ,FINDSTRING( @[User::FileName]  ,"_", 1)+1, FINDSTRING( @[User::FileName]  ,"_", 2)-FINDSTRING( @[User::FileName]  ,"_", 1)-1))

This statement is failing the package when i am entering a character instead of digit.. But i don't want the package to fail rather i just want to log the exception in this case.

Is there any other way to validate the numeric Value?

Many Thanks in Advance!

↧
↧

failure on ssis daily job

January 29, 2015, 11:02 pm
$
0
0

Hi,

  one package is in production, that package runs daily at 6 pm ist, but yesterday job failed because of network failure, how should i load yesterday data in destination

↧

Email notification

June 5, 2014, 9:49 am
$
0
0

I have an SSIS package to send email notifications to certain people...

So, whenever there is a new entry to the db, it will send a link to a report which reflects the newly added entry...

The package is scheduled to run once every hour...

Now, whenever there is a new entry within the last hour it sends email notifs

If there are 2 entries, there are two mails

that is where the problem lies...

I want it to send a single mail with all the links for records received within the last hour...

This is my SQL for the execute SQL task:

Select 'http://diagaitssrs01/ReportServer/Pages/ReportViewer.aspx?%2fIIST%2fInformatix_FEP%2fDetailsRep&DoccID=' 
+ convert(varchar,DOC_ID) LinkTest from
dbo.v_FEP
where v_FEP.DOC_ID IN
(Select v_FEP.DOC_ID
from dbo.v_FEP
where
v_FEP.SUB_DATE between dateadd(hour,-1,getdate()) and getdate())


Dhananjay Rele

↧

SSIS package getting stuck when running through SQL agent

April 8, 2015, 11:03 pm
$
0
0

Hello all,

I have a issue where my SSIS package is getting stuck when running through SQL agent. SQL agent runs through a domain account. To troubleshoot what i did is, I logged in using SQLagent account on server and ran the package manually from Visual Studio which completed successfully. So I am not sure what is wrong here.

Environment is : SQL 2008 R2(X64) on Windows 2008R2 Std(X64)

The job gets stuck and does not log anything nor does it fail.

SSIS experts please advise and let me know if you need any further details.
↧
↧

Debug Script tasks on 64 bit machine?

April 2, 2015, 11:16 am
$
0
0
Why can I not set a debug breakpoint in a script task on a 64 bit box? Is there something I need to add to allow this?
↧

Loading Multiple excel sheets in to different tables in a DB

November 21, 2007, 4:57 am
$
0
0

 

Hi All,

 

I have problem in loading multiple excel sheets data in to according to that excelsheets tables in a DB.

All the excel sheets are in a folder,from that folder i have to  acces all excel sheets.

For this i am unsing script task and one dataflow task.

But the error is coming in script task i am not able to put the path in the script..

 

Is this the correct way to do like this? Or any other way?

 

Can u please tell me the solution for this..Thanks in advance who are responding to this mail...

 

Maruthi..

↧

schedule data load from cube to relational database

April 10, 2015, 5:01 am
$
0
0

Hi,

I have a sales cube from which i want to populate data into relational database automatically on daily basis. It worked with static initialization of date field. To automate it needs to populate data automatically using SSIS package with the help of MDX query. 

Thanks,

Vivek Singh

↧
Search

#TempTable Creation and use throughout my SSIS Package

April 7, 2015, 12:58 pm
$
0
0

I know I've done this before but for the life of me I cannot get this to work.

I am creating a #TempTable to house my Email Message.

USE	[msdb]
GO

IF	Object_ID('TempDB..#TempTable_Files_EMail_Message')	IS NOT NULL	DROP TABLE [#TempTable_Files_EMail_Message]
;

CREATE TABLE [dbo].[#TempTable_Files_EMail_Message]
(
	[MailID]				INT				PRIMARY KEY,
	[EMailMessage]			[VARCHAR](MAX)
)
GO


Then I have my FTP Task to go out and get my FTP files and then a Script Task to get the count of files and then expression constraints which will update my #TempTable_Files_Email_Message via Execute SQL Tasks...one to update my #TempTable_Files_Email_Message if there are files and one if there are not. Each with the following...(Altering the text accordingly)

USE [msdb]
GO

UPDATE [dbo].[#TempTable_Files_EMail_Message]
SET  [#TempTable_Files_EMail_Message].[EMailMessage] = [#TempTable_Files_EMail_Message].[EMailMessage] + '<br>FH Files were indeed found on the Secured FTP Site!'
WHERE [#TempTable_Files_EMail_Message].[MailID]  = 1
;

I have also checked the DelayValidation property on each Execute SQL Task to True

Am I missing something here? When I try executing my package, it's creating my #TempTable fine, it is handling my script and constraint fine and is failing when trying to Update my #TempTable.

Error: 0xC002F210 at Execute SQL Task - Append Email FH FIle Exists, Execute SQL Task: Executing the query "
UPDATE [dbo].[#TempTable_Files_EMail_Mess..." failed with the following error: "Invalid object name '#TempTable_Files_EMail_Message'.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.
Task failed: Execute SQL Task - Append Email FH FIle Exists

Any help is GREATLY appreciated!

Thanks!

↧
↧

Deploying Analysis Services Project Failed to encrypt sensitive information

April 10, 2015, 5:51 am
$
0
0

Hi!

 I had a problem on a server when trying to implement a project analysis services and I get the error:

"Failed to encrypt sensitive information. Perhaps the encryption key is inaccessible due to incorrect change the service account"

I have no idea how to solve this problem and where to get it.

can anybody help me?

Thanks in advance...

Akala

↧

Consuming Web Services in SSIS Script Task

April 10, 2015, 1:42 am
$
0
0

Hello

Sorry for my English, I' ll try to explain my problem.

I am new to SSIS. Using this article http://blogs.msdn.com/b/dataaccesstechnologies/archive/2010/01/28/consuming-web-services-in-ssis-script-task.aspx I have tried to consume web service.

1. I have created proxy class using VS Command Prompt

2. A have added proxy class to Script Task

3. But when I  want to create the instance of the proxy class, it can be accessed from the ScriptMain.cs. 

I will be very pleased for the help!

↧

SSIS Web Service Complex Type Inputs

May 21, 2007, 10:28 am
$
0
0
Hi,

I am trying to make a call to a third-party web service in my SSIS package.  The request has custom complex data type as the parameter.  As has been pointed out in this forum before, the Web Service Task only lets you assign the outside parameter from a variable, not the internal parameters needed to create the complex data type. 

To be more specific, the web service input wants a 'ContactSearchRequest' parameter.  I can assign this from a variable.  If I click on the 'value' field under the 'Input' section for the web service task, it shows me that the 'ContactSearchRequest' data type is made up of the following:

contactId - long
numResults - int
offset - int
passKey - string
searchParam - string
sortType - int

Unfortunately, I can't assign these internal parameters from a variable, at least not through the web service task interface.

My next thought was to create a variable of type 'object' and then set it in a script task prior to calling the web service task.  However, I'm not sure exactly how to do this.  How will my script know about the class definition of 'ContactSearchRequest'?  Do I just create a class called 'ContactSearchRequest'?

I've used this same web service in a .NET C# project and after I imported the web service, visual studio knew all about the custom data types.  How do I do something similar in SSIS?

Of course, the easiest solution would for Integration Service to allow me to set those internal parameters via variables, but we're apparently not there yet.

Any suggestions?

Thanks,
Trey
↧

Help Passing Complex Variable Types to a Web Service Task

February 23, 2007, 7:47 am
$
0
0

I need a little help here and appreciate any insight into this issue.

I am building an SSIS package that retrieves data from a database to use in a web service task. So let me give you a little more broad overview of the package so you can understand how this is supposed to roll. A database is queried and those values are dumped into a recordset. A foreach loop uses each row of variables to call the web service and dump the returned values to another database. The first database holds a bunch of fields, but the four fields of interest are: a StartDate (DateTime), a StartFormat (single char), an EndDate (DateTime) and an EndFormat (single char). The output from the query of the first database is the input in the signature of a web service's .Load method. Sounds easy, right?  Sure, why not?

Well I dragged the Web Service Task on to the pane and took a look inside. Lo and behold, I can hardcode the variables in for the web service or I can assign the inputs to package variables. How fancy, thanks Microsoft!

But that's where the difficulty begins. The method call for the web service looks like this:  service.Load(string, int, GTTimestamp1, GTTimestamp2). The web service is expecting a string, an int, and two objects of the type GTTimestamp, which is a very simple class defined as this:

<System.Xml.Serialization.SoapTypeAttribute(

"GTTimestamp", "http://util.gtdw.pci.com")> _

Public

Class GTTimestamp

Public calendar AsDate

Public displayFormat AsString

End

Class

In the input pane for the Web Service, when I click in the value of the two GTTimestamps like I'm going to hardcode them in, another window pops up saying "Enter the values for complex type -in4" and the pane looks exactly like the previous pane with one very important exception: There is not place to check to assign the value from a package variable!!! Dang you Microsoft!!! I don't really understand why they would leave us out to dry on this... Oh, well, maybe they'll take care of it later...Time to work around it.

SSIS does allow you to create a variable of type System.Object, so after playing with the Web Service for a few minutes and giving up on that, I decided to create a script task that is supposed to create two GTTimestamp objects and assign them to two object variables in the package for passing to the WebService Task. The first challenge was to get the web service to play nice with the script. For those who have never done this, use a command prompt and the wsdl.exe to generate a .vb or .cs file to add to your script file using the right click, add existing item...

Once the file was accessable to my scripts, I created two GTTimestamp objects and assigned them to the Package variables of type System.Object. Running the package, I got this error:

"Microsoft.SqlServer.Dts.Tasks.WebServiceTask.WebserviceTaskException: Could not execute the Web method. The error is: Type 'ScriptTask_8c868490237b4220b582bdc7c7a3ecae.GTTimestamp' in assembly 'VBAssembly, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null' is not marked as serializable.

Not marked as serializable, huh. Okay, so I made the GTTimestamp serializable by adding the <Serializable()> before the class declaration. Then the error changed to:

The error is: Type is not resolved for member 'ScriptTask_8c868490237b4220b582bdc7c7a3ecae.GTTimestamp,VBAssembly, Version=0.0.0.0, Culture=neutral, PublicKeyToken=null'.

And here I am, at a loss for what to do from this point. I'm a little lost, so I thought I'd stop and ask for directions. I'm sure I'm not the first to want to use complex variable types.

Only two options at this point. One is to try and store the GTTimestamp in the database and see if SSIS can deal with that. I'm not sure how to store objects in a database or if that is even an option for me, but it came to mind so it made it into this post. The other is to get this to work through the script above that I have run into a wall.

Again, any help is appreciated. Thanks for your time.

↧
↧

Address Cleaning with SSIS

April 10, 2015, 7:32 am
$
0
0

Hi Experts,

I have 6 columns (Addr1, Addr2, Addr3, Zip, City and State) which has data as below. As you can see any column can have any data with comma separated values. I want to find Zip, City and State from these 6 columns (if available) using SSIS. What would be the best approach to achieve the result?

ADDR1ADDR2ADDR3ZIPCITYSTATE
MOBILETEXASXNA
.,TENNEFX99999NA
ABC,ORLANDO FLORIDAX
.260,ABC,WINCHESTER37398NA
6214WPQR,GREENDALEAZ85306NA
11233,HWY 19,XYZFORIDA32348XNA
400GRAHAM XNA
APT 19DEF,ST. LOUISXNA

Thanks in advance for your help!

↧

Pulling .xlsx files from Sharepoint Using ssis

April 10, 2015, 3:34 pm
$
0
0

Hi,

         I need to create package to pull the .xlsx files from sharepoint and load into another server and make the package automated everyday. I was not familiar with SSIS stuff. I came to know it can be done by using file task and FTP, but not able to figure it out the configuration setting that should be used in the tasks.

                        Can anybody suggest the procress for this task?

Thanks,

Sri Harsha.

BALUSUSRIHARSHA

↧
Search

SSIS 2012 - OLEDB connection (Source) to Flat file (Destination)

April 10, 2015, 11:40 am
$
0
0
Hello everyone,

I'm trying to export the data from SQL database to Flat file.

The data gets exported to the destination but it does not contain the header columns.
Can anybody advise how to get the header columns in flat file?

Thanks,
Ankit

Thanks, <b>Ankit Shah</b> <hr> Inkey Solutions, India. <hr> Microsoft Certified Business Management Solutions Professionals <hr> http://ankit.inkeysolutions.com

↧

SSIS 2012 - How to add too many columns roughly 345 as output columns for Script Component

April 10, 2015, 7:38 am
$
0
0

Hello everyone,

Is there any way to quickly setup output columns for Script component?

I've 342 columns in my flat file source and would like to use them in  script component. What is the fastest way to do so?

Instead of adding them manually at Script component.

Thanks,

Ankit

Thanks, <b>Ankit Shah</b> <hr> Inkey Solutions, India. <hr> Microsoft Certified Business Management Solutions Professionals <hr> http://ankit.inkeysolutions.com

↧
↧

SQL Error Data Flow Task 1: The buffer manager detected that the system was low on virtual memory...

April 9, 2015, 8:05 pm
$
0
0

I'm relatively new to SQL and this is the error that appeared when I tried importing my data. Not sure how to deal with this. Help please. Thanks a lot!


Information 0x4004800c: Data Flow Task 1: The buffer manager detected that the system was low on virtual memory, but was unable to swap out any buffers. 14 buffers were considered and 14 were locked. Either not enough memory is available to the pipeline because not enough is installed, other processes are using it, or too many buffers are locked.

↧

Web Service Task - that accepts XmlNode Input

April 10, 2015, 1:21 pm
$
0
0

I'm creating an SSIS package that uses a web service method called "GetReportResults" ). The input parameters are:

  • username (string)
  • password (string)
  • reportid (int)
  • templateValues (xmlnode)

When I run the package, how do I input the values for the xmlnode? The web service documentation shows an example that says I need to pass in the templateValues (filters) like this for the xmlnode:

<FilterItems><FilterItemFilterItemId="62898"FieldTitle="Date Modified"Operator="GreaterThan"Value=""IsTemplate="true"/><FilterItemFilterItemId="62899"FieldTitle="Date Modified"Operator="LessThan"Value=""IsTemplate="true"/><FilterItemFilterItemId="62900"FieldTitle="Date Modified"Operator="GreaterThanOrEqualTo"Value="8/13/2013 12:00 AM"IsTemplate="false"/><FilterItemFilterItemId="62901"FieldTitle="Status"Operator="DoesNotContain"Value=""IsTemplate="true"/></FilterItems>

How do I go about setting this up so that when the package runs the templateValues are automatically input? Is there some sort of XML task that will accomplish this? If so, how would I implement this.

↧

Removing date from file name

April 11, 2015, 5:08 am
$
0
0

Hello,

Is there any way to move all the file from one location to another and remove the datepart from filename.

for eg:- if file name is abc_20150411.xls change to abc.xls. if file name does not contain date part then ignore it.

Can any one suggest if its possible.

Thank You

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>