Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

configure foreach file container from command line

January 9, 2013, 11:32 am
$
0
0

I have a fairly simple SSIS package that runs fine locally but when I run from a command line, it runs the design time configuration for the source files, evidently because I have a ForEach File container filtering which files to load. I suppose I have to configure the ForEach container from the command line as well.

I have a dtexec command like this, and I use this for other files with only 1 source connection and 1 sql connection, but no ForEach loop.

dtexec /f %DTSPackageName% /Decrypt MyPassword /CONN cm_sql;%cm_sql_USTG% /CONN ffs_raw_file;%SourceFullFilePath% /CONN cm_ffs_FooterFinder;%SourceFullFilePath%

SourceFullFilePathMasked is in the format "C:\Test\MyFileName1.txt" and I have tried "C:\Test\MyFileName*.txt" since there are other files, such as "C:\Test\MyFileName2.txt", etc.

cm_sql is a standard sql connection string and works fine as data does go into the table.

The problem is it is ignoring the ffs_raw_file connection, but it only does this when I have a ForEachFile loop container. Evidently I have to configure that, too. How can I do that?

↧
Search

LOOKUP Operation Painfully Slow on Table With Computed Columns

January 8, 2013, 2:03 pm
$
0
0

I have a LOOKUP component in an SSIS package that performs excruciatingly slow!! The table in the LOOKUP is not large at all - 66,000 rows tops.

When I run it in FULL CACHE MODE it sits forever and does nothing. When I run in PARTIAL CACHE MODE, it gets up to 49,000 rows and then gets hung up. When I run it in NO CACHE MODE, it does eventually complete, but literally takes 10 minutes.

The odd thing is that this particular package used to run completely fine - in a matter of seconds.

The only thing that has changed is the fact that in the table I have added two new columns, both of which are calculated. One of the calculated columns makes use of a UDF.

When I create a copy of the table and remove the calculated columns, it performs fine.

Do calculated columns have that much of an impact on LOOKUP performance??

A. M. Robinson

↧
↧

Regarding passing datetime value as '01/01/2012' to script task having stored procedure in ssis

January 9, 2013, 10:36 am
$
0
0

Regarding passing datetime value as '01/01/2012' to script task having stored procedure in ssis...how to pass value and map it in script task.

Sp name : exec test ?

Paramter is date part only...

↧

How to get the SSIS templates in SQL Server Data Tools

January 9, 2013, 9:56 am
$
0
0

Hello

I had installed SQL Server 2012 Express and over it I installed SQL Server Data Tools. Naturally, the SSIS project templated did not appeared in the Data Tools. Later on, I upgraded the Express edition with a Developer one; and I installed the December release of the Data Tools over it. 

Problem is that the SSIS project templated are still unvailable. What can I do?

Thanks  a lot.

↧

How to deley execute package ?

January 9, 2013, 8:13 am
$
0
0

Hi, 

here is a project has two packages.

1. download files from ftp to local.

2. archive files.

there is a step between 1 and 2.  It has to do something with the files just downloaded. 

so, if 1 package finish, wait one hour, then execute package 2. 

any body have any clues ?

Thank you.

↧
↧

What is the best way to practice SSIS? Derived columns can be in query or better to be in SSIS Package..?

January 9, 2013, 12:27 pm
$
0
0

I am working on a SAS migration project where in need to write large SQL queries.

My question is, can i create the derived columns while writing the query itself

Or shall I create them in the package… ?

Which procedure will improve the performance of my package..

If I prolong my query, due to sub queries the number of Select statements are increasing in my query..

That means the number of times that I am hitting the data base is increasing..

So, instead of that do I need to create the derived columns in SSIS package…

After doing all these things I need to Join with same length of Query…

So I thought to create two datasets completely including derived columns in the query itself

Then latter I want to join them in SSIS package….

Please suggest me which is the best way in my scenario. Creating the derived columns in query or SSIS package…. ??

Thanks & Regards $@m

↧

dtexec ignoring Config file

August 5, 2011, 2:08 am
$
0
0

Hi All,

I had created an SSIS package with package configurations enabled. Since it was created in my local machine, the ConfigFile path is something like: "C:\Docu.......\SSIS_CONFIG.dtsconfig"

Now i moved my package to DEV server and placed the ConfigFile with the SSIS package. My batch script runs the SSIS package dynamically:

dtexec.exe /FILE "K:\SSIS\Ebay\scripts\eBayXML_Load.dtsx" /CONFIGFILE "K:\SSIS\Ebay\scripts\SSIS_Config.dtsConfig"

But the SSIS package keeps on trying to read from the old Config File i.e. "C:\Docu.......\SSIS_CONFIG.dtsconfig" and throws the error The Configuration file name is not valid.

My DEV machine has SSIS 2008 and the package was also developed in SSIS 2008.

I have done exactly the same thing many times with success in SSIS 2005. What am i missing here? Can anyone help please?

Thanks,

Piyush

↧

SSIS package Just fails...not compatible with this version of the DataFlow?

January 9, 2013, 9:39 am
$
0
0

Executed as user: x ...0.00 for 64-bit  Copyright (C) Microsoft Corp 1984-2005. All rights reserved.    Started:  11:27:08 AM  Error: 2013-01-09 11:27:09.74     Code: 0xC0048020     Source: import file import file (DTS.Pipeline)     Description: The version of component "Flat File Source" (1) is not compatible with this version of the DataFlow.  End Error  Error: 2013-01-09 11:27:09.75     Code: 0xC0048020     Source: import file DTS.Pipeline     Description: The version of component "Flat File Source" (1) is not compatible with this version of the DataFlow.  End Error  Error: 2013-01-09 11:27:09.75     Code: 0xC004706C     Source: import file DTS.Pipeline     Description: Component "component "Data Conversion" (773)" could not be created and returned error code 0x80070005. Make sure that the component is registered correctly.  End Error  Error: 2013-01-09 11:27:09.75     Code: 0xC0048021     Source: import file Flat File Source [1]...  The package execution fa...  The step failed.

I am unsure what i am running into here.... Any ideas?

↧
Search

Store 'Merge Join' output Data in a variable

January 9, 2013, 7:30 am
$
0
0

I want to use the 'Merge Join' Output as table with name in variable , so that I can pass this variable to Data flow where I can create XML document.

Is this possible, or there is work around to this.

Thanks in advance.

avm

↧
↧

Question on Dynamic Connection String for OLE DB

January 4, 2013, 5:02 pm
$
0
0

Here is the situation:

 I have a very simple query which needs to be run on say 10 database on  3 servers. Credentials to access to these database are consistent. 

I know I could create 10x3 = 30 connection managers for this task but it just sounds too stupid. 

I'd like to know if there is a solution for me to loop each of these 10 databases, once it's done, move on to the next server and query the next 10 databases until the third one has been covered. 

  Thanks

  Hui

--Currently using Reporting Service 2000; Visual Studio .NET 2003; Visual Source Safe SSIS 2008 SSAS 2008, SVN --

↧

SSIS package won't run as SQL Agent job

January 9, 2013, 2:26 pm
$
0
0

Hello,

I have an SSIS package that writes the results of a query to a flat file.  The package runs within Visual Studio, it runs when deployed to the MSDB database and I run the package, but when I schedule it in a sql agent job it fails with the following error message

Started:  5:02:00 PM  Error: 2013-01-09 17:02:02.12     Code: 0xC020200E     Source: Data Flow Task Flat File Destination [551]     Description: Cannot open the datafile "R:\XXXXXX\FinalReports\BRICLast24Hours.txt".  End Error  Error: 2013-01-09 17:02:02.13     Code: 0xC004701A     Source: Data Flow Task SSIS.Pipeline     Description: component "Flat File Destination" (551) failed the pre-execute phase and returned error code 0xC020200E.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  5:02:00 PM  Finished: 5:02:02 PM  Elapsed:  1.625 seconds.  The package execution failed.  The step failed.,00:00:02,0,0,,,,0

I've granted full control permissions to this txt file to the sql agent service account and my windows account.  The job step that runs the ssis package is run under a proxy I created that uses my windows credentials. I have administrator privileges on the server I run the job from.  I tried a UNC path rather than a drive letter.  I can't think of much more I can try to get this to run as scheduled.  Any info would be greatly appreciated.

Thanks in advance.

↧

How to execute Console app as EXE and get Success or Failure as 0 or 1

January 9, 2013, 10:59 am
$
0
0

Hi,

I am using Visual Studio 2008 and created new "Integration Services Project".

I have one SSIS Package where I need to add one Task to execute one EXE File, which is a separate exe which is developed using VS 2010 as Console Application. So I need to execute that Console Aplication's EXE File, by passing Argument as 1, and also need to know if it was executed successfully and need to return 0 or 1 from that Console Application to SSIS Package so that SSIS Package can know if that was executed successfully then go ahead.

I tried adding "Execute Process Task" but somehow could not understand how to return Value from that Console App to SSIS and also when it executes that task, it displays that Console App Window. I looked some sample code but could not find how to read success or failure value from that executable Console app. 

Can someone help me for two things?

1. how do I get return code from console app to SSIS Package and also if there is any error, want to stop process.

2. Also, it always returns error message "Error: 0xC0029151 at Execute Process Task, Execute Process Task: In Executing "C:\MyFolder\MyExe.exe" "1" at "C:\MyFolder", The process exit code was "-1073741510" while the expected was "0"." Not sure why.

Thanks in advance

Nirav


↧

The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020

January 8, 2013, 4:02 pm
$
0
0

In my SSIS package I have a OLEDB Source in one of the Data Flow Task and "Data Access Mode" is "Sql Command" with the Select statement. When I ran the process after some records were processed I'm getting the below error messages which are not pin pointing to specific errors to fix the issue. I'm having the hard time to figure out the issue. Please help me.

[SSIS.Pipeline] Error: Unspecified error

[OLE DB Source 1 [224]] Error: The attempt to add a row to the Data Flow task
buffer failed with error code 0xC0047020.


[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component
 "OLE DB Source 1" (224) returned error code 0xC02020C4.  The component returned a failure code when
the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component,
 but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this
 with more information about the failure.

↧
↧

SSIS packages failing in SQL Agent job

January 9, 2013, 11:41 am
$
0
0

Hi Team,

Please do help me on this SSIS packages issues.

We do have couple of packages in our environment.  The jobs are failing with the following error when we execute through SQL Agent jobs:

An OLE DB record is available.  Source: "Microsoft SQL Native Client"  Hresult: 0x80040E4D  Description: "Login failed for user 'xxxx'.".

However the jobs are able to run manually through DTSEXECUI.exe.  The SQL Agent has been configured through SQL service account.  In the SSIS we are using the SQL profile.  Please do help me on this.

Thanks in advance!!


 
↧

ADO.NET Destination

January 8, 2013, 10:28 pm
$
0
0
Hi I tried to loading xml into Oracle table using SSIS,
OLEDB destination wont support, so I use ADO.Net Destination,
ADO.NET Destination will load upto some records and then its failing so,I increase the Batch size property of the ADO.net Destination property.

I need One clarification, how to calculate the Correct Batch size, If it is internal buffer size, then how to calculate the Internal Buffer size, and How it relates to batchsize.
↧
Search

Email Dynamic File

January 9, 2013, 4:33 pm
$
0
0

Hi All,

Visual Studio 2008

I have looked at the other postings on this topic and have been unable to get mine to work. I am trying to email an flat file that the name changes everyday. I have already successfully got it to load in to a table using a 'for each loop' container.

Variable:

PoFlatFile,package, string, *.txt

Flat File Connection:

Select file, preview file everything looks good.

ConnectionString: *.txt(changes after originally selecting file)

Expressions:ConnectionString @[User::PoFlatFile]

ForEach Loop Editor:

Folder: D:\xxxx\yyyy\folder where .txt lives

Files: *.txt

Retrieve file name : Fully qualified

Variable Mappings: User::PoFlatFile, Index 0

Send Mail Task(within Loop)

SmtpConnection: connection xxxx

from: valid email address

to: valid email address

subject: abcd

messageSourceType: Variable

messagesource: User::PoFlatFile

priority: normal

Attachments: blank(but after running job it changes to *.txt)

Expressions: FileAttachments, @[User::PoFlatFile]

Then I try to run the package and I get an error message either the file *.txt does not exist or you don't have permissions to access the file.

Well it's not permissions or not existing because I can successfully load the same file using a for loop in another package.

Can anyone help and let me know what I am Missing?

Thanks

↧

dtutil cannot verify that package exists

January 9, 2013, 7:44 pm
$
0
0

Hi All,

I have two SSIS packages, "Package" and "Package1" under MSDB, but when I tried to execute the following command in Command Prompt to see if they exist, the result is negative:

dtutil /sql Package /exists

I got

Error <0xC0014014> while checking......on SQL Server.

The specified package does not exist.

Why is that?  How can I do this correctly to check for their existence (without using the SQL Server Management Studio)?

BI Analyst

↧
↧

Missing data while loading a file in to a column of a table

January 9, 2013, 1:47 pm
$
0
0

For my ETL purposes, I have a file that I want to load to a single column in my table, so that later I could parse the data to get what I want. The file looks like this:

*

**

***

Id 2

Name Jackson

Date when the product was received by the customer Tue Aug 10 16:32:35 2010

End

*

**

After loading this file to a single column in my table, my column is missing some data, I get values like this: 

Column1

*

**

***

Id 2

Name Jackson

Date when the product was received by the customer Tue Aug 10 16:32: (:35 and 2010 is missing)

End

*

**

What can be the reason for that? Why isn't the file getting copied exactly in to the column? Datatype of column is Varchar(Max).


↧

Build Error in SSIS

January 9, 2013, 9:32 pm
$
0
0

Hi all,

I am working on ssis packages i am using sql server 2008 and visual studio 2008. I am using TFS and i have taken the

SSIS Project from TFS into my locan machine and i made some changes and i tried to rebuild the solution. It is giving error saying

Error: Could not get a list of SSIS packages from the project

I am not able to build the project. When i set the property create deployment utility = false then build is getting succeedd and no errors. What might be the problem i am trying to trace it out.

any help and suggessions please...

Thanks

↧

Importing excel sheet into table of DBImporting excel sheet into table of DB

January 9, 2013, 8:16 pm
$
0
0

Hi all,

How to resolve this error , i want to replcae null as "not null ",if so i am getting error msg like below

- Copying to [dbo].[EIPCode] (Error)Messages


Error 0xc0202009: Data Flow Task 1: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.

An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80004005  Description: "Unspecified error".

(SQL Server Import and Export Wizard)

Error 0xc020901c: Data Flow Task 1: There was an error with input column "Debit" (70) on input "Destination Input" (45). The column status returned was: "The value violated the integrity constraints for the column.".

(SQL Server Import and Export Wizard)

Error 0xc0209029: Data Flow Task 1: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "input "Destination Input" (45)" failed because error code 0xC020907D occurred, and the error row disposition on "input "Destination Input" (45)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.

(SQL Server Import and Export Wizard)

Error 0xc0047022: Data Flow Task 1: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Destination - EIPCode" (32) failed with error code 0xC0209029 while processing input "Destination Input" (45). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

(SQL Server Import and Export Wizard)


Thanks


↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>