Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Passing Variables to Execute Process Task in For Each Loop Container

August 2, 2012, 8:55 am
$
0
0

Hi ,

I am new to SSIS.

I have execute 3 batch scripts, for this I created a Execute Process Task inside For Each Loop Container,

In For Each Loop:

Collection Section:

Enumerator : For Each Enumerator

Folder :C:\MVNE\BTDB\data_staging\FileValidationScripts

Files:*.bat

Retrive File Name:Fully Qualified option

VariableMapping Section:used this variable

Created a string variable FileName with value "FileValidation.bat"

In Execute Process Task

Executable:C:\Windows\System32\cmd.exe

Working Directory :C:\MVNE\BTDB\data_staging\FileValidation

created an expression with arguments :"-e"+" "+"-o"+" "+ @[User::FileName]+" "+@[User::Source_Name]+" "+ @[User::Path]

I need to pass Source_name and Path to all the 3 batch script.when i tried using 3 Execute process task for each batch script,the script works fine but inside the for each loop its not working.

Is there any wrong in what I am doing ? Please help me.

Thanks in advance.

↧
Search

SSIS package errors while loading delta records.

August 2, 2012, 10:24 am
$
0
0

Hello,

I am getting the following errors, while loading the data into the destination tables.

Please Help me.

Thanks,

Sarika

[Conditional Split 1 [395]] Error: The expression "on "output "Changed Rows" (533)" evaluated to NULL, but the "component "Conditional Split 1" (395)" requires a Boolean results. Modify the error row disposition on the output to treat this result as False (Ignore Failure) or to redirect this row to the error output (Redirect Row).  The expression results must be Boolean for a Conditional Split.  A NULL expression result is an error.

[Conditional Split 1 [395]] Error: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "component "Conditional Split 1" (395)" failed because error code 0xC020902B occurred, and the error row disposition on "output "Changed Rows" (533)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Conditional Split 1" (395) failed with error code 0xC0209029 while processing input "Conditional Split Input" (396). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

[Table Name [16]] Error: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "Table_NM" (16) returned error code 0xC02020C4.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

[Table_NM [31]] Error: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "Table_NM" (31) returned error code 0xC02020C4.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

↧
↧

Inserting Data into two tables when there is reference between two tables

August 2, 2012, 11:32 am
$
0
0

I have two tables

USE Ticket
GO
CREATE TABLE Test1
(
FirstName NVARCHAR(255),
MiddleName NVARCHAR(255),
LastName NVARCHAR(255),
ContactID INT
CONSTRAINT pk_Test1_pid PRIMARY KEY(ContactID)
)
GO
CREATE TABLE Test2
(
ContactID INT,
SalesOrderID INT,
TotalDue MONEY,
CONSTRAINT pk_Test2_sid PRIMARY KEY(SalesOrderID),
CONSTRAINT fk_Test2_sid FOREIGN KEY(ContactID) REFERENCES Test1(ContactID)
)

Trying to insert rows from a flat file

File is very big i am only giving the column headers for reference and there is one to many relationship between two tables

FirstName,MiddleName,LastName,ContactID,TotalDue

What should be the approach to insert data in to two tables using SSIS

Smash126


↧

SSIS Performance vs DTS When Pulling From IBM iSeries

August 2, 2012, 12:02 pm
$
0
0

Hello!

My organization has about 300 DTS packages and I am trying to come up with recommendations for a new ETL tool. One of the options I'm considering (obviously) is SSIS. I have been able to successfully build SSIS versions of a few of our DTS packages, but I'm running into a vexing problem. It seems like the SSIS packages are not running anywhere nearly as fast as their DTS counterparts. For example, one package takes around a minute to run in DTS, but takes between 3 and 5 minutes to run in SSIS.

Admittedly, I am no expert in SSIS but I can't seem to figure out what might be causing the issue. 

In a nutshell, here is what the packages are doing:

1) Deletes current data in SQL server

2) Pulls data from an IBM iSeries AS/400 (about 35,000 rows or so)

3) Loads the data into SQL server

The data we pull from the AS/400 is a join of multiple tables with some WHERE clause criteria. As the data are loaded into SQL, we have many columns where we perform transformations. In DTS these are done as ActiveX script; in SSIS I wrote them as Script components.   

Both the DTS package and the SSIS package are connecting to the AS/400 via an Odbc connection pointing to a system DSN that uses IBM-provided driver. They connect to SQL Server using a system DSN as well, using the SQL native driver (both are using the driver that came with the SQL 2000 instance we installed for DTS - I wanted to keep things as apples-to-apples as possible).

From what bench-testing I could do, it seems the bottleneck may be in the actual select from the AS/400.   Does anyone have any suggestions for a better way to connect to an AS/400 that might yield better performance? (Or if there's something else I should be looking at instead, any guidance would be appreciated.)



↧

FTP Connection Manager Password in Child Package

July 17, 2012, 7:32 am
$
0
0

I have a package made up of several "Execute Package Task" items. The first to execute is a simple package that does some directory preparation and then retrieves files from an FTP site. It works fine run independently, but when the parent package is run it fails in the first child package with the message:

[Connection manager "FTP Connection Manager"] Error: An error occurred in the requested FTP operation. Detailed error description: The password was not allowed.

It seems clear the password in the FTP Connection Manager in the child package is not available when the package is run as part of a parent package. Both the parent and child packages are saved with EncryptSensitiveWithPassword. I have pored through the properties of both the parent and child packages, but am clearly missing something.  What do I need to do to get this to work?

Echo Train Nashville TN

↧
↧

XML File validation using XSD in XMLTask SSIS

August 2, 2012, 8:42 am
$
0
0

Hi,

    I am having an XML FIle that i need to validate against the XSD Schema (Schema.XSD)  in SSIS. I am using the XMLTask.  I am not able to validate the XML Schema. I am getting Type not declared error.

This same XML file is getting validated against the XSD Schema (Schema.XSD)  in BizTalk Server.

Schema.XSD contains  Imports statement which Imports HeaderSchema.XSD as well as DetailSchema.XSD.

The error that i get is  "Type 'http://schemas......................./1.0:Header' is not declared.

in the HeaderSchema.XSD   xmlns = "http://schemas......................./1.0"  with 'Header' as the RootNode.

Can u please let me know how to validate this type of schema.

"Type 'http://schemas.metlife.com/Investments/DataTypes/MetInvEnvelope/1.0:MetInvHeader' is not declared

-Prasad

↧

How to filter records before we load the data into the destination table

August 2, 2012, 7:56 am
$
0
0

I have a staging package where the flow would be as below :

 

1.Data flow :which loads the data from oracle source to SQLServer 2008 destination

2. Execute SQl task -which would validate the data in destination table and that bad data would be notified in the Audit table

But i know have a requirement to filter all the records with that particular key and year where the audits are written and load only the good data to the Staging  table.

 

Can anyone would give inputs as how this can be done.

↧

Run SSIS Package in Microsoft SQL Server 2008 R2 from MVC

August 2, 2012, 7:12 am
$
0
0

Hi,

 can I use MVC to run the SSIS Package in Microsoft SQL Server 2008 R2

Thank you

↧
Search

call an ftp server

August 2, 2012, 5:33 am
$
0
0

hi everybody

I need to send some files using ftp from my SSIS 2008 R2 package.

but I can establish the connection to the ftp server using dial-up connection.

I need to know how I can establish this connection in SSIS 2008 R2.

Regards,

Mostafa

↧
↧

Why are trailing spaces being added to text columns of my OLE DB Source XLSX file?

August 2, 2012, 9:27 am
$
0
0

I'm testing a very simple SSIS package in which I have an XLSX source (connection is OLE DB Source) with a Multicast destination.  I have a data viewer set in between the two transformations.

There is 1 column in the Excel source file with a data type of General that has a maximum of 30 characters.  Upon executing the package, I copied the data from the data viewer and noticed every value in the column in question has a length of 35 characters.  So SSIS is adding trailing spaces to whatever value is in the column.

For example:

"abcdef" becomes "abcdef                             "

Any ideas as to why those trailing spaces are being added?  I checked the source file and the trailing spaces are not there.  Please let me know if I can provide any additional information.

↧

transaction in ssis not expected

August 2, 2012, 10:22 am
$
0
0

Hi,

       I have 4 execute sql tasks(E1,E2,E3,E4. all are connected) in my package.The package transaction option is 'supported' and E1's is 'required' and other 3 are supported.I intentionally made a syntax error in E2 and executed the package.But it is not rollbacking the data which is inserted in E1.What is the reason?If change the package transaction property to 'required',it will rollback. 

So, is it necessary to make the package transaction to 'Required' always?.Can we create multiple transactions in single packages(like E1(required) to E2 and E3(required) to E4) ?


↧

SSIS 2012 Deployment Error

June 25, 2012, 8:24 am
$
0
0

I am attempting to deploy a project to SQL 2012 and receive the security error below.  I have tried the steps listed in this post (http://social.msdn.microsoft.com/Forums/en-US/vstsdb/thread/bd6a985c-0efc-4541-8771-5201ca47f9c8) but it did not resolve the issue.  Any other ideas?  I am server admin and sysadmin on SQL.

-<SummaryReportItem><Message>A .NET Framework error occurred during execution of user-defined routine or aggregate "deploy_project_internal": System.ComponentModel.Win32Exception: A required privilege is not held by the client System.ComponentModel.Win32Exception: at Microsoft.SqlServer.IntegrationServices.Server.ISServerProcess.StartProcess(Boolean bSuspendThread) at Microsoft.SqlServer.IntegrationServices.Server.ServerApi.DeployProjectInternal(SqlInt64 deployId, SqlInt64 versionId, SqlInt64 projectId, SqlString projectName) .</Message><Property>Deploying project</Property><Status>Failure</Status><Value xmlns:a="http://www.w3.org/2001/XMLSchema" i:type="a:string">System.Data.SqlClient.SqlException (0x80131904): A .NET Framework error occurred during execution of user-defined routine or aggregate "deploy_project_internal": System.ComponentModel.Win32Exception: A required privilege is not held by the client System.ComponentModel.Win32Exception: at Microsoft.SqlServer.IntegrationServices.Server.ISServerProcess.StartProcess(Boolean bSuspendThread) at Microsoft.SqlServer.IntegrationServices.Server.ServerApi.DeployProjectInternal(SqlInt64 deployId, SqlInt64 versionId, SqlInt64 projectId, SqlString projectName) . at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection) at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection) at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning() at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj) at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString) at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async) at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result) at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(DbAsyncResult result, String methodName, Boolean sendToPipe) at System.Data.SqlClient.SqlCommand.ExecuteNonQuery() at Microsoft.SqlServer.IntegrationServices.Common.ObjectModel.SqlHelper.ExecuteSQLCommand(SqlStoreConnection storeConnection, CommandType cmdType, String cmdText, SqlParameter[] parameters, ExecuteType execType, Int32 commandTimeout) at Microsoft.SqlServer.Management.IntegrationServices.CatalogFolder.DeployProject(String projectName, Byte[] projectStream) at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeployExportProjectHelper.DeployProject(CatalogFolder folder, Project project) at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeploymentModel.Deploy(CatalogFolder folder, Project project) at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeploymentModel.DeployProject()</Value></SummaryReportItem>

↧

Copy File Operation in SSIS.

August 2, 2012, 9:21 pm
$
0
0

  Hello Everyone.,

            I am trying to do a file copy operation from one directory to other through ssis.  destination and source directories are rows in a  table. Is there any control flow that  can help in accomplishing this task.  I know File system can copy the files but the way I want is it should dynamically read the destination file path from the table and also read the source file path from the table and do the copy operation. I am thinking of using for each container and use variables set the destination and source filepaths but I am not quite sure if that would help me accomplish in what I am trying to do.

Also, as it copies each file, I would also like to update a column in the table, saying whether the copy was successful or not.

If anyone could shred some light, it would help a lot.

Thank you  in advance.

Please mark as 'Answer', if the solution solves your problem.

↧
↧

Don't Save Sensitive - update Connection String in Execute Pacage Utility

August 2, 2012, 4:42 pm
$
0
0

Hi all,

I am currently studying for the 70-452 exam - and trying to understand 'Don't Save Sensitive' vs. Encryption options.

I have setup a test package with an OLE DB connection using an SQL login.

When I deploy to  my SQL server with Don't Save Sensitive - and open the Execute Package Utility > View Connection String. I can see the connection string with no password.

If I deploy using EncryptSensitiveWithPassword  - the Execute Package Utility prompts me for a password when I click on the Connection String menu, I enter the password, I can see the connection string but still  password is not visible.

Therefore, it appears the password in the connection string is never displayed.

Is this correct? What am I missing?

I have signed up to some practice tests from Transcender - here is one of the questions.

.....

If you want to give Joe access to the package without seeing the password in the connection string

a. Change the protection level to DontSaveSensitive

b. Change the protection level to EncryptAllwithPassword

According to my test - both are correct.

Thanks to anyone still reading.....

Cheers.



↧

Lookups Performance

August 2, 2012, 5:38 am
$
0
0

Hii

i am Using SSIS 2005, we having around 80 columns and 900 GB OF DATA and port it into destination table, in between using lookups i have to avoid duplicates and have to insert only NEW Records to destination table and duplicates should be avoided and CHANGED Records Should also inserted, How to Achieve Using Lookups With Best Performance, please help me out.

↧
Search

SSIS doubt

August 1, 2012, 12:37 am
$
0
0

SSIS subject

In a flat file(many records is there( i dont know how many records is there without seeing that flat file )) i want to pick only 3row  how to send that 3rd row to oledb table, can u give suggestion....

↧

Bulk Insert Fails on Last (Empty) Line

August 2, 2012, 10:16 pm
$
0
0
OK, this seems to be a general problem but I can't find any good solutions. I'm using the Bulk Insert task in conjunction with a format file to load data from a standard tab-delmited file. Unfortunately it always fails on the last line (which is empty). I have tried removing the last line from the file and yet it still fails with a truncation/conversion error. I have total control over the file and can format it any way I wish but I simply can't find a format the the bulk insert task won't choke on. If I don't add a blank line, it fails. If I do add a blank line, it fails. I DO NOT want to count the lines in the file so I can pass a number for the -L parameter. Is there an easy way I can make this work? I'm thinking this shouldn't be so hard...
↧
↧

Moving data of table from sorce to destination

August 2, 2012, 10:57 pm
$
0
0

Hi,

I am moving data of a table from source to destination.

Destination table contians all the columns as Source but it has one more column which is not in source and it is NotNull Column.

I am using OLEDB SOURCE To OLEDB DESTINATION To transfer.

please tell me how to do this.

↧

How to Open .csv.gz file

August 2, 2012, 10:47 pm
$
0
0

Hiii

i Have a file of compressed 3Gb .csv.gz file, How to OPen this, can anyone knows pls help me out..

↧

Local SSIS Connection Issue relating to CNAME

August 2, 2012, 7:56 am
$
0
0

We have a server with a host name Server1 with SQL 2k8 R2 database engine and SSIS.  We need to access this server using an alias of "Server2".  So we have created DNS CNAMEs to point to the Server1 A record.  This works locally and remotely for the database engine.  After opening firewall ports and DCOM launch settings for the MsDtsServer, the SSIS service can be connected remotely using Server1, "Server2" and the IP address.  However,  when connecting locally, the SSIS service can be connected with Server1 and the IP address but not "Server2."  When connecting locally with the "Server2" name we get the same error as in

http://social.msdn.microsoft.com/Forums/en-US/sqlintegrationservices/thread/a492920a-ae78-4366-ab6b-746f5f921c59

What needs to be set to allow the "Server2" name to be access locally?

The Computer Shogun

↧
Viewing all 24688 articles
Browse latest View live
Search