Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

7Zip Argument for SSIS Execute Process Task

$
0
0

Hi All ,

I am getting this following error when i tried to run 7Zip from execute process task.

[Execute Process Task] Error: In Executing "C:\Program Files\7-Zip\7z.exe" " e C:\Netezza\nzload_sri -G:\SRI" at "", The process exit code was "7" while the expected was "0".

I want a proper expression for 7Zip Argument which should Zip a Folder on C Drive and Zip it in the same folder.

Can any one help.

Thanks


Sri.Tummala


how to remove dirty data from source to staging?

$
0
0

Hi,

I have requirement like ,through ssis pacakge i have to remove dirty data which is present in source .the column is some period which contains 5 characteres data like 20071 but i have to eliminate those kind of 5 characters data and the column should contain only 6 characaters like 200711. This  is urgent requirement,early response is appreciable.


Arun

HTML Formatting using SSIS

$
0
0

Hi Forum ,

I need to do cleanup on a column to display clean data by eliminating the various <HTML> in the source. I would like to do a replace using the charindex, but my query becomes too big and i might miss some tags. What would be the best approach removing the <tags>  or formating  them to display in correct format? .

 

Please give me some example if  we can format data according to the tags using SSIS components.

 

<p><font face="Times New Roman"><span style="font-size: 11pt; ">DAVID BACKER, JR
</span><span style="font-size: 11pt; color: navy; ">L
</span></font><span style="font-size: 11pt; ">
<font face="Times New Roman"> 11111 Erwin 185th Ter <br />Jersey Gardens, NJ 10156

Call a db function that returns string.

$
0
0

Hello,

I have created a db function in SQL Server that checks the data in the monthly file received against the existing data to find any duplicates and based on the result, it returns a string ( 0 or message1 or message2)

From SSIS, what i am trying to do is

If the result of this function is 0( meaning no duplicates), then do all the ETL, however if the result of this function is not 0 then send out an email with a message and abort the package from running further.

The problem that I am having is where/how i can place this logic and based on the output from this function , do other things inside the package

Example

dbo.find_duplicate()

The outcomes are

0 or mssg1 or mssg2

Looks like i need to somehow do it in the Control Flow..Any help would be appreciated.

Looked in Conditional Split. and created two condition  PASS/Fail where the data source is the function call.. the problem is ..it requires a destination whereas i need to run another data flow from there based on the result of the function.Thanks

SQL 2008R2

data conversion error

$
0
0

hi,

i am getting below error

Error: 0xC02020C5 at Data Flow Task, Data Conversion [2]: Data conversion failed while converting column "SUBSTANCENAME" (105) to column "Copy of SUBSTANCENAME" (7).  The conversion returned status value 4 and status text "Text was truncated or one or more characters had no match in the target code page.".
Error: 0xC020902A at Data Flow Task, Data Conversion [2]: The "Data Conversion.Outputs[Data Conversion Output].Columns[Copy of SUBSTANCENAME]" failed because truncation occurred, and the truncation row disposition on "Data Conversion.Outputs[Data Conversion Output].Columns[Copy of SUBSTANCENAME]" specifies failure on truncation. A truncation error occurred on the specified object of the specified component.
Error: 0xC0047022 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Data Conversion" (2) failed with error code 0xC020902A while processing input "Data Conversion Input" (3). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Sort 1" (158) failed with error code 0xC0047020 while processing input "Sort Input" (161). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Merge Join" (80) failed with error code 0xC0047020 while processing input "Merge Join Right Input" (88). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Sort" (143) failed with error code 0xC0047020 while processing input "Sort Input" (146). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

what should i do

Unexpect Line Breaks in Flat File

$
0
0

Hello all,

 We have a clinical ER application that is used to review the necessity and validity of ER claims submitted. We need to export feeds from this application to go into another system, and for the most part the feeds work as expected. However, we have an issue at times with the pipe-delimited file having line breaks that throw off the file structure.

 The database serves a VB.net front end, where users are allowed to type free-text into a field. The users sometimes add multiple separate lines by using the enter key. When the flat file gets generated, those enter keys come out on the flat file. The data in the database shows no enter symbols or newline characters.

 I know we could redesign the VB.net front end to disallow the enter key, but that would take programming, testing, QAing, re-deploying, etc. We would like to strip out these enter symbols on the way out into the Flat File. I have tried searching for newline characters (char(10) or char(13)) and have found nothing. Does anyone know of any way we can strip out these newlines from the database? The notes column is VARCHAR. Thanks!

 Some example data:

 

What the user enters:

Code submitted does not support diagnosis.

Deny PLG.

Dr. John Jones

 

How the field looks when queried:

 Code submitted does not support diagnosis.  Deny PLG.  Dr. John Jones

 

An example of what we would see in the file:

 |00001|John|Doe|Approved. Medical necessity apparent. Dr. Smith|01/01/2012|02/01/2012|

|00002|Jane|Doe|Code submitted does not support diagnosis.

Deny PLG.

Dr. John Jones|02/03/2012|02/10/2012|

|00003|Abraham|Lincoln|Approved. Medical Necessity. Dr. Jane Smith|05/01/2012|06/01/2012|

Stored Procedure with Result Set and OUTPUT parameters in 2005

$
0
0

Hi, I've got a Store Procedure that returns a result set that I need to use in a data flow but that also returns a couple of OUTPUT parameters, in this case the Start and End Dates that the Proc used to obtain the result set.  The Start and End Dates are supposed to be used as part of the CSV file name that it the Output of the Data Flow.

My problem is that I want to both Update some Variables with the OUTPUT parameters and consume the Result Set in the Data Flow.  My attempts to use an OLE DB Command in the data flow have failed to Update the Variables (regardless of the connection type used).  I have tried many combinations and although I could swear I had it working for a brief moment I have not been able to get those OUTPUT parameters to Update the variables.   Changing the datetype of the OUT params from DateTime to Varchar did not work eitehr.

I have only been able to successfully Map to OUTPUT parameters in an EXEC SQL Task in the Control Flow.  However, when I do this I do not know how to pass the Result Set (possibly as an Object) to the Control flow for further processing.

Seems this should be simple to do.  Does anyone have an example or suggestion to do this while keeping things simple and elegant.

Thanks

...Ray


...Ray

Moving/Renaming SSIS Solution has rendered it useless - help

$
0
0

Hello Everyone,

I am a novice SSIS user. I had spent hours creating a SSIS project. I wanted to rename it to a name that make sense so I directly renamed the folder that was named IntegrationService1 to something I wanted and then moved it few folders up. Now when I try to open my package through BIDS it gives me the following error -

"the document cannot be opened. It has been renamed, deleted or moved"

Is there a way to recover my without having re-do it? Please help.

Thanks in Advance



check constraint with ssis

$
0
0

HI,

IN MY TAVBLE I HAVE 1 FIELD WHICH ACCEPT VALUES LIKE 2,3,4

now from my ssis package , some values coming other than that field,so my package gets failed,how to implement check in ssis , i need to see condition if that column has 2 /3/4 then only insrt into database otherwise  not

Name of the generated flat file

$
0
0

Hopefully this is a quick and easy one. I am very green too SSIS and here is my current situation. I have an SSIS package that creates a flat file, there is a variable setup that defines a flat file destination. When I create the XML configuration file it displays the below code. I found where i can change the directory it goes into but for the life of me i can not find how it is creating the actual filename which is "name<currentdate>.txt" and i think that relates to the Properties[Value] below. If anybody has any ideas I would greatly appreciate it.

<Configuration ConfiguredType="Property" Path="\Package.Variables[User::ConnectFileDestination].Properties[Value]" ValueType="String">

SSIS crashes when File.Exists is false.

$
0
0

I'm checking to see if a File exists through a script task. When the file doesn't exist, I was expecting execution to go to the ElseIf, but instead SSIS crashes and the task turns red. this is what I have. What's going on?

If File.Exists(Dts.Variables("gstrMergeFile").Value.ToString()) Then
...

Migration Of MySQL data to MS SQL Server 2008 R2

$
0
0

Hi,

I am loading MySQL data to MSSQL  Server by using SSIS,

1. having ADO.NETODBC connection for MySQL server (ADO.NET:System.Data.Odbc.OdbcConnection)

2. OLEDB Connection for SQL Server ()

I am getting error on "ADO.NET Source" when loading souce(MYSQL) table's data having mysql datatype  "longtext" , I want to push this data into destination(MSSQL) with mapping datatype is "nvarchar(max)".

But It throw direct below error on ADO.NET source

[ADO NET Source [1]] Error: An error occurred executing the provided SQL command: "SELECT PageID,
UserData ,
ImageData,
UnitID,
DateReceived,
DateProcessed,
PageType,
FacilityID,
Processing 
FROM ORDERS WHERE ID= 7;". Arithmetic operation resulted in an overflow.
[SSIS.Pipeline] Error: "component "ADO NET Source" (1)" failed validation and returned validation status "VS_ISBROKEN".

Thanks in advance

Sending mail to more addresses with SSIS 2005

$
0
0

Hi,

I need to implement a SSIS 2005 pkg to send a mail, by using the send mail task, for more addresses. I think to create a table with the username and the related mail addresses, but how can I read row by row this table to value the mail address for the send mail task?

Any suggests to me, please? Thanks

How to insert data in table using variable in Execute SQL Task

$
0
0

Hello Everyone,

I am using Execute SQl task inside for each loop

i am using this query

Insert into student(Name)

values('?')

and than map with Parameter mapping for the varibale comming from for each loop

but it giving me error Kindly suggest the solution how to insert data comming from variable

insert into student(Name)

values(?)" failed with the following error: "Parameter name is unrecognized.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.

Task failed: Execute SQL Task

loop files script component:detect finishing last file read

$
0
0

Hi all,

How do I detect the finishing of reading of last file read in loop for each container

from a script component?

I want to update an external file of some state that was maintained thourgh the loop and should be printed once for all the files of this type in the folder.

For now, I am able to print it each time the script component is called and maintain the state  using variables, but how can I differentiate the end of the last time the sciprt is called so  to not to print the state each time, but only at the end of the run?

The script is currently has the following parts: pre-execute, post-execute, method that creates output rows (with readstream,  loop on lines in file , and try -catch-finally).

I tried to flag the streamreader in a way that  will indicate the there is no additional file

(after having at least one file read) and then to do something in the post execute, but

this doesn't get hit. Maybe something in the container scope?

Thanks a lot


SSIS - 64 Bit - Hundreds/Thousands of connections

$
0
0

Hi - I have the following environment

Windows Server: 2008 R2

Cluster: Yes - 2 Node

SQL Server: 2008 R2 Enterprise SP2.

I have SSIS package that has two data providers

1. Text (for input files)

2. Ado.NET for SQL Server destination.

When I schedule and execute package from SQL Agent Job, the package fails with connection time out and max connections reached. sys.sysprocesses shows over 1000 connections and never closed or reused.

As an alternative - Checked the 32-bit option during execution from the SQL Job and it makes very few connections, re-uses them and works fine.

Can anybody help me out on this?

ANOTHER Environment:

Took the same package and deployed to workstation

OS: WIN 7

SQL SERVER: 2012

Works just fine in 64 bit and has few connections, they are being reused and the performance is 10 times more on desktop environment !

Thanks for your help and input in advance

Unable To Execute a Package Through SQL Agent Job

$
0
0

Hi, 

I have a master package that executes without error in BIDS ( local machine as well as server- bids ). When I try scheduling package through SQL Agent job it keeps failing with the below error. 

Please guide as what might be the possible checks that I need to ensure inoder to execute a package through SQL job. Below is the error that I am getting ..Please advice..

Date 11/3/2012 12:36:37 PM
Log Job History (C1 Load-Main Test)


Message
Executed as user: DS1\ebSQLProxy. ...n 10.50.1600.1 for 64-bit  Copyright (C) Microsoft Corporation 2010. All rights reserved.    Started:  12:36:37 PM  Error: 2012-11-03 12:36:38.55     Code: 0xC0202009     Source: STG_DWEDW_DimProduct Connection manager "cm_DW_EDW"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E4D.  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80040E4D  Description: "Login failed for user 'DS1\bSQLProxy'.".  End Error  Error: 2012-11-03 12:36:38.55     Code: 0xC020801C     Source: Data Flow Task- Load To Stage ole_src - Load from source [1]     Description: SSIS Error CodeDTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "cm_DW_EDW" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.  End Error  Error: 2012-11-03 12:36:38.55     Code: 0xC0047017     Source: Data Flow Task- Load To Stage SSIS.Pipeline     Description: component "ole_src - Load from source" (1) failed validation and returned error code 0xC020801C.  End Error  Error: 2012-11-03 12:36:38.55     Code: 0xC004700C     Source: Data Flow Task- Load To Stage SSIS.Pipeline     Description: One or more component failed validation.  End Error  Error: 2012-11-03 12:36:38.55     Code: 0xC0024107     Source: Data Flow Task- Load To Stage      Description: There were errors during task validation.  End Error  Error: 2012-11-03 12:36:38.55     Code: 0xC00220DE     Source: STG_DWEDW_DimProduct      Description: Error 0xC0012050 while loading package file "D:\SSISPackage\CRM\STG_DWEDW_DimProduct.dtsx". Package failed validation from the ExecutePackage task. The package cannot run.  .  End Error  Error: 2012-11-03 12:36:39.61     Code: 0xC002F210     Source: TQL- Truncate STGChangeQForm Table Execute SQL Task     Description: Executing the query "TRUNCATE TABLE [DFA].[dbo].[Changetable1]" failed with the following error: "Cannot find the object "Changetable1" because it does not exist or you do not have permissions.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.  End Error  Error: 2012-11-03 12:36:39.94     Code: 0xC002F210     ..The step falied

EVA05

SSIS Data Flow task ?

$
0
0

Hello:

I am inserting data in my SSIS Data Flow Task from Source to destination.

In my destination table, i have Identity column & that column is also member of Primary Key.

When i run my data task i get following error as shown below. i am trying to see if i can avoid\remove that ID Column in destination to carry on my INSERT.

I right click on that OLE DB Destination & selected Show Advance Editior - Input & Output Properties -- Ole DB Destination Input -- External Column and from there i can remove that ID Column, but that column again pops up & i get the same error message as shown below.

any help or pointer is greatly appreciated.

Thanks

Error:-

[Final Insert Log - 2 [283]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E2F.
An OLE DB record is available.  Source: "Microsoft OLE DB Provider for SQL Server"  Hresult: 0x80040E2F  Description: "The statement has been terminated.".
An OLE DB record is available.  Source: "Microsoft OLE DB Provider for SQL Server"  Hresult: 0x80040E2F  Description Cannot insert the value NULL into column table  column does not allow nulls INSERT fails

Want to Upgrade .net 3.5 to .net 4.0 on Window 2003 Server SQL Server 2005 will there be any issues to SQL, SSAS and SSRS any issue

$
0
0
Want to upgrade from .net 3.5 to .net 4.0 on Window 2003 Server, are there any issues related to SQL Server 2005 / SSAS / SSRS on that server. I want to do some testing after the upgrade, can some help me with list items to be tested on SQL Server 2005 Functionality

Thanks in advance

Could not find stored procedure 'msdb.dbo.sp_dts_getfolder'.

$
0
0

While executing below command

dtutil.exe /FILE E:\Execute.dtsx /DestServer Testsql5\sql5  /COPY SQL;\Execute /Q

i am getting below error

Error (0xC001404A) while checking for the existence of folder "" on SQL Server.Description: While trying to find a folder on SQL an OLE DB error was encountered with error code 0x80040E14
(Could not find stored procedure 'msdb.dbo.sp_dts_getfolder'.).
Source:

This is not maintenance plan or connect to ssms 2005 to ssms2008 etc.

Regards


Manish

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>