Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Use of Pointer in Data Flow task

$
0
0

Hi Friends

I'm a beginner in ssis.

Can anyone explain the Use of Pointer in Data Flow task (Transformations)


Royal PS


flat fille connection error

$
0
0

hi,

i am getting foloowing error:

Error: 0xC020200E at Data Flow Task, Flat File Source [76]: Cannot open the datafile "C:\Users\emp.txt".

Error: 0xC004701A at Data Flow Task, SSIS.Pipeline: Flat File Source failed the pre-execute phase and returned error code 0xC020200E.


Package Validation Error "The operation could not be completed. (Microsoft.DataTransformationServices.VSIntegration)"

$
0
0

Help

I am trying to execute a package within Visual Studio 2008 Business Intelligence Developer.

However there are no errors, warnings etc. just a dialog that pops up with this message:

Package Validation Error

Additional Information:

> The operation could not be completed. (Microsoft.DataTransformationServices.VsIntegration)

How can I troubleshoot this if there are no errors displayed?


I.W Coetzer

need urgently

$
0
0
hi,

i dont know which component do i need to use for my req.

i have 2 column from my table ,productid and productname
now when file comes, i need to see if productid is match, if yes then if product name is empty then insert productname into productname column in table.

now if both r match just ignore.


what should i use ,i tried lookup but doesnt work

derived column

$
0
0

i have numbe rlike this

51079-216-20

what i need to do it remove - between numbers.also remove last 2 digit

so

it should be like 51079216

not i can have more digit on number also.for example.

3456-435623-45-34

i want to remove last two digit ,no matter what the lenght is and also remove - from it

Data Type in Parameter Mapping for an Execute SQL Task

$
0
0
Hi, I am trying to use an integer as input parameter for my task  I get suck on the parameter data type.

The input parameter is define as @Control_ID variable as Int32 in SSIS. When I got into the parameter mapping of Execute SQL Task, I don't find the Int32 data type. I used to try Short, Numeric, Decimal and so on, but all of those data type didn't work. and it returns the following error message:

SSIS package "DCLoading.dtsx" starting.
Error: 0xC002F210 at Update Control_ID, Execute SQL Task: Executing the query "use DCAStaging

update DCA_HFStaging set
[dbo].[Control_ID] = P0 where [Control_ID] is null
" failed with the following error: "The multi-part identifier "dbo.Control_ID" could not be bound.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.
Task failed: Update Control_ID
Warning: 0x80019002 at DCLoading: The Execution method succeeded, but the number of errors raised (1) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
SSIS package "DCLoading.dtsx" finished: Failure.

Any help?

SSIS Data Conversion from Oracle Data Source bug ?

$
0
0

We've got a strange error in SSIS packages in our production environment that we urgently need help with.

The error occurs after 30.000 to 50.000 rows has been sucessfully loaded in a Data Conversion Task, where we convert Unicode datatypes to non-unicode. Error codes, see below

Our Dev and QA enivronment executes the packages just fine without any errors, as does one of the nodes in our falil-over Cluster. The whole project consists of about 60 Data Flow Tasks.

Our Data Source is an Oracle 11g database that we access by OLEDB: ORAOLEDB.1 Our dev. QA and production environment are almost identical, running Windows Server 2008 R2 and SQL Server 2008 R2, except that in production we have a failover cluster where each node consists of eight processors and 96 Gb RAM. Dev and QA are virtual servers with only 10 gb RAM. The production server already runs several big SSIS jobs without any problems. One of which also has an Oracle 11g data source. There are some Data Conversion Tasks in those jobs, but not as extensive as in the faulty job, and yes I have checked that we run teh same version of the Oracl drivers.

Operating system on all three servers are Windows Server 2008 R2 Enterprise and SQL version is SQL Server 2008 R2

We have ruled out any errors in the Oracle Source data, since it is loaded without fault in dev and QA.

Error Description :

SSIS package "Package1.dtsx" starting.
Information: 0x4004300A at DFT - LOAD KUL_OBSERVATION_ISA, SSIS.Pipeline: Validation phase is beginning.
Information: 0x4004300A at DFT - LOAD KUL_OBSERVATION_ISA, SSIS.Pipeline: Validation phase is beginning.
Warning: 0x80049304 at DFT - LOAD KUL_OBSERVATION_ISA, SSIS.Pipeline: Warning: Could not open global shared memory to communicate with performance DLL; data flow performance counters are not available.  To resolve, run this package as an administrator, or on the system's console.
Information: 0x40043006 at DFT - LOAD KUL_OBSERVATION_ISA, SSIS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at DFT - LOAD KUL_OBSERVATION_ISA, SSIS.Pipeline: Pre-Execute phase is beginning.
Information: 0x4004300C at DFT - LOAD KUL_OBSERVATION_ISA, SSIS.Pipeline: Execute phase is beginning.
Error: 0xC02020C5 at DFT - LOAD KUL_OBSERVATION_ISA, Data Conversion [749]: Data conversion failed while converting column "OBS_ANTALREDSKAPUPPS" (29) to column "Copy of OBS_ANTALREDSKAPUPPS" (779).  The conversion returned status value 2 and status text"The value could not be converted because of a potential loss of data.".
Error: 0xC0209029 at DFT - LOAD KUL_OBSERVATION_ISA, Data Conversion [749]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "output column "Copy of OBS_ANTALREDSKAPUPPS" (779)" failed because error code 0xC020907F occurred, and the error row disposition on "output column "Copy of OBS_ANTALREDSKAPUPPS" (779)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at DFT - LOAD KUL_OBSERVATION_ISA, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Data Conversion" (749) failed with error code 0xC0209029 while processing input "Data Conversion Input" (750). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.
Error: 0xC02020C4 at DFT - LOAD KUL_OBSERVATION_ISA, OLE_SRC - V_DW_OBSERVATION [1]: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.
Error: 0xC0047038 at DFT - LOAD KUL_OBSERVATION_ISA, SSIS.Pipeline: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "OLE_SRC - V_DW_OBSERVATION" (1) returned error code 0xC02020C4.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.
Information: 0x40043008 at DFT - LOAD KUL_OBSERVATION_ISA, SSIS.Pipeline: Post Execute phase is beginning.
Information: 0x4004300B at DFT - LOAD KUL_OBSERVATION_ISA, SSIS.Pipeline: "component "OLE_DST - KUL_OBSERVATION_ISA" (653)" wrote 31311 rows.
Information: 0x40043009 at DFT - LOAD KUL_OBSERVATION_ISA, SSIS.Pipeline: Cleanup phase is beginning.
Task failed: DFT - LOAD KUL_OBSERVATION_ISA

Problem while setting the value of package variable in Execute Package Utility

$
0
0

I have a package that has a config file configured and package variables. This package is executing fine in visual studio. I am trying to execute the package in Execute package utility by setting one package variable.

Please find the command line:

/FILE "C:\Documents and Settings\N023922\My Documents\Visual Studio 2008\Projects\BPSLogsErrorCapture\BPSLogsErrorCapture\bin\Deployment\BPSLogstoDatabase.dtsx" /CONFIGFILE "C:\ErrorCapture\Config\BPSLogstoDatabase.dtsx.config"   /CHECKPOINTING OFF  /REPORTING EWCDI  /SET "\Package.Variable[IsRequestmanager].Properties[Value]";True

Error faced:

TITLE: SSIS Execution Properties
------------------------------

Info: 2012-11-08 11:06:39.26
   Code: 0x40016041
   Source: BPSLogstoDatabase
   Description: The package is attempting to configure from the XML file "C:\ErrorCapture\Config\BPSLogstoDatabase.dtsx.config".
End Info
DTExec: Could not set \Package.Variable[IsRequestmanager].Properties[Value] value to True.


------------------------------
BUTTONS:

OK
------------------------------


Ckecking all the file names from a sftp server if file name exists in table then dont download it.

$
0
0

Hi Everyone,

I am loading a file from sftp to my local directory and then from my local directory to tables, I also have filename table list. once i download all the files to local then i check that filename against filename_table if exixt then dont load it else load it.

My question is ...Is there a way to check only the filename from SFTP from filename_table befor downloading it from sftp.

Currently I am using winscp in ssis to connect to sftp server.

Thanks

Tej

SSIS convert a zero to null

$
0
0

I have a .dat file that is being loaded in SSIS into an SQL table.  There are multiple fields that are specifically designated to be "datetime."  The source data file is for a COBOL system.  The COBOL system has "00/00/00" automatically entered into several of these fields so an end user can see the field is for a date.  Many of these date fields never have anything entered and remain "00/00/00."  In the .dat file, the "00/00/00" is interpreted to be a single zero.  Then, when the SSIS package tries to insert a zero into a date field, SQL interprets that zero to be "2000-01-01 00:00:00.000."  How can I use a derived column to make the single 0 a null before SQL interprets it to be 2000-01-01?  I've combed the web and cannot find a solution to this.  I know it is something like...REPLACE(db_catty_to_date) == 0 ISNULL ? do_nothing_to_field_and_accept_a_valid_date_that_it_contains.  Can ANYONE give me a solution to this?

MANY THANKS!!!


flatfile error

$
0
0
Error: 0xC02020A1 at Data Flow Task, Flat File Source 1 [101]: Data conversion failed. The data conversion for column NAME" returned status value 4 and status text "Text was truncated or one or more characters had no match in the target code page.".

Multiple Select result to a single file

$
0
0

I have had this problem with SQL Server 2000 - DTS package and hoping that SQL Server 2008 - SSIS may have a solution. Our developers have ran multiple select statements in Query Analyzer and sent the result to client who said, HAH, this is what we want on a daily bases. The problem is, How can I automate multiple select queries that ran in Query analyzer and have the result in 1 file and in ANSI format.

I couldn't find a way in DTS package (SQL 2000). So what I did was, created a stored procedure with almost 20 select statements in it and run the Stored procedure from a job and get the result in a file that is in UNICODE format (Job creates the resulting file in UNICODE format only). Then, I have to run a command to change the file from UNICODE to ANSI mode so that client can load the file into where ever they are loading to.

The question is, Is there a way in SSIS package where I can run multiple select statements and get the result in a single file that is created in ANSI format ?

Thank you.

Can I create macros for VSA of SSIS Script Components/Tasks?

$
0
0

Hello all,

Is it possible to write macros for VSA used for Script Components/Tasks?

I have a way handling columns in script component transforms that is used often.  I would like to create a macro that will prompt me for the column name, then insert the default lines of code using that column name.

FYI: I have almost no experience with VS other than using the version of VS/BIDS that came with SQL Server 2005 to create SSIS packages...which doesn't appear to have (please excuse my ignorance) any major programming languages "associated" with it/very limited project template selection...mainly just BI projects.  Most of my coding experience is VBA behind Excel.  Can the macro I'm wanting to create be done in VB Express Edition?  If possible, just give me the major points to start me in the right direction...hopefully I can figure out the rest.

Thanks,

CTB

Query In OLEDB Command

$
0
0

I am using OLEDB command with XML source.The query I am using is :

UPDATE  Table1 SET Table1.STATUS ='12'
from Table1 join Table2 on Table1.REC_NUM= Table2.REC_NUM
where  Table2.FLDCASENUM= ?  

IF I use the same query in SSMS and use a valid value in place of '?' I get expected results but in OLEDB Command in SSIS it gives an error saying "The multi-part identifierTable2.FLDCASENUM could not be bound "

In my XML source I am processing an XML file which has FLDCASENUM values that need to be mapped with TABLE2.FLDCASENUM

Thanks for your time and help.

                                                                                                                                                           

flat file clean up

$
0
0

hi,

i am getting data something liek this in flat file

productid         name          description            schedule

2345-54-324      tylon        Serotonin Reuptake Inhibitor [EPC], Serotonin Uptake Inhibitors [MoA], Atypical Antipsychotic [EPC]

45673434         nepolp       Norepinephrine Reuptake Inhibitor [EPC], Norepinephrine Uptake Inhibitors [MoA]        CI

now i need  only productid,name and schedule

so in my falt file i am using tab as column delimeter,

when i preview data i am seeing something like this

productid      name   schedule

2345-54-324      tylon        Serotonin Reuptake Inhibitor [EPC], Serotonin Uptake Inhibitors [MoA], Atypical Antipsychotic [EPC]

45673434         nepolp       Norepinephrine Reuptake Inhibitor [EPC], Norepinephrine Uptake Inhibitors [MoA]

here schedule value will

null

ci

but instead of it i am getting description value.

i check  my mapping also, everythign is fine.

also, if defind varchar in my table ,does that data type should match with string ,in flat file connection manager.

example:

in table , varchar(6) , flat file connection : string(dt_str) 6

let me know


space ignore

$
0
0

i am getting number like this

0022-23-4567 1

0567-43-5567 4

now i just need number till space only

0022-23-4567

0567-43-5567

how to do that

excel file in different format

$
0
0

hi,

when i am downloading file from site,it save as excel97-2003 worksheet.

when i am trying to open , getting error "The file you trying to open is in different format then specified by file extension.

now this file has so many rows,

if i am trying to save is as excel 97-2003 , i am geeting error , that i will loose some data.

and i am not getting all the rows in this ofrmat.

i need it as a excel file. the file is html ,but store as a xls extension

SQL Job Failed on data type not match

$
0
0

I've a simple data flow task which pulls data from mysql to sql db.  Use DataReader Source, .Net Providers\Odbc Data Provider.  The task runs fine on my machine but it fails when I put in sql job.  Below is error:

Source: import temp_tbl DataReader Source [1]     Description: The data type of "output column "project" (25)" does not match the data type "System.String" of the source column "project". 

The source data type is varchar(max).  In Advanced Editor for DataReader Source, the external column data type is DT_WSTR so I change it to DT_STR but the job still fails.  To further troubleshoot the issue, I only pull the data that is Integer data type and the jobs run fine.  I even use Data Conversion but it still fails.

Really appreciate any inputs.  Thanks in advance.


Ash_

SSIS Standard Package Template

$
0
0

Hi

I am using SQL Server 2008 with BIDS. I have to create an solution with 2 pacakages adhering to industry standards.

Where can i get the sample for creating the solutions which should be used with all the global senarios

I tryed to get adventure works and project real solutions, but i am not finding them more relevent to my requirement as they are very big solutions.

I am already on day 2 of this assignment .. Kindly help me


ShanmugaRaj

Convertion Through derived column in SSIS

$
0
0

Hi all ,

 I have one requirement in my work. that is

source column is(Effective date) like this (string datatype)

1111201
1120101

but my user requirement is convert to this value 201112,201201

Ex:- 110 converts to 2010,- 111 converts to 2011,- 112 converts to 2012 and - 0101 converts to 01,- 0201 converts to 02,- 0301 converts to 03

How to do this through derived column,Please help Him.....


vasu

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>