Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Data profiling failed. Conversion Overflows

$
0
0

Hi,

I was able to run Profiling task with the previous table. However, after that I tried with a huge table and it showed below error msg.

[Data Profiling Task] Error: Error occurred when profiling the data. The error message is: System.OverflowException:

Conversion overflows.
   at System.Data.SqlClient.SqlBuffer.get_Decimal()

   at System.Data.SqlClient.SqlBuffer.get_Value()

   at System.Data.SqlClient.SqlDataReader.GetValueInternal(Int32 i)

   at System.Data.SqlClient.SqlDataReader.GetValue(Int32 i)

   at System.Data.SqlClient.SqlDataReader.get_Item(Int32 i)

   at Microsoft.DataDebugger.DataProfiling.NullAndStatisticsWorkItem.ProcessReader(SortedList`2 results, IDataReader reader)

   at Microsoft.DataDebugger.DataProfiling.NullAndStatisticsWorkItem.DoWork()

   at Microsoft.DataDebugger.DataProfiling.TablePartitionedBatch.ComputeProfiles()

   at Microsoft.DataDebugger.DataProfiling.BuiltInProfiler.Profile().

Then, I tried the small table again, but the error still exists.

Can anyone give me a clue for this?

Thanks.


Custom Components Installlation

$
0
0

I have spent about a day adding my custom component to the SSIS Toolbox.  I have followed the instructions on MSDN and failed to see the component after refresh. I finally figured out to change installation into the Program Files(x86) instead of Program Files. As I have a variety of BIDS and SSDTs and Visual Studios, how could I define which  Folder I should copy the files to?

Thanks!

date data extration problem in SSIS

$
0
0

Hi All,
I have excel file and having field structure like below
File:
[Brand] [varchar](200) NULL,
[Pack] [varchar](200) NULL,
[Manufacturer] [varchar](200) NULL,
[Division] [varchar](200) NULL,
[ATC1] [varchar](200) NULL,
[ATC2] [varchar](200) NULL,
[ATC3] [varchar](200) NULL,
[ATC4] [varchar](200) NULL,
CU Month/6/2010,
CU Month/7/2010,
CU Month/8/2010 ,
R Month/6/2010,
R Month/7/2010, 
R Month/8/2010 ,
UN Month/6/2010,
UN Month/7/2010,
UN Month/8/2010

i Have   UNPIVOTED this put it in a table 

Table:[CalendarDate] [varchar](50) NULL,
[MapTime] [varchar](200) NULL,
[MapValue] [varchar](200) NULL,
[Brand] [varchar](200) NULL,
[Pack] [varchar](200) NULL,
[Manufacturer] [varchar](200) NULL,
[Division] [varchar](200) NULL,
[ATC1] [varchar](200) NULL,
[ATC2] [varchar](200) NULL,
[ATC3] [varchar](200) NULL,
[ATC4] [varchar](200) NULL,
[Measure] [varchar](200) NULL

in [measure] Column i have  put 
CU Month/6/2010,
CU Month/7/2010,
CU Month/8/2010 ,
R Month/6/2010,
R Month/7/2010, 
R Month/8/2010 ,
UN Month/6/2010,
UN Month/7/2010,
UN Month/8/2010 

column's data with 

SUBSTRING(LTRIM(MapValue),1,2) == "CU%" ? "CUnits" : (SUBSTRING(LTRIM(MapValue),1,2) == "UN" ? "Units" : (SUBSTRING(LTRIM(MapValue),1,2) == "R " ? "Value" : NULL(DT_WSTR,5)))
SUBSTRING(LTRIM(MapValue),1,1) == "R" ? "02" + SUBSTRING(LTRIM(MapValue),8,8) : "02" + SUBSTRING(LTRIM(MapValue),9,8)
 condision 
But problem is [CalendarDate] data is showing like 01 rather than
 01/8/2010 formate and in [Measure] column data is NULL.
Can anyone suggest how to do it?

Thanks

  

How to kill or fail a data flow task to test if the error handling solution will work.

$
0
0

I have a SSIS package where I am executing a data flow task.

I have already implemented a solution in case the data flow task fails for some reason in the middle of operation, but to test if my solution works correctly I need to simulate the condition where data flow task runs half duration and then fails.

In the half duration that it will run it would have inserted some rows in the table. 

I have not been able to find a way to simulate this condition and thus test my solution.

Essentially, How do I fail my data flow task half-way through?

Thanks

How to reject if duplicate records are there in flat file data by checking table data in SSIS 2008 R2?

$
0
0

Hi ,

i got one requirement like

Steps

1. Client will sent one fixed length file on daily basis , we have to load the data into one staging table 

2. then i am running one distributed procedure to distribute the data

3. after that i am moving the file to archive folder.

Note: Up to above points i succeeded.

Requirement:

1. Now while loading new file i have to verify like  if any record existed  in a table then that record need to be reject and then i have to load the data.

how do i verify whether record existed or not in a table by comparing flatfile fixed length data to the table data.


franklinsentil

Can any one guide me lookup and merg join transformation

$
0
0
Can any one guide me  diffrence between  lookup and merg join transformation

Encountered error "Connection "XXXX" is not found" when schedule SSIS package via SQL Server Agent ( SQL Server 2012 )

$
0
0

Hi,

My package only download the data from iSeries to SQL Server table.  So under connection manager, i setup two connections.  One is ODBC connection to iSeries.  The other one OLE DB to SQL Server. 

The package run successfully under SQL Server Data Tools.  I encountered error "Connection "XXX" is not found."  if i scheduled it under SQL Server Agent.  I did try run using DTEXEC also encountered same error.  I did create proxy account to run this DTS where this proxy account link to network account which used to create the package as suggested some of forums.  But it still fails.  

Could someone help me on this?  Any setup i missed out?  

Thanks in advance.



SSIS SQL Server authentication

$
0
0

Hi All,

I have an SSIS package and am using SQL Server authentication to pull data from a few different sources. I am 100% sure that if I deploy the package as is, it will fail when running as a SQL Agent job. What are my options for deploying this package? Is there a way to deploy this package without using configuration file? I can only use SLQ Serer authentication.

Thanks for your thoughts.


handling errors in SSIS 2008

$
0
0
Hi everyone

I'm working with SQLServer Integration Service 2008

I have some questions about handling fails in SSIS:


I have a package containing a data flow task, wich has some data flow sources, transformation, and destination, but without handling error the task stops displaying the error cause in the output window, the error message is very clear, like this: Hresult: 0x80004005 Description: "Violation of UNIQUE KEY constraint ...."

When I try to handle the fails for logging messages, I try to capture manipulating "Oledb destination error output" looking for that error, but that message is hidden and always returns this ErrorCode -1071607685 with the message "Not status is available", and the columnNumber is 0. That is the same for any sql server error occurs.

I need to capture sql server errors from ssis package, code and message, not ssis package errors, this is for logging that messages in a database.

Thanks for any suggestion.

Jose Obregon

ssis data flow item and ssis control flow item tab missing in choose toolbox item from ssdt 2010

$
0
0
ssis data flow item and ssis control flow item  tab missing in choose toolbox item from ssdt 2010

Run ssis packages with another package

$
0
0

Is this best practice to run the ssis packages with another ssis package?

What are the advantages and disadvantages with this method?

Thanks in advance.

Renaming files, Changing one word for another word in the file name

$
0
0

Hi,

Ive got lots of files in different folders

.....Hotfolders\Downloads\A

.....Hotfolders\Downloads\B

.....Hotfolders\Downloads\c

Ect (So I go to Hotfolders and traverse the subfolders.

Within these folders I want to change file names SIN_STAT to SINSTAT (The _ Causes major issues later on in the process.

Is there a way of doing this using File System Task, Rename file?

Thanks in advance of any help

Debbie

Executing A package using command line option type in SQL server agent

$
0
0

Please Experts' advise is urgently needed. 

The Challenge: My package runs well in BIDS but failed when scheduled in agent.

Reasons: [Connection manager "Excel Connection Manager"] Error: SSIS Error Code DTS_E_OLEDB_EXCEL_NOT_SUPPORTED: The Excel Connection Manager is not supported in the 64-bit version of SSIS, as no OLE DB provider is available.

Research/Debugging so far: i have configured the 64 bits runtime to false in package property in BIDS and i checked the box in agent to run the package in 32 bit. No results. 

Presently,  i am working on this hits: to run the package through command line directing to 32 bits since my agent environment is in 64 bits with the path below but the job still failed!!!!!!!

Please help me...... I know the solution is out there.......please tell me if there's anything i am doing wrong.

"C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\DTExec.exe\NewSSIS_Packages\foldername\foldername \package.dtsx

Thanks a lot



BislKenny

Compare/Update Excel values with database tables

$
0
0

Hello community,

I need some help finding a starting point for the following task:
The goal is to compare the values of a Excel table with values in two database tables.

I have Excel files that have this (simplified) structure:
Every files always consists of 30 Excel columns.

Image

Column is always 7 chars long (COL0010) followed by text, number or date values.

The tricky part for me is as follows:
If the column starts with COL00 I have to compare the Excel value with a specific database table (TABLE_A - here, "COL" is called "Field_" plus a number, i.e. "Field_10").
Starting from COL10 a different table is needed (TABLE_B). Where I also need to consider the row number (2 digits).

With compare I mean: If the Excel value differs from the DB-table value then update the DB-table with those values - if not then don't do anything. As you can see above, each row usually requires both table comparisons.

The two DB-tables look like this:
TABLE_A: is only one row for each ID with many columns - meant for the "COL00"comparison.
TABLE_B: can contain several rows for each ID - including a field column, row-number column and the actual value column.

Can I achieve this task with the "board tools" of SSIS or do I need scripts or even a procedure? Do I have to create a temp table for the comparison?

Any ideas, advice on how to get started is highly appreciated.

BTW I can't change the Excel source.

Thank you.


How to check the directory file is exist or not and that file is .txt or not using script task in ssis

$
0
0
Hi,

i need how to check the directory file is exist or not and that file is .txt file or not then that file contains empty or value.
please help me.
please give me the c# script full details for this requirements.

Regards,
Abdul Khadir.

The ORACLE registry key cannot be opened.

$
0
0

Hi All,

I'm using SSIS package to transform the data from oracle to SQL server.  I'm using Oracle Source attunity.

I'm getting the below error. Please help me on this.

[Connection manager "ATG-ORACLE-CONNECTION"] Error: The ORACLE registry key cannot be opened. Verify that the Oracle Client for Windows x64 is installed properly.

Thanks,

Prabhu

The package path referenced an object that cannot be found

$
0
0

I'm getting the error below, just to preface...I do have all my package variables in the package level/scope, could there be another reason as to why this is occurring or other things i should try first?

dtexec /f "D:\SSISPackages\TEST_REPORT.dtsx" /set "\package.variables[User::ReportID].Properties.Value";"95E56F3A-DBEF-4FA1-B3E9-92A4BCB15E42"

Microsoft (R) SQL Server Execute Package Utility
Version 10.50.2500.0 for 64-bit
Copyright (C) Microsoft Corporation 2010. All rights reserved.
NULL
Started:  10:54:02 AM
Warning: 2012-09-20 10:54:02.72
   Code: 0x80012017
   Source: TEST_REPORT 
   Description: The package path referenced an object that cannot be found: "\package.variables[User::ReportID].Properties.Value". This occurs when an attempt is made to resolve a package path to an object that cannot be found.
End Warning
DTExec: Could not set \package.variables[User::ReportID].Properties.Value value to 6A48D31E-3356-41C2-8BA7-A4C73869D5F1.
Started:  10:54:02 AM
Finished: 10:54:02 AM
Elapsed:  0.468 seconds
NULL

How to update records in oracle table using Attunity

$
0
0

Hi,

I want to update a table in oracle based on a primary key.  I'm using oracle destination(Attunity).

Please help me on how to achieve this in oracle destination provided by attunity

Caal function in webservice VB.net

$
0
0

Hi,

I have a VB.net script and added a Webreference to a external webservice (i have the wdsl url).

In the webservice there is a function i want to call, but i cann't figure out how to do this.
The function needs input variables but it is defined in a way i do not understand yet.

This is the function:

<System.Web.Services.Protocols.SoapDocumentMethodAttribute("", Use:=System.Web.Services.Description.SoapBindingUse.Literal, ParameterStyle:=System.Web.Services.Protocols.SoapParameterStyle.Bare)> _
        Public Function findActiveBenchmarks(<System.Xml.Serialization.XmlElementAttribute("findActiveBenchmarks", [Namespace]:="http://benchmark.webservice.finconnect.finan.nl/")> ByVal findActiveBenchmarks1 As findActiveBenchmarks) As <System.Xml.Serialization.XmlArrayAttribute("findActiveBenchmarksResponse", [Namespace]:="http://benchmark.webservice.finconnect.finan.nl/"), System.Xml.Serialization.XmlArrayItemAttribute("return", Form:=System.Xml.Schema.XmlSchemaForm.Unqualified, IsNullable:=False)> benchmarkResult()
            Dim results() As Object = Me.Invoke("findActiveBenchmarks", New Object() {findActiveBenchmarks1})
            Return CType(results(0), benchmarkResult())
        End Function

I seems to refer to a class called FindActiveBenchMarks. This looks liks this:

<System.CodeDom.Compiler.GeneratedCodeAttribute("System.Xml", "4.0.30319.233"),  _
     System.SerializableAttribute(),  _
     System.Diagnostics.DebuggerStepThroughAttribute(),  _
     System.ComponentModel.DesignerCategoryAttribute("code"),  _
     System.Xml.Serialization.XmlTypeAttribute([Namespace]:="http://benchmark.webservice.finconnect.finan.nl/")>  _
    Partial Public Class findActiveBenchmarks
        Private yearField As Integer
        Private yearFieldSpecified As Boolean
        Private sbiField As String
        '''<remarks/><System.Xml.Serialization.XmlElementAttribute(Form:=System.Xml.Schema.XmlSchemaForm.Unqualified)>  _
        Public Property year() As Integer
            Get
                Return Me.yearField
            End Get
            Set
                Me.yearField = value
            End Set
        End Property
        '''<remarks/><System.Xml.Serialization.XmlIgnoreAttribute()>  _
        Public Property yearSpecified() As Boolean
            Get
                Return Me.yearFieldSpecified
            End Get
            Set
                Me.yearFieldSpecified = value
            End Set
        End Property
        '''<remarks/><System.Xml.Serialization.XmlElementAttribute(Form:=System.Xml.Schema.XmlSchemaForm.Unqualified)>  _
        Public Property sbi() As String
            Get
                Return Me.sbiField
            End Get
            Set
                Me.sbiField = value
            End Set
        End Property
    End Class

Can some one help me?

sales are not matching

$
0
0

Hi All,

How do i check why my sales are not matching in view.

Even my fact table and my source table my sale is matching but in my view after joining these two tables

sales are not matching.How should i check it Can anyone suggest.

Thanks

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>