Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

How to call SAP RFC from SSIS

$
0
0

Hi!!

I´m new with SAP, can you tell me pelase how to call a SAP RFC from SSIS package?

Thanks,


sent mail task parent package

$
0
0

Hi team,

I have parent package under 10 child package

when i run parent package i need child package details list

S.no  Package Name  fail/success Rowcount

1      childpack1           success     100000

2      childpack2           success     2000

3      childpack3           success     30000

4      childpack4           success     15000

...

....

..

i need single email not each package one email

thanks

Shanvitha

Delete and update in different tables using SSIS package

$
0
0

Hi Team

Have data in 3 different databases like Archive, Staging and Live.

Live DB : data from Jan 2006 to Dec 2018

Archive DB :  data from Jan 2006 to Dec 2014

Staging DB :  data from Jan 2006 to Dec 2014

Want to delete data in Live DB which is presents in Archive DB mean need data Jan 2015 to Dec 2018 in Live DB. 

Also have created a one SSIS package, if any one tell this is correct or not

Note : while deleting (it is row by row operation) data in Live DB am updating  DeletedDate as current date in Staging DB 

OLEDB source 1: select * from archive..Table1 - am sorting source level 

OLEDB source 2: select ID  from Live..Table1 - am sorting source level 

Lookup transformation : am using Inner Join and column from Live Table as ID_D

Conditional split : expression - isnull(ID_D) -- here am taking default output as input for OLEDB command 1

OLEDB command 1: Delete from Live..Table1 where ID=?

OLEDB command 2: update Staging..Table1 set DeletedDate=Getdate() where ID=?



After executing this package am getting results but count was mismatch in live and archive DB

For example : 

Before executing package : record count in Achive - 2000 and Live - 45000

After executing package : record count in Achive - 2000 and Live - 44300

Results : It delete one 200 records but it suppose to delete 2000 records in Live DB


Thanks Bala Narasimha

Editions and supported SSIS features of SQL Server 2016

$
0
0
I want to know the differences between SSIS features available in each sql server edition. Also, is there any feature which is not available in sql server standard version?

OData Source Failed Validation

$
0
0

I am using SSIS 2016 and deploying packages at SSIS catalog 2016. We are using OData Source to get data from SharePoint list by giving both User Name/Password and windows Authentication. Package is working fine in Data Tools but when I deploy it on SSIS catalog its failed connection validation.

I have tried following options.

  • Run64Runtime to False
  • check 32 bit Run time at SSIS Catalog when I run the package.
  • Change protection level and try different options e.g storing password in XML file.

Below Diagram will explain well.

immediate help would be highly appreciated.

Thanks in Advance.

Digital Cert

$
0
0

Hi,

What is the use of digital signing of SSIS package? and how it can be done?

is it just to identify its source and encrypt at issuing end that can be de-crypted at using end?

Is it good to use encrypt all with user key or encrypt all with password, instead to securing it using digital signing and encryption..

Or

Can create the pkg normally with DontSaveSensitive and ask at receiving end to open the package and change the property to EncryptAllWithUserKey and use the package with that user only. In this way I do not need to take a path for digital signature.  Here my requirement is simple I want to secure entire package being shipped to receiving server (at customer end) for their use.  


Neil



Getting error column description in a SSIS pkg - SSIS 2014

$
0
0

Hi,

I need to get the description of the error column. It is important I'm working with SSIS 2014.

I'm not interesting to get the error description.

Any suggests to me, please?

Thanks

How to resolve "Microsoft.SharePoint.Client.FieldCalculatedErrorValue" error while retrieving data from Share Point list

$
0
0

Hi There, 

I Am trying to get data from share point list by using SSIS Script component. in that one of the field throwing the error like  "Microsoft.SharePoint.Client.FieldCalculatedErrorValue". How to resolve this? could you please help me.

Thanks in advance!!


Optional feature not implemented Execute SQL Task

$
0
0

I'm having trouble making my Execute SQL Task work. My connection type is ODBC and I connect to Netezza. My SQL Statement works...I ran it in Aginity against Netezza server. The problem I'm having is setting a variables value to the result of the query which I was able to do with an OLE DB connection. 

Right now, I have ResultSet set to Single Row (Just like how i had it for OLE DB) and in the Result Set tab I haveResult Name set to 1 (because I heard that's what you do when you are working with and ODBC connection) and myvariable name is the variable that I want mapped (User::TheFirstDate) which is of typeDateTime and my query returns a type Date 

When I run this, the error I'm getting is this: An error occurred while assigning a value to variable "TheFirstDate": "Optional feature not implemented"

Any help would be greatly appreciated!

ssis, How to connect to Access database?

$
0
0

MS Access database was one of the standard data connections in DTS.  Excel is listed as a scourc/destination, but access is not.  Question:

What is the best connection to use for MS-Access databases for output of data?

We generally process the ETL in SQL server then, export to Access database.

THANKS!!

Dave

SSIS MSBuild - Microsoft.SqlServer.IntegrationServices.Build - 8D7C1236-F3CD-4BCD-BB67-6788D5649EE2 probing problem

$
0
0

Hi,

I have used the CodePlex community sample (https://archive.codeplex.com/?p=sqlsrvintegrationsrv) to build SSIS Integration solutions using MSBuild. The MsBuild extension is the .Net Project named Microsoft.SqlServer.IntegrationServices.Build.

I am only using the build capabilities through the class DeploymentFileCompilerTask, during the execution of the Execute method that generates the ispac file, I have notice that the calls to the method Add of the Microsoft.SqlServer.Dts.Runtime.ConnectionManagerItems class and method LoadFromXML of the class Microsoft.SqlServer.Dts.Runtime.Package, generates an insane lookup in the registry for the following pattern: HKCR...\CLSID...\Implemented Categories{8D7C1236-F3CD-4BCD-BB67-6788D5649EE2}.

In google, a search for this GUID returns nothing.

With Sysinternals Process Monitor, I detected approximately 25 Million lookups in the registry trying to find the above pattern:

Multiple parallel builds of SSIS Solution in our build server cause a big degradation of the machine performance.

Did anyone else had this same problem? How did you mitigate this performance problem?

Thank in advance,

Kind Regards,

Nuno Monteiro

How to resolve "This component has no available input columns."?

$
0
0

My source is OLE DB Source.  I've tested the connection and it's successful. I dropped in the Data Conversion and drag the blue arrow to this Data Conversion. I double click on this Data Conversion and it pops up a window showing the following message. This is my first time learning/creating a SSIS package so any help is much appreciated.

TITLE: Microsoft Visual Studio
------------------------------

This component has no available input columns.
Do you want to continue editing the available properties of this component?

------------------------------
BUTTONS:

&Yes
&No
------------------------------

ODBC Source - Unable to Set Properties through Expressions

$
0
0

I have an ODBC source in which I need to pass the query dynamically. 

When I create the dataflow task and add the ODBC Source, I am unable to see any of the ODBC properties in the expression window. 

Googling this issue I have seen 2 different threads related to this. Unfortunately I am unable to post links/images until my account gets verified. Will edit the post when it does.

Yesterday I updated my VS as well as SSDT to the newest version and the issue persists.

VS2017 - 15.9.6

SSDT - Release number: 15.9.0 Build Number: 14.0.16186.0


Any help would be greatly appreciated.

SSDT 2017 - SSIS Package failed to start

$
0
0

TITLE: Microsoft Visual Studio
------------------------------

Failed to start project

------------------------------
ADDITIONAL INFORMATION:

The directory name is invalid (Microsoft.DataTransformationServices.VsIntegration)

Please help to fix this issue and run the package.

Additional columns in flat file

$
0
0

I am writing a small SSIS package, with 2 steps:

The first step, connecting to my OLE DB Source, I am writing a SQL statement to select 20 columns from a table. The preview looks as I'd expect. Clicking on the properties, in the columns tab, I can see only the 20 columns.

In the data flow to the flat file, in both the metadata and data viewer tabs, I can see my 20 columns, and no more.

In the 2nd step, the flat file destination, in the mappings tab, the destination columns now include all columns from the original table from which I applied my select statement. There are about 100 columns and 80 of them have the value "<ignore>" on the input Column tab (the other 20 are mapped as I'd expect). When I try to right-click on any of the "ignore" rows and select delete, it does nothing (delete isn't greyed out, but clicking on it does nothing)

When I run the package, a flat file is created with all 100 headings and a load of blank data.

Why is the SSIS package retreiving the 80 columns when I haven't asked it to? And how can I stop it? I only want my flat file to contain my 20 columns that I specify.

I'm using SQL Server Data Tools for Visual Studio 2013 (and I'm new to it)


Connection may not be configured correctly or you may not have the right permissions on this connection

$
0
0

Hello,

I have a package in SSIS that loads a flat file into a Netezza server. When I run it locally on my machine, it runs smoothly and without error. However, when I deploy it in SQL Server and execute it with a Server Agent, I get 2 errors:

1) Failed to acquire connection "Connection name". Connection may not be configured correctly or you may not have the right permissions on this connection

2)  SSIS Error Code DTS_E_OLEDBERROR. An
OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available. Source: "Netezza OLE DB
Provider" Hresult: 0x80004005 Description: "Client
unable to establish connection".

In the job step, I went to Configuration > Connection Managers and manually added in the value for the password to connect to Netezza. That still didn't help.

Any help would be great, thanks!

ORA-00907: missing right parenthesis on OLEDB SQL Comand from variable

$
0
0

Hi All, I currently having the same problem as other friend in here but I could not figure out how to fix by its answer.

My problem is that I'm trying to build an Oracle query using an expression in the SQL Command from Variable, but i'm getting the error message ORA-00907: missing right parenthesis. The query is big and I also have looked for a missing parenthesis without success. It runs OK in SQL Developer and also using SQL Command in OLEDB Source with date fixed, it only keeps giving this error using variable.

What a use is 

S.COMPLETED_ON >= TO_DATE('" + (DT_STR, 20,1252) @[User::PARM_LAST_LOADED_DATE_LIMS] + "','MM/DD/YYYY HH:MI:SS AM')

where User::PARM_LAST_LOADED_DATE_LIMS is datatype DateTime = 1/30/2019 6:06:24 PM as example.

Appreciate any help. Thanks in advance.

If needed the entire sql is: 

"SELECT
            ID_AMOSTRA as LGABIDAMT,
            COMPLETADO_EM as LGABDTANA,
            AMOSTRADO_EM as LGABDTAMO,
            TIPO_AMOSTRA as LGABTPAMO,
            LOCOMOTIVA as LGABIDLOC,
            METODO as LGABMETOD,
            ENSAIO as LGABENSAI,
            NVL(UNIDADE_DO_RESULTADO,'N/A') as LGABUNMED,
            RESULTADO as LGABVLRES,

            decode(sign(1-regexp_count(LISTAGG(STATUS2, ',') WITHIN GROUP (ORDER BY STATUS2), '[^, ]+')), -1, '#ERRO CAD ESPEC', NVL(LISTAGG(STATUS2, ',') WITHIN GROUP (ORDER BY STATUS2), '#FORA ESPEC')) AS LGABSTFIM,
            C.NORMAL_DESCRICAO LGABDFNOR,
            NVL(C.ALERTA_DESCRICAO,'N/A') LGABDFALE,
            NVL(C.CRITICO_DESCRICAO,'N/A') LGABDFCRI,
            NVL(NORMAL_LIM_INF,-99) as LGABLINOR,
            NVL(ALERTA_LIM_INF,-99) as LGABLIALE,
            NVL(CRITICO_LIM_INF,-99) as LGABLICRI,
            NVL(NORMAL_LIM_SUP,-99) as LGABLSNOR,
            NVL(ALERTA_LIM_SUP,-99) as LGABLSALE,
            NVL(CRITICO_LIM_SUP,-99) as LGABLSCRI
FROM
            (SELECT
                        ID_AMOSTRA,
                        COMPLETADO_EM,
                        AMOSTRADO_EM,
                        TIPO_AMOSTRA,
                        LOCOMOTIVA,
                        METODO,
                        ENSAIO,
                        UNIDADE_DO_RESULTADO,
                        RESULTADO,
                        case EXP
                          when '>=<' then(case when LIM_INF <= RESULTADO and RESULTADO <= LIM_SUP  then STATUS else '' end)
                          when '+/-' then(case when LIM_INF*(1-LIM_SUP/100) <= RESULTADO and RESULTADO <= LIM_INF*(1+LIM_SUP/100)  then STATUS else '' end)       
                          when '<=' then(case  when (RESULTADO <= LIM_SUP) then STATUS else '' end)                         
                          when '>=' then(case  when (RESULTADO >= LIM_SUP) then STATUS else '' end)                         
                        end STATUS2,
                        R_ID,
                        TEMPL
            FROM
                        (SELECT
                                        s.sample_id ID_AMOSTRA,
                                        s.completed_on COMPLETADO_EM,
                                        s.sampled_on AMOSTRADO_EM,
                                        s.sample_type TIPO_AMOSTRA,
                                        SUBSTR(s.name,1,INSTR(s.name,'-',1,2)-2) LOCOMOTIVA,
                                        r.name ENSAIO,
                                        t.name METODO,
                                        r.formatted_unit UNIDADE_DO_RESULTADO,
                                        ROUND(AVG(r.CALCULATED_NUMERIC_RESULT),2) RESULTADO,
                                        wn2.template TEMPL,
                                        specitem.parameter PARAMETROS,
                                        case regexp_count(specitem.parameter, '[^: ]+')
                                          when 1 then SUBSTR(specitem.description, 1, 2) 
                                          when 2 then decode(INSTR(specitem.description, 'e', 1, 1), 0, decode(INSTR(specitem.description, '+/-', 1, 1),0,'','+/-'), '>=<')
                                          when 3 then '><IS'
                                        end EXP,
                                        REPLACE(SUBSTR(specitem.parameter,1,INSTR(specitem.parameter, ':', 1, 1) - 1),',','.') LIM_INF,
                                        REPLACE(SUBSTR(specitem.parameter,INSTR(specitem.parameter, ':', 1, 1) + 1, LENGTH(specitem.parameter) - INSTR(specitem.parameter, ':', 1, 1)),',','.') LIM_SUP,
                                        DECODE(specgrade.order_number, 1, 'CRITICO', DECODE(specgrade.order_number, 2, 'ALERTA', DECODE(specgrade.order_number, 3, 'NORMAL'))) STATUS,
                                        r.result_template_id R_ID
                        FROM lims_sys.SDG sd, 
                                lims_sys.sample s, 
                                lims_sys.aliquot al, 
                                lims_sys.test t, 
                                lims_sys.result r,
                                LIMS_sys.WORKFLOW_NODE wn1,
                                LIMS_sys.WORKFLOW_NODE wn2,
                                LIMS_sys.SPECIFICATION spec, 
                                LIMS_sys.SPECIFICATION_item specitem, 
                                LIMS_sys.SPECIFICATION_GRADE specgrade
                        
                        WHERE1 = 1
                                        AND sd.sdg_id = s.sdg_id
                                        AND s.sample_id = al.sample_id
                                        AND al.aliquot_id = t.ALIQUOT_ID
                                        AND t.test_id = r.test_id
                                        AND wn1.WORKFLOW_NODE_ID = t.WORKFLOW_NODE_ID
                                        AND wn2.WORKFLOW_ID = wn1.WORKFLOW_ID
                                        AND wn2.name like 'Specification'
                                        AND spec.SPECIFICATION_ID = specgrade.SPECIFICATION_ID
                                        AND specgrade.SPECIFICATION_GRADE_ID = specitem.SPECIFICATION_GRADE_ID
                                        AND spec.SPECIFICATION_ID = wn2.template
                                        AND specitem.RESULT_TEMPLATE_ID = r.result_template_id
                                        AND  NVL(sd.group_id,0) <> 37
                                        AND s.completed_on is not NULL
                                        AND t.status in ('A','C')
                                        AND sd.sdg_template_id = 1092
                                        AND specitem.description is not null
                                        AND s.sampled_on > sysdate - 365 + 1- 1/24/60/60 
                                        
                                        AND REGEXP_LIKE(SUBSTR(s.name,1,INSTR(s.name,'-',1,2)-2), '[:digit:]*-(CP|MD)')  --> added to filter out Compressor or MotorDisel 

                                        AND S.COMPLETED_ON >= TO_DATE('" + (DT_STR, 20,1252) @[User::PARM_LAST_LOADED_DATE_LIMS] + "','MM/DD/YYYY HH:MI:SS AM')
                         
                        group by 
                                        s.sample_id, s.completed_on, s.sample_type, t.name,s.sampled_on,
                                        SUBSTR(s.name,1,INSTR(s.name,'-',1,2)-2), r.name,r.formatted_unit,wn2.template, 
                                        specitem.parameter,
                                        case regexp_count(specitem.parameter, '[^: ]+')
                                          when 1 then SUBSTR(specitem.description, 1, 2) 
                                          when 2 then decode(INSTR(specitem.description, 'e', 1, 1), 0, decode(INSTR(specitem.description, '+/-', 1, 1),0,'','+/-'), '>=<')
                                          when 3 then '><IS'
                                        end,
                                        SUBSTR(specitem.parameter,1,INSTR(specitem.parameter, ':', 1, 1) - 1),
                                        SUBSTR(specitem.parameter,INSTR(specitem.parameter, ':', 1, 1) + 1, LENGTH(specitem.parameter) - INSTR(specitem.parameter, ':', 1, 1)),
                                        DECODE(specgrade.order_number, 1, 'CRITICO', DECODE(specgrade.order_number, 2, 'ALERTA', DECODE(specgrade.order_number, 3, 'NORMAL'))),
                                        r.result_template_id
                        ) 
            ) A

INNER JOIN    (select * 
                                from 
                                            (select DECODE(specgrade.order_number, 1, 'CRITICO', DECODE(specgrade.order_number, 2, 'ALERTA', DECODE(specgrade.order_number, 3, 'NORMAL'))) STATUS,
                                                        specitem.description DESCRICAO,
                                                        REPLACE(SUBSTR(specitem.parameter,1,INSTR(specitem.parameter, ':', 1, 1) - 1),',','.') LIM_INF,
                                                        REPLACE(SUBSTR(specitem.parameter,INSTR(specitem.parameter, ':', 1, 1) + 1, LENGTH(specitem.parameter) - INSTR(specitem.parameter, ':', 1, 1)),',','.') LIM_SUP,
                                                        spec.SPECIFICATION_ID,
                                                        specitem.RESULT_TEMPLATE_ID
                                            from lims_sys.SPECIFICATION spec, lims_sys.SPECIFICATION_item specitem, lims_sys.SPECIFICATION_GRADE specgrade
                                            where 1 = 1
                                                        and spec.SPECIFICATION_ID = specgrade.SPECIFICATION_ID
                                                        and specgrade.SPECIFICATION_GRADE_ID = specitem.SPECIFICATION_GRADE_ID
                                            )
                                pivot
                                            (
                                            MAX(DESCRICAO) as DESCRICAO, MAX(LIM_INF) as LIM_INF, MAX(LIM_SUP) as LIM_SUP
                                            for STATUS in ('ALERTA' AS ALERTA,'CRITICO' AS CRITICO,'NORMAL' AS NORMAL)
                                            )
                                 
                                ) C

ON        C.SPECIFICATION_ID = A.TEMPL and 
             C.RESULT_TEMPLATE_ID = A.R_ID 

group by
                ID_AMOSTRA,
                COMPLETADO_EM,
                AMOSTRADO_EM,
                TIPO_AMOSTRA,
                LOCOMOTIVA,
                ENSAIO,
                METODO,
                UNIDADE_DO_RESULTADO,
                RESULTADO,
                C.NORMAL_DESCRICAO,
                C.ALERTA_DESCRICAO,
                C.CRITICO_DESCRICAO,
                C.NORMAL_LIM_INF,
                C.ALERTA_LIM_INF,
                C.CRITICO_LIM_INF,
                C.NORMAL_LIM_SUP,
                C.ALERTA_LIM_SUP,
                C.CRITICO_LIM_SUP"    

How can I deploy a dtsx package which can run without needing type password in connection management

$
0
0

Dear MS:

   As a beginner, I recently involved in a Legacy database migration project, as I upgraded the dts to dtsx package as guilde, and deploy them to customer, they reported that they are confuse at typing the password each time when running the DTS in SSIS after import the package, Can I fix the password and delivery to them, is there detail instruction guide on that?, your solution will be appreciated, thanks


MSDN Deadlock issue

SSIS Script component not Updating .NET framework after 2012 to 2017 Upgrade

$
0
0

Hi Team,

Currently we upgraded our SSIS packages from  2012 to 2017 version but some of the packages which has script component or script task has failed with below error message.

  Description: CS0234 - The type or namespace name 'SSISScriptComponentEntryPointAttribute' does not exist in the namespace 'Microsoft.SqlServer.Dts.Pipeline' (are you missing an assembly reference?), main.cs, 10, 35”

 “Description: CS0234 - The type or namespace name 'SSISScriptComponentEntryPointAttributeAttribute' does not exist in the namespace 'Microsoft.SqlServer.Dts.Pipeline' (are you missing an assembly reference?), main.cs, 10, 35”

We suspect  that changing the Target framework  to .Net framework to 4.5 inside the script component  would fix the issue but we are unable to change it. When we changed manually, it is still reflecting the existing .NET framework 4 only after SAVE. Could anyone suggest how to change it or  do we need to recreate Script component tasks manually again in the SSIS packages.


Many Thanks

Karthi

How to call SAP RFC from SSIS

$
0
0

Hi!!

I´m new with SAP, can you tell me pelase how to call a SAP RFC from SSIS package?

Thanks,

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>