Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Sort transformation drops rows?

May 21, 2019, 2:22 pm
$
0
0

While debugging an SSIS package (SQL 2017 target, VS 2015 with SSDT), I noticed that one of the Sort transformations apparently "lost" about 85% of all the records - and the "Remove rows with duplicate sort values" is Unchecked.  Out of 471,226 rows in to the Sort transformation, only 66,899 are reported to be passed to the next transformation (a Merge Join). 

I think I saw that this (Sort -> Merge) may have been an issue in 2008, but I don't recall seeing anything more recent.

What gives?

(My VS shows the following:)

BI Developer Extensions v2.1.1 for Visual Studio 2015 - An add-in to extend SQL Server Data Tools

Microsoft SQL Server Data Tools 14.0.61712.050

Microsoft SQL Server Integration Services Designer
Version 14.0.1000.169

↧
Search

post json to web service

May 21, 2019, 9:13 pm
$
0
0

I need to post a json for a webservice in SSIS, Looks like I need to use script task ,can you point me to couple of examples.

the response is json.

I showed the code that I use in https://forums.asp.net/post/6262895.aspx specifically for the .Net code.

This post is related to SSIS where I plan on incorporate the code, but if you have any other idea please let me know.

Thank you,

↧
↧

Connection manager usage

May 16, 2019, 7:29 am
$
0
0

Hello

I have a package that uses multiple connection managers.  The package has 9 containers, each of which have 1 or more data flow tasks.

I need to know which connection manager is being use in each task, two are due to be replaced

Is there an easy way to do this besides manually go through each task or trying to read the xml file?

Thanks

Roy

↧

Numeric arithmetic causes truncation when my aplication

May 16, 2019, 12:41 pm
$
0
0

I have the next error in the log in my aplication when it try to insert data into Data Base  Microsoft SQL Server Enterprise: Core-based Licensing (64-bit)

ClassName":"System.Data.SqlTypes.SqlTruncateException","Message":"Numeric arithmetic causes truncation.","Data":null,"InnerException":null,"HelpURL":null,"StackTraceString":"  at System.Data.SqlClient.TdsParser.TdsExecuteRPC(SqlCommand cmd, _SqlRPC[] rpcArray, Int32 timeout, Boolean inSchema, SqlNotificationRequest notificationRequest, TdsParserStateObject stateObj, Boolean isCommandProc, Boolean sync, TaskCompletionSource`1 completion, Int32 startRpc, Int32 startParam)

Thank

Adixon

↧

Convert datetime format

May 22, 2019, 6:56 am
$
0
0

how to convert varchar column using SQL Query?

May 24 2017 12:00AM to 2017-05-24 00:00:00

I am getting 2017-05-24 00:00:00.000. I dont want last three zeros
↧
↧

how can i use cast function inside merge sql statement for example

May 22, 2019, 7:45 am
$
0
0

merge update 

      ,(CAST(tgt.LastSaleDate as datetime2(0)) = src.LastSaleDate)

this comes as an error in update 

↧

No Authentication

May 22, 2019, 8:55 am
$
0
0

Hi Guys, 

I am making an API call from script task using this:

           var webRequest = WebRequest.Create(uri);
           webRequest.Headers["Authorization"] = "Bearer " + token;
            webRequest.Method = "GET";
            webRequest.ContentType = "application/x-www-form-urlencoded";

However, there is no authentication for the url, please I need help on how to set the Authorization.

Thanks

me

↧

Expression Builder Syntax

May 22, 2019, 9:30 am
$
0
0

I know I've asked this before...I just cannot for the life of me find my thread

What is the Expression Builder Syntax in SSIS and SSRS? Is it VB? VBA?

↧
Search

SSIS File System Task Move File Could not find part of the path error

September 12, 2013, 3:01 am
$
0
0

Hi All,

I am getting error in production when try to move files from one folder to another folder. But on Dev environment working fine. 

An error occurred with the following error message: "Could not find a part of the path 'C:\Archive\ABC.txt'

My package configuration details.

1) For Each loop Container 

           Prop’s:

Enumerator: For Each File Enumerator

Folder: C:\

Files: *.txt

Retrieve File name --> Fully qualified 

In Tab Variable mapping: User::name --0

2) File System task

Props:

           Destination Connection: c:\archive\

           Overwrite destination: True

           Operation: Move file

Is Source Path Variable: True

Source Variable: User::name

Please share your suggestions on this.

Regards,


Vaishu

↧
↧

Expression Builder Syntax Help to replace \ with /

May 22, 2019, 10:02 am
$
0
0

So I have my fully qualified path name derivation which properly pumps the data file into the proper location. I now want to reference that same file location within a [dbo].[sp_send_dbmail] Email Message Line.

So my Global Variable is...

\\Qualifier\apps\Region\Client\File Name.csv

I know in order to incorporate this file location within the Email HTML it has to be...

<a href="file//Qualifier/apps/Region/Client/File%Name.csv">Sample File</a>

So I am struggling with the syntax and I think because "/" is an escape character. Also, I need to REPLACE the <blank> with "%20" so that renders fine as well.

Can someone please help me with the double-REPLACE syntax on this?

Thanks for your review and am hopeful for a reply.

↧

How do I provide the

May 22, 2019, 10:30 am
$
0
0

So my Syntax in the Execute SQL Task is...

UPDATE[dbo].[##TempTable_846_Inventory_File_Email]
SET[##TempTable_846_Inventory_File_Email].[EmailMessage]=[##TempTable_846_Inventory_File_Email].[EmailMessage]+
'<p>There were <b><u>' + ? + '</b></u> 846 Inventory Records found for Client <b><u>' + ? + '</b></u> thru Date ' + ? + '. Archive Data File <b>'+ '<a href="file:' ? + '">Inventory 846 File</a>' + '</b> was created and is located in Archive File Share!</p>'
WHERE[MailID]=1

The 5th Parameter after '<a href="file:' ? is where it is choking. I am successfully replacing the Variable file 5th parameter with forward slashes"/". 

Am I taking on too much here?

Is it getting confused because of the embedded "?

Has anyone done something similar where the file name is derived and then included within the Email using the <a HTML tag?

↧

Error when Download the wsdl file in Webservice Task

October 17, 2018, 11:06 pm
$
0
0

1. I create a new HTTPConnection, add the url https://myurl/service?wsdl provide the credential and add the certifcate. And click test connection. It said "Succefully".

2. I create a new Web Service Task. Choose the HTTPConnection, provide a empty wsdl file and set override to True, and then Click the download wsdl. Then I got an error.

How Can I solve it?

TITLE: Web Service Task
------------------------------

SSL certificate response obtained from the server was not valid. Cannot process the request.


------------------------------
BUTTONS:

OK
------------------------------

↧

How to store a decimal value 2.53 as 2.53 in excel using ssis 2014?

May 22, 2019, 12:55 pm
$
0
0

I have a table in which I have stored a decimal value which is like 

2.54

1.56

now when I want to plot in excel I have converted it to numeric in SSIS DATA CONVERSION task but when I open excel after data generation it shows 

2

1

The decimal places are not getting plotted .

When I open the excel it show a message " The number in the cell is formatted as text "  and also the number is stored as text message displayed when I click the cell.

SSIS 2014

sql server 2014

EXCEL DESTINATION used with 2007 VERSION .




↧
↧

SSIS Connection to SAP OData v4

May 15, 2019, 8:36 am
$
0
0
Hi Experts,

I have a SSIS to SAP  HANA XSA OData v4 issue, which i have been struggling for a while. Looking for your valuable suggest.

1. We have no issue when using web browser or postman to the odata services (both v4 and v2). Details for v4:

--Collection URL: https://hxehost:51028/catalog/

OData Service Log: 

5/14/19 10:43:18.000 PM [RTR] OUT   192.168.56.1 - - to hxehost:51028 "GET /catalog/ HTTP/1.1" 200 sent 152 in 20 by 010-045569cd-c7b2-4770-8475-f518001482c1

Collection:

{
    "@odata.context": "$metadata",
    "@odata.metadataEtag": "W/\"l4Y9nfxmXiS3w2Lh6W7806U2/5vwswKjb0opSMPEy18=\"",
    "value": [
        {
            "name": "BookInfo",
            "url": "BookInfo"
        }
    ]
}



--Metadata URL: https://hxehost:51028/catalog/$metadata

OData Service Log: 

5/14/19 10:41:52.000 PM [RTR] OUT   192.168.56.1 - - to hxehost:51028 "GET /catalog/$metadata HTTP/1.1" 200 sent 2305 in 43 by 010-045569cd-c7b2-4770-8475-f518001482c1

Metadata:

<?xml version="1.0" encoding="utf-8"?>
<edmx:Edmx Version="4.0" xmlns:edmx="http://docs.oasis-open.org/odata/ns/edmx">
    <edmx:Reference Uri="https://oasis-tcs.github.io/odata-vocabularies/vocabularies/Org.OData.Core.V1.xml">
        <edmx:Include Alias="Core" Namespace="Org.OData.Core.V1"/>
    </edmx:Reference>
    <edmx:Reference Uri="https://oasis-tcs.github.io/odata-vocabularies/vocabularies/Org.OData.Measures.V1.xml">
        <edmx:Include Alias="Measures" Namespace="Org.OData.Measures.V1"/>
    </edmx:Reference>
    <edmx:Reference Uri="https://oasis-tcs.github.io/odata-vocabularies/vocabularies/Org.OData.Capabilities.V1.xml">
        <edmx:Include Alias="Capabilities" Namespace="Org.OData.Capabilities.V1"/>
    </edmx:Reference>
    <edmx:Reference Uri="https://oasis-tcs.github.io/odata-vocabularies/vocabularies/Org.OData.Aggregation.V1.xml">
        <edmx:Include Alias="Aggregation" Namespace="Org.OData.Aggregation.V1"/>
    </edmx:Reference>
    <edmx:Reference Uri="https://wiki.scn.sap.com/wiki/download/attachments/462030211/Analytics.xml?api=v2">
        <edmx:Include Alias="Analytics" Namespace="com.sap.vocabularies.Analytics.v1"/>
    </edmx:Reference>
    <edmx:Reference Uri="https://wiki.scn.sap.com/wiki/download/attachments/448470974/Common.xml?api=v2">
        <edmx:Include Alias="Common" Namespace="com.sap.vocabularies.Common.v1"/>
    </edmx:Reference>
    <edmx:Reference Uri="https://wiki.scn.sap.com/wiki/download/attachments/448470971/Communication.xml?api=v2">
        <edmx:Include Alias="Communication" Namespace="com.sap.vocabularies.Communication.v1"/>
    </edmx:Reference>
    <edmx:Reference Uri="https://wiki.scn.sap.com/wiki/download/attachments/448470968/UI.xml?api=v2">
        <edmx:Include Alias="UI" Namespace="com.sap.vocabularies.UI.v1"/>
    </edmx:Reference>
    <edmx:DataServices>
        <Schema Namespace="CatalogService" xmlns="http://docs.oasis-open.org/odata/ns/edm">
            <EntityContainer Name="EntityContainer">
                <EntitySet Name="BookInfo" EntityType="CatalogService.BookInfo"/>
            </EntityContainer>
            <EntityType Name="BookInfo">
                <Key>
                    <PropertyRef Name="ID"/>
                </Key>
                <Property Name="ID" Type="Edm.Int32" Nullable="false"/>
                <Property Name="copiesSold" Type="Edm.Int32"/>
            </EntityType>
        </Schema>
    </edmx:DataServices>
</edmx:Edmx>



2. SSIS Connection Manager (ODATA_TEST). There is no issue. We can test it successfully, either apply authentication or not at the odata backend. Here is the log from OData services.

5/14/19 10:49:33.000 PM [RTR] OUT   192.168.56.1 - - to hxehost:51028 "GET /catalog/ HTTP/1.1" 200 sent 152 in 9 by 010-045569cd-c7b2-4770-8475-f518001482c1



3.  We have issue when it comes to SSIS OData source.

--When select the created OData Connection Manager, it returns error "Unable to load collection for the connection ODATA_TEST, reason: Cannot open this connection".  The log shows that SSIS sent metadata request , and the odata services returned 2305 bytes with successful status 200. Same info as in Postman or Web Browser. 

5/14/19 10:52:38.000 PM [RTR] OUT   192.168.56.1 - - to hxehost:51028 "GET /catalog/$metadata HTTP/1.1" 200 sent 2305 in 7 by 010-045569cd-c7b2-4770-8475-f518001482c1



--When select "Resource Path", it has error "An error occured when detect the document payloadkind". Detail error message go to "Microsoft.SqlServer.ManagedDTS). The odata log shows it just sent request to /catalog.

5/14/19 10:53:37.000 PM [RTR] OUT   192.168.56.1 - - to hxehost:51028 "GET /catalog/ HTTP/1.1" 200 sent 152 in 5 by 010-045569cd-c7b2-4770-8475-f518001482c1



Thanks in advance any information.

Lester


↧

How to merge two columns into one column

May 22, 2019, 4:09 pm
$
0
0

We have Visual Studio 2015. We have a flat file source (CSV) with two columns that we want to merger into one column in the SQL Server table. The two input columns are "Fans (LIfetime)" and "LinkedInFollowers". The column in SQL is "Fans (Lifetime)". Basically we want to Merge the LinkedFollowers data into the Fans (Lifetime) data. This is the data source we are using. The data conversion step of for a date field conversion. Looked at Merge and Union All as possible ways to do this but no luck.

↧
Search

SQL Equal expression in ssis derived column

May 22, 2019, 6:12 pm
$
0
0

Hi ,

I am looking for an equal derived column expression in ssis to convert below sql query.

  select dateadd(ms, -3, convert(datetime2,CONVERT(date, getdate())))  

↧

ssis No "Expressions item" in Properties when modify Connection Managers item

May 8, 2017, 5:43 pm
$
0
0

fellow a online training to test SSIS, the link is here in step3 no.2 


the article https://msdn.microsoft.com/en-us/library/ms166797%28v=sql.120%29.aspx?f=255&MSPPError=-2147217396

show it should show an item Expressions in Properties panel, but I can't find it in my VS 2015 Shell, only like following:

https://drive.google.com/file/d/0B5F_qaK8bYV3RXdtd1U4ZVVoa2M/view?usp=sharing

test enviroment is following:

WINDOWS2012R2
MS SQL 2016 WITH SSIS SSAS
SSDT 14.0.60923 WITH VS2015 SHELL

THANK AND BLESSING

(BTW, WHY I CAN'T PUT IMAGES AND LINK HERE?)




↧
↧

Performance issues using SSIS Unpivot component

May 23, 2019, 3:46 am
$
0
0

I am using SSIS and have the need for Unpivoting 60+ columns. This is causing extreme performance issues, is there a way to tune this to increase performance? Anyone that knows the best practice for this?

Im already following Microsoft Performance Tuning Techniques, like auto adjust buffer size etc.

↧

Execute Process Task - using StandardOutput And ErrorOutput - Want to stop the Window from showing

May 23, 2019, 5:17 am
$
0
0

Fellow SSISers.

Altering a SSIS 2008 R2 package:

I am using an Execute Process Task. I need to capture the standard output and error output.

Thus, I have create variables and have tied them into the Exec Process Task parmeters of Standard Output and Error Output.

When I do that, even though I have the window set to HIDDEN, the CMD window still pops up.

How can I prevent the Cmd Window from showing?

Thanks

MG

↧

Message "A request to establish a connection with the transaction manager was denied" during the transaction start

May 23, 2019, 5:59 am
$
0
0

We have two oledbproviders, both runnign on top of miscellaneous providers also with SQLOLEDB.

First provider is inproc library, which works without problems in all activieties also these requiring Transactions changing db content.

Another provider is implemented as a client-server. A client is inproc library running in the address space of its host process, and a server is a separate local32 process. The server works  exactly in the same way as the first provider only it has its own memory space. This configuration works OK by read-only access but fails on the TransactionStart with the message

error 0x8004d01d:  A request to establish a connection with the transaction manager was denied

The global transaction coordinator is active.

I also tried DtcGetTransactionManager() but then I have the same message during the invocation ofJoinTransaction().

These server however successfully processes the transactions of other providers as msjet, access, oracle. The only problem is SQLOLEDB.

The mistake occurs also when both a client and a server possesses elevated  previlegies.

What could be reasons for that?

A there ways to get additional information regarding this rejection?




↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>