Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS Script task shows reference missing for Microsoft.SqlServer.Dts.Runtime

$
0
0

I am running Visual Studio 2017 with SSDT 15.1.619 and while working with a SSIS C#script task, when I open the task it shows that there is no reference for Microsoft.SqlServer.Dts.Runtime.  I am unable to execute this task at all as a get an error:"Cannot load script for execution.  I created the SSIS package containing that script on the same laptop and instance of VS so I am unsure what has changed to cause this issue.

Any help would be appreciated.


David Dye My Blog


Can we fetch the secrets from Azure key vault in SSIS in any way?

$
0
0
Need to fetch the connections strings stored as secrets in Azure key vault and assign them to SSIS variables so that we can use those connection strings in Connection managers.

"Text was truncated or one or more characters had no match in the target code page."

$
0
0
I’m new to SSIS. I meet the following errors after executing the package.

Error: 0xC02020A1 at Data Flow Task, Flat File Source [2]: Data conversion failed. The data conversion for column "Name" returned status value 4 and status text "Text was truncated or one or more characters had no match in the target code page.".

Error: 0xC020902A at Data Flow Task, Flat File Source [2]: The "Flat File Source.Outputs[Flat File Source Output].Columns[Name]" failed because truncation occurred, and the truncation row disposition on "Flat File Source.Outputs[Flat File Source Output].Columns[Name]" specifies failure on truncation. A truncation error occurred on the specified object of the specified component.

How to import azure table storage data to SQL database

$
0
0

Hi Team,

My team storing some transnational data in to azure table. Want to import those data into local SQL database. Could you please help on to import data to local from azure table storage.


Thanks Bala Narasimha

SSIS 2008:- Visual Studio 2008 dependency on SQL SSIS package execution

$
0
0

Hello Team,

Good afternoon. Because of security challenges, our IT team has decided to uninstall the visual studio 2008 on our server. If we uninstall the Visual studio 2008, Do we see any impact to the SSIS packages/ SSAS cube processing which are running on the server?. As per my understanding, Both are independent and it shouldnt impact each other.

Thank you,

Pradeep.

SSIS : Creating Variable Expressions

$
0
0

Hi Everyone,

Can you please help me in the below situation.

How can we create Variables for PreviousMonth Firstday and PreviousMonth LastDay expressions in SSIS.

If we pass the Date as 2020-02-01, variable should return 2020-01-01  as firstday and 2020-01-31 as lastday

                                 2020-01-01, variable should return 2019-12-01 as firstday and 2020-12-31 as lastday

If we dont pass any date, Default it should return the Getdate()-1 month firstday and lastday dates.

I have tried the below code but it is working only for Getdate() scenario, not for the others.

REPLACE(LEFT((DT_WSTR,20)DATEADD("d",-1,DATEADD("m",DATEDIFF("m",(DT_DATE)"1901-01-01",GETDATE()),(DT_DATE)"1901-01-01")),10),"-","-")

Thanks in advance.

Debugger breaks when using "variable = new IntegrationServices(sqlConnx)"

$
0
0

I have a C# script which I'm using to call a child package synchronously. However as soon as my code includes the following:

IntegrationServices isSession = new IntegrationServices(sqlConnx);

the debugger no longer works and execution runs to completion. I've tried breaking this down to:

IntegrationServices isSession;
isSession = new IntegrationServices(sqlConnx);

and it's definitely the second command which is causing the problem.

I've tried setting the Language Version to "C# 4.0" - as mentioned for similar issues - as well as Run64BitRuntime to "False" - which has also been mentioned - but neither of these make any difference.

Has anyone seen this before and is there a workaround?

SSIS 2017 latest version keeps crashing

$
0
0

Hi,

I'm running VS 2017 Community and it keeps crashing. I'm running it on the server and I'm getting very frequent crashes when I run my packages.

Is it a common experience for everyone here? What am I supposed to do?

Thanks in advance.

One more thing - Uri, you told me you're uploading files to the Azure portal and run the process using the portal. Can you please explain everything what needs to be done step by step, if possible? Right now I'm running from the file server trying to load 1 mln rows at a time (original file was 36 mln rows, so I split it into pieces) into Azure DB by pressing F5 in VS. Apparently VS is running out of memory really quickly.


For every expert, there is an equal and opposite expert. - Becker's Law


My blog


My TechNet articles



Cant Find SSIS installed in configuration manager

$
0
0

Hello,

 We have a VM and on it SQl server 2017 was installed. Couple of days ago, Visual studio 2017 was installed and SSDT was also installed. I can create a solution and execute it without any issues. But oddly, i cannot see it in the configuration manager. Is SSIS installed correctly or not? Below is a screenshot of the manager. The SQL server that we have is a paid license and not a free/trial version. There were no issues during installation. please advise, on what am i missing..

SCD Type-2 Alternative

$
0
0

Hi,

Greetings!!

I want to implement SCD type 2 transformation logic in my SSIS package but due to heavy data size (i.e. 3.4 million) it is failing . I tried implementing the same logic using 2 lookups but it failed due to  cache memory issue.

My table has three business keys and want to maintain the history of one column location with start and end date.

Can anyone please suggest some alternative to implement SCD type 2 transformation logic ?

Thanks in advance :)

how to rename ssis solution

$
0
0
Hi ,I have one doubt in ssis
how to rename solution and folders using ssis solution

solution name : Test_First_V1
Foldername: Test_First_V1

inside folder again have Test_First_V1.dtproj

how will rename all from Test_First_V1 to 
 Test_First_V2



I Tried 
step1:open the solution and right click on solution rename
the Test_First_V1 to   Test_First_V2 and save it
after that I closed the solution 

Step2: rename the folders from Test_First_V1 to   Test_First_V2 
Step 3: again open the solution this time getting warnning
one or more project in the solution were not loaded correctly
plase see the outputwindow for details

i have seen outputwindow no message there


can you please help me how to rename soution and solution related folders in ssis

The version of ODBC destination is not compatible with this version of the dataflow error for SSIS package

$
0
0

I have an SSIS package i created in SSDT 2015 on my local. It runs fine and does a simple data flow task of pulling from a vertica table and loading into a SQL table.  Problem is , when i deployed to SQL server 2016 (64 bit). I get this error (see below).

Note: i have execute with the checkbox (32 bit) under the advanced settings.

ODBC table name - parameterization

$
0
0

Hi, I'm new to SSIS and I have a question regarding the use of parameters for table names in ODBC destination components.

I was able to make use of parameters for connection strings, but don't see any expression builders for the table name.

Essentially it only allows me to select a table from a list of tables when I click the down arrow.

Any tips or hints would be appreciated.

Thanks

MDX to return percent measure as pure numeric value type to SSIS data flow

$
0
0

I am trying to read data out of an analysis services cube and process that data through an SSIS data flow. The MDX query is very simple (identifiers obfuscated):

 SELECT NON EMPTY { [Measures].[somemeasure] }  ON 0, 
 NON EMPTY { ([H0].[H1].[H2].ALLMEMBERS ) }  ON 1 
 FROM [somecube] 

The issue is that the measure "somemeasure" will return data as a formatted percent string, like "12.3%". I want the underlying numeric value, not the formatted string. So, I altered this to:

 SELECT NON EMPTY { [Measures].[somemeasure] }  ON 0, 
 NON EMPTY { ([H0].[H1].[H2].ALLMEMBERS ) }  ON 1 
 FROM [somecube] 
cell properties value

This now returns the value as a decimal number, however, the problem is not completely solved, because in SSIS this data is still treated as something other than a simple numeric value:

Validation warning.  {EBF6EDE6-C061-433D-9C40-5BEB570F4089}: The data type "System.Object" found on column "[Measures].[somemeasure]" is not supported for the ADO NET Source. This column will be converted to  DT_NTEXT.

I could do a derived column transform, but that won't eliminate the source warning.

What is the microsoft-intended way to have an SSAS data source in SSIS that does not result in data type warnings?



http://www.sqlservercentral.com/blogs/don_halloran/

Import excel files in a SQL server from TEAMS

$
0
0

Hi,

I need to import the excel files saved in a teams site in some sql server table (sql is on a VM on Azure, it is not a SQL Azure) with SSIS.

The teams site is something like:

https://sharepoint.com/teams/TEST/Shared%20Documents/Forms/AllItems.aspx

How can I reach the goal without using third party objects?

Many Thanks,

Simona



SQL Job Agent Proxy Fails to Authenticate To Azure File Share

$
0
0

Current Setup

 

  • On-Prem SQL Server 2019 version 15.0.4033.1
  • Azure file Share StorageV2 (general purpose v2)
  • Created a network share on our local machines and SQL server using the following syntax - cmdkey /add:<yourstorageaccountname>.file.core.windows.net /user:AZURE\<yourstorageaccountname> /pass:<YourStorageAccountKeyWhichEndsIn>
  • Confirmed the mapped share was present in Credential Manager on the server and local machines and that we can access the share created above in Explorer window on both the local machines and SQL Server
  • Confirmed UNC pathing was used to reference the share i.e \\xxxxxxxx.file.core.windows.net\share-directory\ in the SSIS job

 

What we have confirmed works

 

  1. The job runs fine locally in Visual Studio
  2. The job runs fine when executing from SSISDB catalog from the server console when logged in as the proxy account defined for use within the SQL Job Agent. i.e Log onto the server using the domain account defined in the SQL Job agent proxy. In the SSISDB right click and execute.
  3. The job runs fine when logged into the server console as the proxy account and executing DTExec from the command line.

 

What is not working is when we try and execute the job via SQL Job Agent via proxy account. The job runs to completion but fails to see the files in the Azure file share. Similar problem is described in this article https://techcommunity.microsoft.com/t5/sql-server-support/ssis-packages-executed-through-sql-agent-job-scheduler-fails/ba-p/319047

 

Reading this article confirms our setup followed the same steps but a review of the process monitor trace described in the article reveals that the call from ISServerExec.exe to the share actually results in a “LOGON FAILURE” message. Does anyone know why the SQL Job Agent Proxy account can’t see /authenticate to the Azure file share when running within the SQL Agent Job?

ODBC source - fetch rows

$
0
0

Hi,

I'd like to fetch a 100 rows from a specific table and I'm using the ODBC source connection for development purposes. In the source ODBC source editor window I don't see any way to do so. I also looked under properties and did not see any fetch rows option. I did notice the sqlcommand property to create your own sql statement with a fetch command, but was wondering if this is the only way to do that or whether there is another quick way to do this.

Roland

Create XML DataSet Error

$
0
0

I'm trying to create XML data set using ADO.Net connection and i'm getting below error when i try to run SQL Agent job. Below is the error. It works fine when i run the package locally but doesnt work on the server. I;m using Visual Studio 2015.

"Create XML DataSet Error: Failed to acquire connection ADo.Net. Connection may not be configured correctly or you may not have the right permissions on this connection"

ANy help much appreciated.


Run SSIS on remote server using DTEXEC

$
0
0

Hello,

When I run a package with dtexec on the server hosting the package it works

When I use the same dtexec command from a remote machine it fails with error 
Login failed for user 'NT AUTHORITY\ANONYMOUS LOGON'

The package's connections uses Windows Integrated Security

DT Exec command is like that
DTExec /ISSERVER "\SSISDB\Customer\Customers\Lc Address.dtsx" /SERVER "XR-SQL-SERV01" /Envreference 1   /Par "$ServerOption::SYNCHRONIZED(Boolean)";True

I cannot specify an execution account and this may be why it does not work remotely


Thanks/Regards, Philippe Cand

SSIS Script Tasks Works Fine in VS 2015 But Not In SQL Server Management Studio

$
0
0

I've read dozens of threads on this topic, and I've tried all of the suggestions with no success.

I have a script task that writes to multiple SQL tables correctly in VS 2015, but when I Deploy it to SSMS 2017, it will not write to the tables (or appear to run at all).  I right-click on the package inside of the SSISDB->Projects->Packages folder and it indicates that it ran successfully, showing no errors.  But when I check all three tables, no data has been written to them.

I've deployed my 'package' from VS as a Project, and also from the .ispac via SQL Management Studio, with no success.  I've matched .Net versions and that didn't make a difference.  Has there been any updates/fixes to SSMS so this problem will go away? Please advise. 

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>