Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Unable to deploy ETL through the isdeploymentwizard on MS SQL server

August 28, 2019, 8:58 am
$
0
0
we are trying to run ETL deployment and  we getting  permission issue.
 .NET Framework error occurred during execution of user-defined routine or aggregate "deploy_project_internal": 
System.ComponentModel.Win32Exception: A required privilege is not held by the client&
↧
Search

Importing excel with hidden columns through SSIS

August 28, 2019, 9:01 am
$
0
0

Hi All, 

I'm importing an excel which has some valid hidden columns. Is it possible to import all the columns (including) to database using SSIS ? 

Thanks,

Vikram 

↧
↧

OST to PST Conversion

August 18, 2019, 10:46 pm
$
0
0

I have tried a lot of tools for conversion but found OST to PST Converter one of the best, it is ads free , easy to use, fast in processing, please recommend me any other tool also that can help me in  easy conversion from ost to pst conversion online.

coolutils dotcom slash OSTtoPSTConverter


↧

The Script Task uses version 15.0 script that is not supported in this release of Integration Services

August 21, 2017, 12:49 pm
$
0
0

Hi All,

We are migrating an SSIS project from SQL 2012 to SQL 2016. The project upgraded successfully without any issues and able to run few packages without any errors. But there are few packages which has got the script task and they are failing. The error message is as below: -

Error: There was an exception while loading Script Task from XML: System.Exception: The Script Task "ST_bb19096e98ab45d2a2d6132b995cd509" uses version 15.0 script that is not supported in this release
of Integration Services. To run the package, use the Script Task to create a new VSTA script. In most cases, scripts
are converted automatically to use a supported version, when you open a SQL Server Integration Services package
in %SQL_PRODUCT_SHORT_NAME% Integration Services. at
Microsoft.SqlServer.Dts.Tasks.ScriptTask.ScriptTask.Load
FromXML(XmlElement elemProj, IDTSInfoEvents events)

This runs fine when run from BIDS (VS2015). It also runs fine if the project is deployed from BIDS and run through agent job. But when the deployment happens through .ispac (deployment) file, this error occurs. Can somebody suggest how to get past this error?

Is it any known issues with migration or with SSIS 2016?

Thanks.


↧

Visual Studio 2017 SSIS Package - Excel Source Generating Error at Data Flow Task 1 - No column information returned by SQL command

August 8, 2019, 8:40 pm
$
0
0

I'm using an SSIS package (MS Visual Studio 2017) to import an Excel spreadsheet (97-2003 Workbook) into a table (SQL Server Management Studio 2017). The import needs to skip over the first four rows because the column headings start on row 4. Here is an example:

I use a SQL script to skip the first four rows in the spreadsheet: 

SELECT F1,F2,F3,F4,F5,DATE() AS InsertDate
FROM [Jobs$]
WHERE 
F5 IS NOT NULL 
AND F5 <> "Service Address"
This code works in the SQL Server Import and Export Wizard but when I try to use it to create an Excel Source in a Visual Studio SSIS package, I get the following error message: 


Is there a fix for this?

↧
↧

Converting a Date Field

August 28, 2019, 1:16 pm
$
0
0

Hello,

I am new to SSIS and in the beginner phase. I am trying to read data from csv file and in the 'Derived column' transformation I am trying to convert a date field from string to date (mm/dd/yyyy) and it is not working for me. Can someone tell me how would I be able to achieve that.

Thanks,

Ali.

↧

Use Newtonsoft.Json in SSIS via Script Component

August 29, 2019, 10:04 am
$
0
0

I tried all options in this article :
https://devblogs.microsoft.com/visualstudio/using-newtonsoft-json-in-a-visual-studio-extension/#
But, Newtonsoft.Json still doesn't work. I am trying to use Newtonsoft.json in an SSIS solution via Script Component Task. Followed all these instructions, C# script builds correctly, but each time I run the SSIS package I always get the same errors because Newtonsoft.jston files are not found (Script Component : Runtime Error ... Could not load file or assembly 'Newtonsoft.Json, version =9.0.0.0,...). I tried the latest version 12.2, but the results are the same. I have removed the Script Component reopened the SSIS solution, created a new Script component, but nothing works. Tried resintalling using Nuget console, as well as Nuget manager, also tried referencing directly the .dll file. Nothing works.

I use Visual Studio 2017 (SSDT), Version 15.9.15, X64, .NET 4.7.03056.

Adrian Hernandez


↧

Not Getting the required output for one of the field

August 29, 2019, 2:37 pm
$
0
0

Hello,

I am importing a csv file and one of the field is coming in decimal and the datatype in the table is varchar(50). In the csv file the values are nulls or '0' see the screenshot below.

and this is what I am doing derived column transformation:

and in my out I am getting '.00' as the values

any help is appreciated

↧
Search

Issue in Import from Oracle query result to MS SQL server table

August 29, 2019, 11:52 pm
$
0
0

I am accessing Oracle server database and it is mirror database. So i have only read only access to this database.

For my application, i am using MS SQL Server database. I want to fetch data from Oracle database for internal processing.

How do i get all the Oracle Query data into my SQL server table without creating linked server.?

The problem is, when i execute oracle query in oracle SQL plus, it return the result after long time. since the data is large. so data  return will take long time. this is ok...
But, when i execute the same query in my SQL Server through linked server, after some period of time, the query cancelled and it will not be processed...
How do we solve this issue...?
My oracle query like below : 

select DISTINCT 
name,nvl(NUMBER,' ') AS NUMBER,
nvl(STATE,' ') AS STATE,nvl(FROM,' ') AS FROM,nvl(TO,' ') AS TN_TO,
from table1
    /* more joins here    /
UNION
select DISTINCT 
name,nvl(NUMBER,' ') AS NUMBER,
nvl(STATE,' ') AS STATE,nvl(FROM,' ') AS FROM,nvl(TO,' ') AS TN_TO,
from table2
    / more joins here    /
UNION
select DISTINCT 
name,nvl(NUMBER,' ') AS NUMBER,
nvl(STATE,' ') AS STATE,nvl(FROM,' ') AS FROM,nvl(TO,' ') AS TN_TO,
from table3
    / more joins here    */
UNION
select DISTINCT 
name,nvl(NUMBER,' ') AS NUMBER,
nvl(STATE,' ') AS STATE,nvl(FROM,' ') AS FROM,nvl(TO,' ') AS TN_TO,
from table4

I want exact solution..since i am trying to solve this issue many days...?

↧
↧

SSIS Deploy Powershell Integrated Authentication error

July 25, 2019, 5:23 am
$
0
0

Hi all, 

I am trying to deploy an SSIS project with SQL server authentication, using powershell to a virtual machine.

As far as I am aware, SSIS deployment is possible with SQL Server authentication. Do I need to change something on the server side?

Script:

$ServerName = "XX.XX.XX.XX"
$UserName = "test"
$UserPassword = "test"

$SSISCatalog = "SSISDB"
$ProjectFilePath = "C:\ReleaseProcess\Test.ispac"
$ProjectName = "Test"
$FolderName = "Test"

# Load the IntegrationServices Assembly
[Reflection.Assembly]::LoadWithPartialName("Microsoft.SqlServer.Management.IntegrationServices")

# Store the IntegrationServices Assembly namespace to avoid typing it every time
$ISNamespace = "Microsoft.SqlServer.Management.IntegrationServices"

Write-Host "Connecting to server ..."

# Create a connection to the server

$sqlConnectionString = "Data Source=$ServerName;Initial Catalog=master;User ID=$UserName;Password=$UserPassword;TrustServerCertificate=True;"
$sqlConnection = New-Object System.Data.SqlClient.SqlConnection $sqlConnectionString

Write-Host "Connected"
$integrationServices = New-Object "$ISNamespace.IntegrationServices" $sqlConnection
$catalog = $integrationServices.Catalogs["SSISDB"]
$folder = $catalog.Folders[$FolderName]

# Read the project file, and deploy it to the folder
Write-Host "Deploying Project ..."
[byte[]] $projectFile = [System.IO.File]::ReadAllBytes($ProjectFilePath)
$folder.DeployProject($ProjectName, $projectFile)

So I get the below error: 

Exception calling "DeployProject" with "2" argument(s): "The operation cannot be started by an account that uses SQL Server Authentication. Start the operation with an 
account that uses Integrated Authentication."
At line:38 char:1+ $folder.DeployProject($ProjectName, $projectFile)+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~+ CategoryInfo          : NotSpecified: (:) [], MethodInvocationException+ FullyQualifiedErrorId : SqlException


↧

Azure DevOps Pipelines-Deploy SSIS

August 30, 2019, 1:53 am
$
0
0

Hi all, 

currently I am looking for ways to deploy SSIS projects in VM. As far as I searched, in order to do SSIS deployments you need integrated authentication (which means a windows account). But based on the Microsoft hosted agent which is being called to do the deployment, that's not possible. 

Has somebody managed  successfully to do the SSIS deployments with another way? Please don't point me to other websites/blog if you haven't tried by yourself.

↧

Append variable name

August 30, 2019, 4:22 am
$
0
0

Hi

I have a package that uses variables.

What is the correct syntax for appending a variable to  a column name

e.g 

...join column_ +'my_var'

Please assist.

↧

SSIS variables

August 30, 2019, 4:47 am
$
0
0

Hi 

I have the below join statement in my ssis package SQLStatement

From table1 ft
Jointable_"+@[User::num]+"as dt

I get an error when I run it, but if I remove the 'as dt' It works. I need the column aliases for this to work.

Please assist.

Thanks


↧
↧

behavior of a no cache lookup followed by an oldedb destination

August 27, 2019, 7:37 am
$
0
0

Hi we run 2017 std. We have a no cache lookup on Table B for values coming into the buffer from (driven by) Table A with two paths coming out of the lookup, one for matches and another for no matches.

The no match path leads to an oledb destination where inserts occur on the lookup table TableB.

At https://jorgklein.com/2008/02/28/ssis-non-blocking-semi-blocking-and-fully-blocking-components/ I see that lookups are non blocking.  And as I recall, if ssis gets multiple hits on a lookup, it throws away all but the first matching candidate from TableB.  

We suspect that duplicates are coming into the buffer from Table A which is a different subject but do not believe they are sorted in any way on their way in.

For some reason the query you see in the code block is showing as the selected custom query in the advanced window of the lookup.  Other than the nolock I don't see it being any different from what ssis would have generated in the first place.

My question is if either of the following scenarios could occur...

1. could a pair of dupes both get inserted in the oledb destination because by the time the second arrived, the lookup would not have yielded a match yet on the 1st lookup?  In fact perhaps the rule that saves results of last lookup also saves the fact that no match was found on that key on the prev record?

2. one of the latter went the match route because by the time it arrived and tried a lookup, the other had already been inserted?

select * from (select * from [dbo].[TableB] (NOLOCK)) [refTable] where [refTable].[Id] = ? and [refTable].[ID2] = ?



↧

CSV string to Numeric - [Derived Column [2]] Error: An error occurred while attempting to perform a type cast.

August 30, 2019, 6:40 am
$
0
0

Hi,

CSV data source has column with Numeric (4,5,10) and N/A. With the help of Derived Column Transformation I removed N/A (REPLACE(ColumnName,"N/A",""), which is okay. Trying to change its data type in second step, receiving this message:  [Derived Column [2]] Error: An error occurred while attempting to perform a type cast.

When I reopen Transformation its order is changed

Regards,

↧
Search

SSIS-Execute Process task Error _File/Process "\\Servername\Foldername\batfile.bat" is not in path

January 16, 2014, 12:30 am
$
0
0

Hi Sir,

I have designed the SSIS Package in 2012 Version. and i have deployed into the Integration Server,using Project Deployment Model.

In the SSIS Pacakge we are calling the batch file using Execute Process task.

when i am Executing the SSIS pacakge using Visual Studio(Sql Server Data tools) which is working fine.

When i Execute the Pacakge uisng Sql server Management Studio,after the Deployment i am getting the below Error message.

ExecProcess task:Error: File/Process "\\Servername\Foldername\batfile.bat" is not in path.

Thanks for your time.

Regards

Prasad




↧

Protect Task From Stopping

August 27, 2019, 7:22 am
$
0
0

Good morning, all -

A thought hit me this morning that there are certain tasks in my SSIS projects that I don't want the user to be able to stop while they are executing. There are some tasks that, if stopped, may critically damage data.

So, wondered I, is there a means to protect a task that, once it's running, it can't be stopped by the user? Perhaps the stop instruction gets queued such that it executes only once the task has finished what it's doing, something along those lines.

I don't have a big use for something like this, but there have been occasions when I have accidentally clicked theStop Debugging button in SSIS and I do have some tasks that could cause problems if they aren't allowed to finish.

Thanx in advance for any assistance!

↧
↧

trying to download a jason file using webservices task

August 30, 2019, 8:16 am
$
0
0

hi all

i have Url link which is in below format

https://ABC.BCD.com/api-docs/index.html when we are on this site we have to click on Authorize and then i have a token which is alfa numeric 

my task is to connect to this site using web services (note we are not yet buying the C data connector as i know they have direct ZS jason transformation but here we have to work with web services only)

↧

Microsoft Visual Studio 2015 Solution Opens but Package doesn't Execute

August 28, 2019, 8:36 am
$
0
0
I am attempting to open Microsoft Visual Studio 2015 using VBA code from a Microsoft Access database. The code is as follows: strExecutable = Chr(34) & "C:\Program Files (x86)\Microsoft Visual Studio 14.0\Common7\IDE\devenv.exe" & Chr(34)
strPathname = """nas00275pn\cmg_finance\Membership Reporting\Ancillary Reporting\Package Savings\Projects\CategorizationFinal\CategorizationFinal.sln"""   (Note there are two backslashes before nas00275pn to denote the folder where the solution is located)
varRunVS = Shell(strExecutable & " /runexit " & strPathname)        VS opens the solution but the package does not execute.  This coding works for other solutions.  What might be wrong that this package doesn't execute?  In fact, after a few seconds VS just closes automatically.
↧

Deployment Wizard for SSISDeploymentManifest

August 30, 2019, 9:14 am
$
0
0

When I double click on SSISDeploymentManifest to deploy, it won't start the Package Installation Wizard.

What do I need to do to start the wizard?

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>