Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Dimension Merge SCD - installation

June 22, 2020, 6:41 am
$
0
0

Hi,

I came across an alternative component for SCD (slowly changing dimension) on Codeplex (https://archive.codeplex.com/?p=dimensionmergescd) however it has not been maintained for more than 10 years I guess.

Does anyone how to install this custom component as I didn't see any installation instructions or installer of some kind?

Also would this component be compatible with PostgresQL?

Roland

↧
Search

ssis help

June 22, 2020, 7:07 am
$
0
0
Hi i have one doubt in ssis

how to improve performance  while loading 2 lakhs records data from sql server to postgres using ssis package
its taking 2 hours time for loading 2 lakhs records from sql server to postgres

source sql server table: emp and fields :30 its mixed int,varchar,decimal daatypes
target postgres table : emp and fields :30 its mixed int,varchar,decimal daatypes
for performanc steps  i follwed like below :
1)default buffer size i have increase 10 mb to 30 mb
2)default rows :10,000 rows to 30,000 rows
3)select required filed in the source select statment using oledb source

4) destination i have using odbc destination for configure the postgres table

no data types changes while loading sql server to postgres we have maintain exact sql server and postgres dbs.
its one to one loading(sql server to postgres no business logices)

in ssis using : oledb source for sql server tables using select statment and select required columns
               odbc destination for postgres tables  and select destiantion table and created ado.net connection for dsn configure.

 we can do bulkinsert task using ssis ,but its support only text files to sql server tables.

same thing can we do sql server to postgres tables loading using bulk insert task.

can you please tell any solution to reduce loading time from sql server to postgres loading using ssis package.





↧
↧

Convert string to date in SSIS

June 22, 2020, 10:29 am
$
0
0

Hi everyone,

I have an ssis package that loads data from csv to MSSQL DB. One of the fields in the csv file has this date string (e.g. 01JAN1990,  01FEB2018), I need help on how to convert this to date value.

Thanks

me

↧

ssis 2016 trasaction deadlocked error

June 22, 2020, 11:52 am
$
0
0

Hi, I am using SSIS 2016 and have a few ssis packages that are scheduled to run at the same time nightly 11:30 pm via SQL Server Agent job. The source server is SERVERA and the destination server is SERVERB. This is a one to one data import. For instance SERVERA.dbo.TABLEA data is inserted to SERVERB.dbo.TABLEA. Of late we are running into the following error.

Error: Transaction was deadlocked on lock resources with another process and has been chosen as the deadlock victim.

Not sure what might be causing this. Or is there something I should be doing in the ssis packages or with the job schedule.

Thank you in advance.

SQLEnthusiast

↧

How to move Visual Studio templates: Analysis Svcs and Reporting Svcs under the Business Intelligence category?

June 22, 2020, 3:21 pm
$
0
0

I'm using Visual Studio Enterprise 2017. In the "New Project" window, in the 'Installed' section, I have 'Analysis Services' and 'Reporting Services' templates at the same level that "Business Intelligence" category. Can I move 'Analysis Services' and 'Reporting Services' templates down under the "Business Intelligence" category? Thanks.

↧
↧

error : Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostAcquireConnections(

June 22, 2020, 4:44 pm
$
0
0

Hi Everyone,

I am stuck with a SSIS error and have tried many things but still can't get this resolved. I would appreciate any help.

So give a background:

I have a class library ( many projects)  that is actually a pipeline components used by SSIS. Now  when I build these libraries ; I have a post  build event that copies the dll to 130 and 110 folder

"C:\Program Files (x86)\Microsoft SDKs\Windows\v8.0A\bin\NETFX 4.0 Tools\gacutil.exe" -u $(TargetName)
"C:\Program Files (x86)\Microsoft SDKs\Windows\v8.0A\bin\NETFX 4.0 Tools\gacutil.exe" -i $(TargetFileName)
copy "$(TargetPath)" "C:\Program Files\Microsoft SQL Server\110\DTS\PipelineComponents"
copy "$(TargetPath)" "C:\Program Files (x86)\Microsoft SQL Server\130\DTS\PipelineComponents"

 and then register the dlls to GAC which I can verify here:

C:\Windows\Microsoft.NET\assembly\GAC_MSIL

so far this is good. Then I use these as components in my SSIS project. And as per my understanding SSIS looks for the components in GAC. Now , I converted the SSIS to target sql -> 2016. Build performance is just horrible and it will take forever to build this.After I biuld the SSIS, i see on of the component with error:

<style type="text/css">@page { margin: 0.79in } p { margin-bottom: 0.1in; line-height: 115% } </style>

[Read  File [2002]] Error: System.MissingMethodException: Method not found: 'Microsoft.SqlServer.Dts.Pipeline.Wrapper.IDTSComponentMetaData100 Microsoft.SqlServer.Dts.Pipeline.PipelineComponent.get_ComponentMetaData()'.

at BloombergCorporateActionsReader.CorporateActionsReader.AcquireConnections(Object transaction)

at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostAcquireConnections(IDTSManagedComponentWrapper100 wrapper, Object transaction)

I tried googling this error but nothing of any help. 

I am suing visual studio 2017 (SSDT) and sql server 2016.

I hope I was able to explain it clearly.

Thanks,

Rohit


↧

The reference assemblies for framework ".NETFramework,Version=v4.7" were not found

June 16, 2020, 9:20 pm
$
0
0
Hi,

I had .net framework 4.7.03062 and Visual Studio SSDT 2015, need to upgrade to SSDT 2017 as of production version because my packages failed for version issues. Installed SSDT 2017 version 15.9.24 but still packages were failed. Then came to know .net framework should also similar, so installed 4.8.03761 and uninstalled the old one. I created the new project in SSDT 2017 and package but the script component package giving me following error.

SeverityCode DescriptionProjectFileLineSuppression State
ErrorError loading MyPackage.dtsx: MSB3644 - The reference assemblies for framework ".NETFramework,Version=v4.7" were not found. To resolve this, install the SDK or Targeting Pack for this framework version or retarget your application to a version of the framework for which you have the SDK or Targeting Pack installed. Note that assemblies will be resolved from the Global Assembly Cache (GAC) and will be used in place of reference assemblies. Therefore your assembly may not be correctly targeted for the framework you intend., C:\Program Files (x86)\Microsoft Visual Studio\2017\SQL\MSBuild\15.0\Bin\Microsoft.Common.CurrentVersion.targets, 1179, 5C:\work\SSDT\TreasuryDataLoad\TreasuryDataLoad\MyPackage.dtsx1

I am unable to identify how SSIS package still searching for old .NETFramework, following assembly references used.

            <AssemblyReferences>
                <AssemblyReference AssemblyPath="Microsoft.SqlServer.DTSPipelineWrap" />
                <AssemblyReference AssemblyPath="Microsoft.SqlServer.DTSRuntimeWrap" />
                <AssemblyReference AssemblyPath="Microsoft.SqlServer.PipelineHost" />
                <AssemblyReference AssemblyPath="Microsoft.SqlServer.TxScript" />
                <AssemblyReference AssemblyPath="System.dll" />
                <AssemblyReference AssemblyPath="System.Data.dll" />
                <AssemblyReference AssemblyPath="System.Xml.dll" />
            </AssemblyReferences>


Many Thanks, Muhammad Yasir

↧

Import excel files in a SQL server from TEAMS

June 5, 2020, 1:09 am
$
0
0

Hi,

I need to import the excel files saved in a teams site in some sql server table (sql is on a VM on Azure, it is not a SQL Azure) with SSIS.

The teams site is something like:

https://sharepoint.com/teams/TEST/Shared%20Documents/Forms/AllItems.aspx

How can I reach the goal without using third party objects?

Many Thanks,

Simona


↧
Search

Access is denied connecting to SSIS instance

June 23, 2020, 6:38 am
$
0
0

Hi Everyone,

I have followed the steps provided in link below but still teh user not able to connect to integration services through SSMS.

https://www.mssqltips.com/sqlservertip/3086/how-to-resolve-ssis-access-denied-error-in-sql-server-management-studio/

The SQL Server Integration Services 13.0 , I can connect using SSMS 2016. But others users get Access Denied error. They are part of DCOM config.

This service is running under Local System account on server can that be causing this issue ? Which account this should run under and how to change that now ? also any other input on access issue will be very helpful.

Thanks much.

Best Regards, Pragati

↧
↧

transfer files from sharepoint site to blob storage

June 23, 2020, 8:31 am
$
0
0

Hi,

I am working on to create an SSIS package to transfer files from a sharepoint site to BLOB storage.

Can you please provide steps on how to achieve this?

Thanks much in advance!

harshac

↧

cannot connect to integration services from ssms

July 13, 2019, 7:48 am
$
0
0

Using sql server 2014 standard edition, SSMS v18.1

I am not able to connect to sql server integration service from SSMS. Error copied below. Please suggest what needs to be fixed.

error:

"
Failed to retrieve data for this request. (Microsoft.SqlServer.Management.Sdk.Sfc)

Exception from HRESULT: 0xC00160AC (Microsoft.SqlServer.DTSRuntimeWrap)

"

Thanks in advance.

↧

Run SSIS on remote server using DTEXEC

June 12, 2020, 2:58 pm
$
0
0

Hello,

When I run a package with dtexec on the server hosting the package it works

When I use the same dtexec command from a remote machine it fails with error 
Login failed for user 'NT AUTHORITY\ANONYMOUS LOGON'

The package's connections uses Windows Integrated Security

DT Exec command is like that
DTExec /ISSERVER "\SSISDB\Customer\Customers\Lc Address.dtsx" /SERVER "XR-SQL-SERV01" /Envreference 1   /Par "$ServerOption::SYNCHRONIZED(Boolean)";True

I cannot specify an execution account and this may be why it does not work remotely

Thanks/Regards, Philippe Cand

↧

Copy table from a merge-joined to another data flow

June 23, 2020, 3:22 pm
$
0
0

Hello all,

I have two data flows connected. i want to Copy the data from a merge-joined container, which is in the first data flow task to the second one. The thing is i don't want to create a table destination (ado net destination 3) just for this. any other way to transport the data that is in the merged-joined to the second data-flow without creating a table?

Thanks all

↧
↧

Excel source validation error

June 24, 2020, 3:54 am
$
0
0

Hi,

I have SSIS package to read excel file. The package runs successfully when run from visual studio.

When I deploy the same package to azure VM and run from SSISDB/Agent job, it fails with Excel source failed with validation error.

It used to run until last week but its failing now. I have some other excel files and they are running very well. Only issue with this package.

I couldn't understand why the package is failing. It is running very well in visual studio.

I have opened and saved every task in the package and deployed. Still the same issue. 

How do I fix this issue?

Thanks in advance

↧

Logging in Control flow SSIS

June 24, 2020, 4:36 am
$
0
0

1: I just want to create 2 log files for success and error within control flow logging facility.

2: Also want to add dynamic statement within Logs.

Please guide!

↧
Search

To run a SSIS package outside of SQL Server Data Tools you must install Standard Edition of Integration Services or higher.

November 27, 2017, 6:35 am
$
0
0

Hi 

I have migrated the SSIS package from 2012 to SQL Server 2017 and when i am running the package from visual studio 2017 the package is executing successfully.

I created a bat file that targets: C:\Program Files (x86)\Microsoft SQL Server\140\DTS\Binn\DTEXEC.exe. But when i am excuting from the batch file am getting below error.

ERROR:

START EXECUTING PURGING FOR NON PROD WM DB LOGS. 
Microsoft (R) SQL Server Execute Package Utility
Version 14.0.1000.169 for 32-bit
Copyright (C) 2017 Microsoft. All rights reserved.

Started:  9:17:27 AM
Error: 2017-11-27 09:17:28.00
   Code: 0xC000F427
   Source: Get Table Names 
   Description: To run a SSIS package outside of SQL Server Data Tools you must install Standard Edition of Integration Services or higher.
End Error
Warning: 2017-11-27 09:17:28.00
   Code: 0x80019002
   Source: Purge_WMLogs-DVEK 
   Description: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED.  The Execution method succeeded, but the number of errors raised (2) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
End Warning
DTExec: The package execution returned DTSER_FAILURE (1).
Started:  9:17:27 AM
Finished: 9:17:28 AM
Elapsed:  0.499 seconds
FINISHED EXECUTING PURGING FOR NON PROD WM DB LOGS. 

Please can anyone help me on this.

Thanks

Ashwin

↧

SSIS package runs successfully only when the source excel file is open.

June 24, 2020, 4:19 pm
$
0
0

I have a simple ssis package that has excel file as a source and ole db table as a destination, the package executes successfully as long as the excel file is open and whenever I close the excel file and execute the package it fails. After lot of google research, I changed the setting 'Run64BitRuntime' from True to false, still the package is failing when I execute after closing the excel file.

I tried changing the excel connection property 'RetainSameConnection' from False to true, still not working.

Any idea or input will be appreciated.

Please find the below error message I am getting.

TITLE: Microsoft Visual Studio
------------------------------

Exception from HRESULT: 0xC020801C
Error at Package [Connection manager "Excel Connection Manager"]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft JET Database Engine"  Hresult: 0x80004005  Description: "External table is not in the expected format.".

Error at Data Flow Task [Excel Source [8]]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

↧
↧

Bulk Deletion in Dynamic 365 using SSIS Package

June 25, 2020, 12:37 am
$
0
0

I'm not able to use Bulk Delete option given in CRM Destination Data Flow task.

Getting error "Saved Query is null"

Please help!

↧

pass input parameter to SP that triggers SSIS pkg

June 25, 2020, 5:57 am
$
0
0

Hi,

I would like to pass a parameter value to a stored procedure that would execute an SSIs package consuming the parameter value.

Can someone provide example where SSIS pkg uses the parameter value coming from SP.

↧

compare date in Excel file to target table before importing data from excel

June 25, 2020, 10:13 am
$
0
0

Hello,

I will be importing data from an excel file and adding that data to a target table in management studio.  I would like SSIS to compare the date from the excel file and target table first and if the dates are the same, delete what is in management studio and then import the file.

How do I do that?

OJMP

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>