Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS - SQL Server Developer Edition limitation

$
0
0

Hi,

We are using Developer Edition (64-bit) of Microsoft SQL Server 2016 (SP2) for our ETL development. We are facing issue like, in oracle source table there are 3 million records but ssis package is unable to load all records from source to sql server table. Package is completed successfully after loading only 300000 records. We are not sure what is the reason for this issue.

kindly let us know is it due to SQL server Developer Edition limitation. Also please help me with the limitation of SQL Server developer edition. So that we can provide justification to our client and get a licensed version.

Thank you



Attunity Oracle destination error output problem

$
0
0

Hi,

I am using Attunity connector 4.0 for Oracle to load data into a table in my Oracle 12c database. I configured destination error output on the Oracle destination to capture errors while inserting null in on one of the "not null" columns. The error records are then inserted to a log table along with ErrorCode and ErrorDescription (derived using Script component). When i execute the SSIS package in Visual Studio 2012 for testing, I can see all the error rows in the data viewer but with ErrorCode=1 and ErrorCode-Description=NULL. 

Without configuring the destination error output the package throws correct error message

[Insert into TargetTable [154]] Error: Fast Load error encountered during PostLoad or Termination phase. Class: 	Logical
Status:	0	Code:  	0
Note:  	
At:    	ORAOPRdrpthEngine.c:1133
Text:  	Conversion error on column '"VERSION_NAME"'.	ORA-01400: cannot insert NULL into (VERSION_NAME)

Also,When i replace Attunity destination with OLEDB destination everything works as expected. Am I doing something wrong with Attunity set up or is it a known issue?

SSIS runs successfully but records in table does NOT updated

$
0
0

Hi All,

I have source A and source B two databases on different sql servers. Need to compare data in both databases and if any new rows in source A need to insert into source B and if any data update is source A those rows data needs to update in source B.

I have used below transformations to insert and update data in source B. This SSIS package runs successfully insert operation is working fine but data update is not happening after SSIS running successfully.

Can you please help me on this.

Thanks in Advance.

condition used in conditional split transformation
NEWROWISNULL(DBID)

EXISTINGROW!ISNULL(DBID)

Thanks

Naga


Thanks, Naga

Error when running SSIS package with parameter - dtexec

$
0
0

Hi, 

I am facing issues when I run SSIS package with parameters but without parameter it works.

What could be the problem?

Query without parameter-

Begin

declare @query varchar(4000) = 
'dtexec /Project C:\SSIS\DUTPackages.ispac /Package cityTransfer.dtsx /decrypt password1!'

exec xp_cmdshell @query

End

Query with parameter-

Begin
declare @p_cityId varchar(10) = '%'
declare @p_count varchar(10) = '-1'

declare @query varchar(4000) = 
'dtexec /Project C:\SSIS\DUTPackages.ispac /Package cityTransfer.dtsx /decrypt password1!'
+ ' /SET \Package.Variables[$Package::p_cityID];''' +  @p_cityId + ''''+ ' /SET \Package.Variables[$Package::p_count];''' + @p_count + ''

exec xp_cmdshell @query

End

Error I get when running query with parameter-

[OLE DB Source [25]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E10.
[SSIS.Pipeline] Error: OLE DB Source failed the pre-execute phase and returned error code 0xC0202009.

Thanks.


Error when trying to deploy to SQL server

$
0
0

I recently had a modification on an SSIS package that I previously deployed successfully to SQL Server SSIS catalog, but after I made the change and did a rebuild and tried to deploy I get this:

TITLE: SQL Server Integration Services
------------------------------
Could not load file or assembly 'Microsoft.SqlServer.Management.IntegrationServicesEnum, Culture=neutral, PublicKeyToken=89845dcd8080cc91' or one of its dependencies. The parameter is incorrect. (Exception from HRESULT: 0x80070057 (E_INVALIDARG)) (mscorlib)
------------------------------
ADDITIONAL INFORMATION:
The parameter is incorrect. (Exception from HRESULT: 0x80070057 (E_INVALIDARG)) (mscorlib)
------------------------------
BUTTONS:

OK
------------------------------

And I am using VS 2017 to deploy.  Does anyone know what this is about?  I did also run a Repair on my SSDT instance.

Thanks


Brad Allison

Microsoft.Jet.OLEDB.4.0 connection to azure data lake dbf file

$
0
0

I am trying to create SSIS pipeline to process a dbf file which is on Azure data lake without copying the file to local. For that, I am trying to write a c# script task.

  1. Are there any alternatives?
  2. How to give the data source folder in the connection string to the data lake?

Provider=Microsoft.Jet.OLEDB.4.0;Data Source="???to data lake directory???";Extended Properties=dBASE III

SSIS 2012 deployed packages fail unless I RDP to server and run it from there

$
0
0

Hi Everybody,

I deployed an SSIS project from my local machine to our new SSIS 2012 dev server and then tried executing it from my local SSMS.  It failed with the error "Login failed for user NT AUTHORITY\ANONYMOUS LOGON".  I then logged into the SSIS 2012 server itself and executed the very same package from within SSMS and it executed successfully.  How and why did the package execute successfully?

The SSIS service on the SSIS 2012 server is running as "NT Service\MsDtsServer110," which I'm trying to convince the OPS dept. needs to be changed to a domain account that has permissions on the data source and destination servers.  I've convinced myself this service account explains the login failure error, but why does the package run successfully when I run it from the server console itself?

I created the packages myself and there was never a permission problem executing during development.

Thanks,
Eric B.

Write Data to csv file using Script Task

$
0
0

Hi Guys,

I need a code that will write the data in below format to a csv file in the location folder.

Also, I want to write only the texts after Observation (the last 6 lines) to be written to the file.

Thanks

TERMS AND CONDITIONS
https://www.bankofcanada.ca/terms/

SERIES
id,label,description
FXUSDCAD,"USD/CAD","US dollar to Canadian dollar daily exchange rate"

OBSERVATIONS
date,FXUSDCAD
2018-08-29,1.2931
2018-08-30,1.2980
2018-08-31,1.3055
2018-09-04,1.3182
2018-09-05,1.3185


me


How to loop in SSIS 2014 and send a SSRS paramterized report which generates PDF to user's email address using SSIS 2014 package

$
0
0
I have a user table which holds user details 

Userid name email  age  language

---------------------------------------

A12345 Mike mike@test.com  25 English

B56789 Jeff Jeff@test.com 30  French
.
.




I would like to use the user table to create ssrs pdf reports for each distinct user present in my user table .

Template of the report is simple.I have 2 versions of the report one is for english and other one is for french

Below is an example of one PDF english report template for one user and french will look very similar with translated names for Headers.


Userid name age 
-------------------

A12345 Mike mike@test.com  25



The ssrs report in english will have a name as EnglishReport and french will have a name FrenchReport.



So say I have 10 users in my user table I want to call SSRS report 10 times using a loop in a SSIS package and then deliver the report via a send mail task to the user's email address 

The report is generated based on user language .So say If I have Mike who is English user then I would like to call only English version of the report using the attribute language in my user table.


Why I do this way is becuase I dont have Enterprise edition of SSRS and my SSRS \SSIS  is standard edition.


Basically I get a file daily with user records and I process it using a SSIS 2014 package after processing I would like to create pdf's using the same SSIS package and send it to users .

The tricky part is when a user is english then send only english version of the report.

So say I have 2 Users in my cureent table 
I want a loop  using the distinct user table dataset to run in SSIS package and deliver the report to 1 english user using english version of the report and run another loop to deliver french version of the report to french user.

I have already created ssrs reports and they are hosted on SSRS 2014 report manager as EnglishReport and FrenchReport .They run fine they also a 'userid' parameter to run .

Now since I have never done looping in ssis and calling ssrs reports I m looking for help from you guys here .





How to RENAME SERVER NAME IN SSIS Configuration Files

$
0
0

Please need some suggestion. We are currently on SQL Server 2008R2 with SERVER NAME "A" and we are upgrading to SQL 2016 with SERVER NAME "B". Basically we are RENAMING the server name. SO we have Some parts of SQL code using server name and we can write a command to edit so it renames every where it is used.

BUT we have SSIS Configuration files and SSIS packages. IN Configuration files we do have server name in XML code.

1) How we can edit this SERVER NAME TO "B" in Config File.(WE can do it through Notepad++) but is there any other option to do this other then NOTEPAD++. Because we have 100's of Configuration files right now.

2) Some SSIS Execute SQL tasks have manually coded server names in SQL code. Because our jobs run at different time so to pick right DATES and some stuff they have manually coded with Server Names.

At this point my question is how we can change server names in SSIS package Execute SQL Tasks??

Please kindly give some suggestions.

Error when loading the CSV to database. The Column Delimiter was not found.

$
0
0

Hi,

I have an SSIS Package where I download a file from a website, unzip the file and then load the CSV to my database.

I am able to get the file downloaded, unzipped and when I am trying to load the csv to my table, it is failing saying the Column Delimiter for the Column was not found.

But when I open the csv and just save it without making any change then the csv is loading to my table.( I just opened it and saved. Did not even touch anything in the file)

Can anyone please help me on this?

I am attaching all the pics step by step to understand in detail.

And also another small question.

When I load the CSV as it is without changing any formats, I am seeing the data like 3.31E+13 as the data in my column 1( The datatype I have is Varchar(50)).

To get the correct values in my table I am having to open my CSV, format that column to Number and then load it.

Is there anything I can do on this too.

FYI....Pics shown below for more reference.




Loading html file data to table

$
0
0

HI,

I have data in a website and I want to load that to my database.

For now, I am looking for only a partial data elements to be brought to my database ( Marked them in the below pic).

I have a Script Task which pulled the data from the above site and created an HTML file.

Can you help me load the data from this file to my database?

I would like to know if there is a better solution for this also.

FYI... Below is the link for the HTML file.

https://drive.google.com/open?id=1AWIXxosFT2ua3j3Eu6u46TUK6TWjapD4

Thank you.

Cannot deploy SSIS packages after upgrade to SQL Server 2016 SP2 Build 5201.2

$
0
0

Hello,

Upgrade SQL Server 2016 Enterprise from SP1 CU7 to SP2 build 5201.2 ten days ago. This server is running Integration Services and has numerous packages. An application analyst was previously able to deploy packages and now gets this error:

Failed to deploy project. For more information , query the operation_messages view for the operation identifier '777'. (Microsoft SQL Server, Error: 27203)

Querying the operations_messages table in the SSISDB database for 777 I get this message:

Failed to deploy the project. Fix the problems and try again later.:Cannot use SAVE TRANSACTION within a distributed transaction.

The analyst said they were able to previously deploy packages. They are using MS Visual Studio Enterprise 2015 Version 14.0.25431.01 Update 3 and MS. NET framework 4.7.02558

Is there a possibility that the SQL Server upgrade is the cause of this problem? Any advice would be most appreciated. Thanks,

Unable to save connection manager, packages update details

$
0
0

In my Sql server 2014  Integration Service catalog I did import packeges using SSDT tool.
SSDT -> file ->new project->integration service->Integration service import project wizard -> servername and Integration Service catalog

Once import I Its allow scheen to edit. But when save and reopen  that old values still remains. I need to change
connection managers and packeges and deply right back to Integration Service catalog. Any idea why unable to
save changes.  Manay thanks

A transport-level error has occurred when receiving results from the server. (provider: Shared Memory Provider, error: 0 - The pipe has been ended.)

$
0
0

I was Create Link Server to connect oracle database tables using "OraOLEDB.Oracle" provider.

exec master.dbo.sp_MSset_oledb_prop 'ORAOLEDB.Oracle', N'AllowInProcess', 1 ;
GO

exec master.dbo.sp_MSset_oledb_prop 'ORAOLEDB.Oracle', N'DynamicParameters', 1 ;
GO

sp_addlinkedserver @server = 'OrclDB', @srvproduct = 'Oracle', @provider = 'OraOLEDB.Oracle', @datasrc = 'PDBORCL';
GO

exec master.dbo.sp_serveroption  @server=N'OrclDB',@optname=N'rpc out',@optvalue=N'true';
GO

sp_addlinkedsrvlogin @rmtsrvname = 'OrclDB', @useself = 'False', @locallogin = NULL, @rmtuser = 'hr', @rmtpassword ='hr';
GO


SELECT * FROM OrclDB..HR.EMPLOYEES;

error As below

Msg 109, Level 20, State 0, Line 15
A transport-level error has occurred when receiving results from the server. (provider: Shared Memory Provider, error: 0 - The pipe has been ended.)


Microsoft.Jet.OLEDB.4.0 connection to azure data lake dbf file

$
0
0

I am trying to create SSIS pipeline to process a dbf file which is on Azure data lake without copying the file to local. For that, I am trying to write a c# script task.

  1. Are there any alternatives?
  2. How to give the data source folder in the connection string to the data lake?

Provider=Microsoft.Jet.OLEDB.4.0;Data Source="???to data lake directory???";Extended Properties=dBASE III

Extracting YEAR from a DT_DBTIMESTAMP column

$
0
0

Hi All,

I have a DT_DBTIMESTAMP column and I would like to extract only the YEAR part of it in a derived column expression. I tried the following expressions. But always the day and month also coming up in the output. Please let me know your thoughts.

1. (DT_DBTIMESTAMP)YEAR(DOB)

2. (DT_DBTIMESTAMP)(DT_DBDATE)YEAR(DOB)

3. YEAR((DT_DBTIMESTAMP)DOB)

4. YEAR((DT_DBDATE)DOB)

Thanks,

Akhil

Unable to deploy SSIS after VS 2017 update 15.8.0

$
0
0

I just installed the 15.8.0 update to Visual Studio 2017 and now I am unable to deploy SSIS projects and packages to the SSIS Catalog from within Visual Studio 2017.The Deployment Wizard does still work from the command line, however.

I have repaired SQL Server Data Tools. I have repaired Visual Studio 2017. I have uninstalled and reinstalled SQL Server Integration Services Projects. The end result is the same:

ETA: This error occurs after the "Connect" button is clicked on the "Select Destination" page of the Wizard.

===================================

Could not load file or assembly 'Microsoft.SqlServer.Management.IntegrationServicesEnum, Culture=neutral, PublicKeyToken=89845dcd8080cc91' or one of its dependencies. The parameter is incorrect. (Exception from HRESULT: 0x80070057 (E_INVALIDARG)) (mscorlib)

------------------------------
Program Location:

   at System.Reflection.RuntimeAssembly._nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.RuntimeAssembly.nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.RuntimeAssembly.InternalLoadAssemblyName(AssemblyName assemblyRef, Evidence assemblySecurity, RuntimeAssembly reqAssembly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)
   at System.Reflection.Assembly.Load(AssemblyName assemblyRef)
   at Microsoft.SqlServer.Management.Sdk.Sfc.ObjectCache.LoadAssembly(String fullName)
   at Microsoft.SqlServer.Management.Sdk.Sfc.ObjectCache.LoadElement(ObjectLoadInfo oli)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Environment.GetServerVersion(Urn urn, Object ci)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Environment.GetObjectInfo(Object ci, RequestObjectInfo req)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Enumerator.GetObjectInfo(Object connectionInfo, RequestObjectInfo requestObjectInfo)
   at Microsoft.SqlServer.Management.Sdk.Sfc.Enumerator.Process(Object connectionInfo, RequestObjectInfo requestObjectInfo)
   at Microsoft.SqlServer.Management.Sdk.Sfc.SfcInstance.GetSupportedResultTypes(ISfcConnection connection, Urn urn)
   at Microsoft.SqlServer.Management.Sdk.Sfc.SfcInstance.Initialize()
   at Microsoft.SqlServer.Management.Sdk.Sfc.SfcInstance.MarkRootAsConnected()
   at Microsoft.SqlServer.Management.IntegrationServices.IntegrationServices..ctor(SqlConnection sqlConnection)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.ServerHelper.ConnectToServer(String server, String username, String password, AuthenticationType authenticationType)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.ServerProjectBrowser.validateServerWorker_DoWork(Object sender, DoWorkEventArgs e)

===================================

The parameter is incorrect. (Exception from HRESULT: 0x80070057 (E_INVALIDARG)) (mscorlib)

------------------------------
Program Location:

   at System.AppDomain.nApplyPolicy(AssemblyName an)
   at System.AppDomain.ApplyPolicy(String assemblyName)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.MatchAssemblyName(AssemblyName reference, AssemblyName definition)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.FindAssembly(String name, IEnumerable`1 probingPaths)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.InnerResolveHandler(String name)
   at Microsoft.VisualStudio.Platform.VsAppDomainManager.ResolveHandler(Object sender, ResolveEventArgs args)
   at System.AppDomain.OnAssemblyResolveEvent(RuntimeAssembly assembly, String assemblyFullName)



send most recently created file ssis ftp task

$
0
0

I am trying to automate an ftp send with ssis. I can create the file, drop it in a folder on my server but how do I set up the ftp task to send that file via ftp? when the project creates the file, it names is with today's date in the name ex. tosend20180904.txt. How can I instruct the ftp task to send the most recently created file in the file transfer configuration?

Thanks

Error: 0xC0202009, OLE DB Destination [39]: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.

$
0
0

Hi All,

When I am trying to run my SSIS package I am getting below error.

SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.

Can you please help me to trouble shoot this error.

Thanks in advance.

Thanks,

Naga


Thanks, Naga

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>