Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Visual Studio 2015 - SSIS Development - Backward Compatibility - Can we develop 2008, 2012, 2014 packages?

$
0
0

Hello and good day to all

I'm trying to determine if Visual Studio 2015 (VS2015) Ultimate or any other version VS2015 will allow for SSIS packages for 2008, 2012, 2014 environments.

Any direction is appreciated

Thank You Forum


Mark Covian


SqlCeCommand.CommandTimeout does not support non-zero values.

$
0
0

Hi, I am receiving the "SqlCeCommand.CommandTimeout does not support non-zero values" message by clicking the Pase Query button in the Execute SQL Task Editor. The timeout value has already been set as 0.

We use the SQLMOBILE connection type to connect to a SQL CE 3.5 database file through the SQL Server Compack Connection Manager Edition. The SQL statement is simple "DECLARE @MaxID AS int".

Is there anyother configuration I need to do?

Thanks

 

SSIS 2008R2 ODBC DataReader Command doesnt' Time Out

$
0
0

So I have seen lots of forum questions from people whose ODBC command is giving them a timeout error, and they want it not to do that.

I am having the opposite problem.

I have a Source Component whose CommandTimeout property I have set to 150.  

In my package-level Options, "Cancel long running query" is set to cancel after 30 seconds.

I started the package in debug mode in Visual Studio.   My Source component has been yellow for over four hours, without any rows coming out of it, and without timing out.

After about 5 hours, the DataReader did finally error with the following messages:

Error: 0xC02090F5 at Header Workload, Select Incremental HeaderFrom Firebird [115]: The component "Select Incremental HeaderFrom Firebird" (115) was unable to process the data. ERROR [08S01] [ODBC Firebird Driver][Firebird]Error reading data from the connection.

Error: 0xC0047038 at Header Workload, SSIS.Pipeline: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "Select Incremental HeaderFrom Firebird" (115) returned error code 0xC02090F5.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

Error: 0xC0047062 at Header Workload, Select Incremental HeaderFrom Firebird [115]: System.Data.Odbc.OdbcException: ERROR [08001] [ODBC Firebird Driver][Firebird]Unable to complete network request to host "S1WPVCRS08".

Error writing data to the connection.

Error: 0xC0047018 at Header Workload, SSIS.Pipeline: component "Select Incremental HeaderFrom Firebird" (115) failed the post-execute phase and returned error code 0x80131937.

 

So, to ask the opposite of what most people ask, how can I get my command to timeout instead of waiting five hours to throw these errors?


-Tab Alleman


Using SSIS to retrieve data from a MariaDB causes an Appcrash only on one table

$
0
0

I am using the SQL Server Integration Services   Version 12.0.2430.0 and VS 2013 to retrieve data from a maria db table using an ODBC connection.  I am using the same ODBC tool on several other tables with many more records but for some reason on one particular table it fails every time with the following message:

Problem signature:


  Problem Event Name: APPCRASH

  Application Name: DtsDebugHost.exe

  Application Version: 2014.120.2000.8

  Application Timestamp: 5306c843

  Fault Module Name: StackHash_65ec

  Fault Module Version: 6.3.9600.18194

  Fault Module Timestamp: 569515fc

  Exception Code: c0000374

  Exception Offset: PCH_27_FROM_ntdll+0x0003C7EC

  OS Version: 6.3.9600.2.0.0.272.7

  Locale ID: 1033

  Additional Information 1: 65ec

  Additional Information 2: 65ec23bdef2a83f58f5b73049ca4ee57

  Additional Information 3: e064

  Additional Information 4: e064871c17ee17f071c0d9ae5eb27b4c

I need to download this data daily and the only other method I have is me doing a download from the maria db tool and doing an import from the csv.  Thank you all in advance.


Matt

Issues accessing DTS packages on SQL Server 2000 from SQL Server 2008R2

$
0
0

 I have SQL Server 2014 and SQL server 2008R2 installed and I am trying to access DTS packages on SQL Server 2000 from SQL server 2008R2. I am on Window 7, 64 bit machine.

After SQL Server 2008R2 was installed, I installed,

Microsoft SQL Server 2005 Backward Compatibility Components-
SQLServer2005_BC_x64.msi
AND
Microsoft SQL Server 2000 DTS Designer Components
SQLServer2005_DTS.msi

Then manually copied files from-
C:\Program Files (x86)\Microsoft SQL Server\80\Tools\Binn
Copy
semsfc.dll
sqlgui.dll
sqlsvc.dll
To
C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE

C:\Program Files (x86)\Microsoft Visual Studio 9.0\Common7\IDE

Then navigate to
C:\Program Files (x86)\Microsoft SQL Server\80\Tools\Binn\Resources\1033
Copy
semsfc.rll
sqlgui.rll
 sqlsvc.rll
To
C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\Resources\1033

But didn't help. I can see DTS packages, but when I right click and open I get error

I get error-

SQL Server 2000 DTS Designer components are required to edit DTS packages. Install the special Web
download, "SQL Server 2000 DTS Designer Components" to use this
feature. (Microsoft.SqlServer.DtsObjectExplorerUI)

I can see the components installed in Control panel. Please suggest what to do?

Thanks

How to specify Request headers with SSIS JSON Source component

$
0
0

Hi, I am using Codeplex SSIS JSON Source component to access data using API.

but the API i am using the headers (like X-API-Token and its key) inorder to access their API.

Please help me how to specify the headers in this component or with any other ways to access API in SSIS.

Cannot import date values in SharePoint

$
0
0
I'm trying to copy excel data in sharepoint using SSIS package. I cannot copy date values in SharePoint. I tried single text and Date type in SharePoint but still i cannot see date values in the list.

How to handle changes in source file format?

$
0
0

Hello All,

I am working on SSIS 2005 (yes still) and loading csv files coming in at regular intervals from an external system in to my sql server database. So far so good.  

Now, I want to know how to handle a situation where the external system adds a new column or removes few existing columns from the source files? I will have to create a new destination table each time I suppose?

I am sweating on this for a long. Any help will be highly appreciated.

Regards,

Sachin


'In Persuit of Happiness' and ..... learning SQL.


SSIS package run as a job from sql agent does nothing

$
0
0

Hi, I am using SSIS for Visual Studio SSDT 2013 and SQL Server 2014 database. In my SSIS package I have a script task which pulls data from an api and writes data to a table. When I run this package in Visual Studio environment everything works as expected but when I run the same from SQL Server Agent as a job it does nothing. Not sure what might be causing this. Please point me in the right direction.

Thanks in advance....


SQLEnthusiast

SSIS ETL solution needs to import 600,000 small simple files every hour. What would be optimal Agent scheduling interval?

$
0
0

Greetings,

The hardware scaling, infrastructure and redundancy are not in the scope of this question.

I am building an SSIS ETL solution needs to import ~600,000 small simple files per hour.  With my current design, SQL Agent runs the SSIS package and it takes “n” number of files and process them.

  • Number of files per batch “n” is configurable
  • The SQL Agent SSIS package execution is configurable

I am so confident on the above design. I wonder if the above approach is a right design choice? Or alternatively I must have a infinite loop in the SSIS package and keep taking/processing the files?

So the question boils down to choice between infinite loop vs. batch+schedule. Is there any other better option?

Thank  you

Backup Database Task - User Permissions

$
0
0

Hi

I am currently implementing an SSIS package to cater for the backup of our database system.  I am using a Back Up Database Task connecting to the database using SQL Authentication.  This login has public server rights and db_backupoperator database role rights.

Having tested the package, it seems to fail on the backup task because of the following error:

[Execute SQL Task] Error: Executing the query "BACKUP DATABASE [CAAP] TO  DISK = N'R:\CAAP_Backup..." failed with the following error: "Only users who are members of the following roles can perform this operation: sysadmin fixed server role; dbowner or dbcreator fixed database role in the current database.
Only users who are members of the following roles can perform this operation: sysadmin fixed server role; dbowner or dbcreator fixed database role in the current database.

Why does it need dbOwner/dbCreator/sysadmin rights to execute a simple backup?  Isn't this the point of the dbBackupOperator role?

Thanks.

Transfer very large binary data table from one Sql Server to another

$
0
0

Hello,

we have 2 sql server nodes. On one of the nodes, there is a table with a varbinary(MAX) column. we need to transfer the data in this table to another identical table sitting on the second node.  The source table is over 2.5Terrabytes(TB).  This large size is due to the fact that there are over 100 million rows and the image column(varbinary).

I am trying with a linked server approach. 

Select * into desttable from SourceServer.sourceDB.Sourcetable with (nolock)

I find the transfer to be very slow.  Right now, i am getting only a million records per hour. I am trying to speed up the transfer. 

What should i take care?

When i tried to query the source table, i find that there is large variation in the data stored in the varbinary column. 

   Select ID, IMGColumn, Len(IMGColumn) from SourceTable.

The length of the varbinary column varies from 190 bytes to 32K.  Where records have images of 32k, the transfer is slow. I can quickly transfer records where the Varbinary column  is small (100 bytes to a a few thousand bytes). But i see there are rows where Len(IMGColumn) returns 32k and these rows transfers very slow.

Please can someone guide me on how best to handle transfer of large binary data from one sql to another?

thanks

MSProg

Issues wtih SAS Query along with WHERE clause in OLE DB Source Tranformation - SSIS Package

$
0
0

Hi folks,

I'm using following query in my SSIS ETL Package to fetch data from SAS .sas7bdat format file. I created OLE DB Connection using Native OLE DB\SAS Local Data Provider 9.43.  I executed this query in SAS Enterprise Guide it's executing perfectly and it's giving the result. At same time, I used this query inOLE DB Source -> SQL Command it giving following error. 

PROC SQL;

SELECT * FROM XXX.XXXX_TB

WHERE X_XX_XX_NAME='XX_XXXX_TY_CD';

I can able to select entire table from OLE DB source transformation but while preview the value it giving another error like below.

But, I canable to run the package even after getting preview errorand viewed the data using Data Viewer.

Now, I want to know, why I'm getting the preview error in OLE DB Source and SAS Query executing perfectly in SAS Enterprise guide but it's not working in OLE DB Source -> SQL Command.

SAS and SQL Server both are different servers.

SAS Version: 9.4, SSDT 2013 and SQL Server 2014.

I'm using any wrong driver for SAS? or SAS Query need any modification while using SQL Command text in OLE DB Source.

Could you please any one help me on this issues.

Thanks in Advance.

 

Thanks,

Pandi K

SSIS Running a Parent package in SQL Agent will not run the child package

$
0
0

Hello

I have two SSIS packages, a Parent package that just runs a SQL script to a recordset and then runs a second package and passes a location to the child package.

When I run in visual studio it runs fine, but when I run in SQL Agent I get the following error.

Message
Executed as user: TELFORD\Sql. ...0.5058.0 for 32-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  16:40:18  Error: 2016-05-20 16:40:20.11     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.13     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.13     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.13     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.13     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.13     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.13     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.13     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.13     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.13     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.13     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.15     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.15     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specific connection element is not found.  End Error  Error: 2016-05-20 16:40:20.15     Code: 0xC001000E     Source: Child_Package      Description: The connection "{97198076-5026-4B8C-A6FB-30FD129E93D1}" is not found. This error is thrown by Connections collection when the specif...  The package execution fa...  The step failed.

The child package location is;

\\ttt-vsp02\SSIS\Trading Report\Trading Report\Child_Package.dtsx

I think it is complaining about the connection to the child package, but I don't know how to resolve. Any suggestions?

Regards

SQLSearcher99

The type of the value (DBNull) being assigned to variable "User::Query" differs from the current variable type (String). Variables may not change type during execution.Variable types are strict, except for variables of type Object.

$
0
0

Hello Friends,

I am reading a CSV file which has Query as one of the column using a DFT. I have defined a package level variable, User::Query, to which I am assigning the value read from the Query column in .csv file. Query is being read as DT_TEXT datatype. 

I am getting the following error in the FELC when there is no data in the Query column:

Error: 0xC001F009 at ExecuteRecon: The type of the value (DBNull) being assigned to variable "User::Query" differs from the current variable type (String). Variables may not change type during execution. Variable types are strict, except for variables of type Object.
Error: 0xC001C012 at Foreach Loop Container: ForEach Variable Mapping number 4 to variable "User::Query" cannot be applied.
Error: 0xC001C012 at Foreach Loop Container: ForEach Variable Mapping number -1922413632 to variable "蒼揲" cannot be applied.

I added an Expression Task before FELC to convert the NULL into NULL of requested Data Type:

@[User::Query] = LEN(TRIM(@[User::Query]))>0 ? @[User::Query] : NULL(DT_WSTR, 1 )

How do I resolve this error?

Thank you

P.S: I am unable to attach screenshots because, " Body text cannot contain images or links until we are able to verify your account."


Reading character for integer field.

$
0
0

I am Using SSDT 2014.

I have a file from which I am reading data, column by column.

For inrteger column, sometime I receive string data (character).

Could someone tell, if I want to check if the data is NUMERIC or STRING. I tried using IsNumeric() function, but this dosent worked. If data is string I will insert NULL else data.

Using column name in derived column for some calculation, where it is failing.

SSIS Data Flow Item tab missing when I go to "Choose toolbox items" in SSDT for visual Studio 2013

$
0
0

I had MS Visual Studio ultimate 2013 and MS SQL Server 2012 on the dev machine (Win 7) and I installed SQL Server Data Tools - "Business Intelligence for Visual Studio 2013". When I launch SSDT for visual Studio 2013, I cannot find SSIS Data Flow Item tab if I go to "choose items" in toolbox. I gone through related suggestion on the forum which says "REM Unregister and re-register the assembly on the GAC" but I could find assembly namedChangeCase.dll on my machine hence following URLs does not help. Looking forward for support............

ThanksChoose Toolbox Items


MSDN

how many ways to deploy the ssis package?

$
0
0
how many ways  to deploy the ssis package?

Changing the configurations of a deployed package in sql server

$
0
0

Hi ,

I have a ssis package which is already deployed to sql server,but it is configured to different server.

now i need to change the configurations of the deployed package.

How can i change the server name in the configurations of deployed package.

Thanks

Type conversion in SSIS

$
0
0

Hi All,

I want to convert a string column to integer column (all numeric values to integer and alpha-numeric vales to null). I am able to perform this with the help of a expression. But the expression also converts "." (dot) to 0 (zero). For my requirement,"." (dot) should be treated as null. Please help me to write an expression.

Here is the expression I am using:

(DT_I4)column ==(DT_I4)column ? (DT_I4)column : NULL(DT_I4)

Requirement Example 

Input

1

0

2a

.

4

Output

1

0

null

null

4


Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>