Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS package doesn't use 64bit runtime while running from SSDT on windows 2012 server

$
0
0

Hello,

I'm debugging an SSIS package on Windows Server 2012 from SSDT but I can't get the package debugging because the SSIS runtime being used is a 32 bit.  I've the project debug property - "Run64bitRunTime = True"; but still SSDT doesn't invoke the 64bit runtime. I have executed the package using the 64 bit dtexec (installed at C:\Program Files\Microsoft SQL Server\120\DTS\Binn\) on the server and the package runs fine. But haven't been successful in getting it to run from SSDT. Can someone please help to get it run in SSDT using 64 bit runtime?

Here are my software installed on the Windows Server 2012 and the Path environment variable:

Microsoft Visual Studio Ultimate 2013
Version 12.0.21005.1 REL
Microsoft .NET Framework
Version 4.5.51641
Installed Version: Ultimate

SQL Server Data Tools   12.0.50318.0
Microsoft SQL Server Data Tools
SQL Server Integration Services  
Microsoft SQL Server Integration Services Designer Version 12.0.2430.0
SQL Server Reporting Services  
Microsoft SQL Server Reporting Services Designers Version 12.0.2430.0

Path :

Path C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Localbin;C:\debuggers;C:\Program Files\Dell\SysMgt\oma\bin;C:\Program Files\Dell\SysMgt\shared\bin;C:\Program Files\Dell\SysMgt\idrac;C:\Program Files\Microsoft SQL Server\110\Tools\Binn\;C:\Program Files\Microsoft SQL Server\120\DTS\Binn\;C:\Program Files\Microsoft SQL Server\Client SDK\ODBC\110\Tools\Binn\;C:\Program Files (x86)\Microsoft SQL Server\120\Tools\Binn\;C:\Program Files\Microsoft SQL Server\120\Tools\Binn\;C:\Program Files (x86)\Microsoft SQL Server\120\Tools\Binn\ManagementStudio\;C:\Program Files (x86)\Microsoft SQL Server\120\DTS\Binn\;C:\Program Files (x86)\Windows Kits\8.1\Windows Performance Toolkit\;C:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\IDE\PrivateAssemblies\;C:\Program Files (x86)\Microsoft SQL Server\110\Tools\Binn\;C:\Program Files\Microsoft SQL Server\110\DTS\Binn\;C:\Program Files\Microsoft\Web Platform Installer\;%SYSTEMROOT%\System32\WindowsPowerShell\v1.0\


catalog.start_execution SYNCHRONIZED in Transaction

$
0
0

Hi, I am trying to execute a SSIS Package from a stored procedure within a transaction. I also want the execution to be in Synchronized mode. This is an example of my stored procedure code:

begin try
begin transaction

	/*
	inserts, updates
	*/

	declare @execution_id bigint
	EXEC [SSISDB].[catalog].[create_execution]	@package_name=N'My Package.dtsx',
												@execution_id=@execution_id OUTPUT,
												@folder_name=N'MyFolder',
												@project_name=N'MyProject',
												@use32bitruntime=False,
												@reference_id=Null
	EXEC [SSISDB].[catalog].[set_execution_parameter_value] @execution_id,
															@object_type=50,
															@parameter_name=N'LOGGING_LEVEL',
															@parameter_value= 1
	EXEC [SSISDB].[catalog].[set_execution_parameter_value] @execution_id,
															@object_type=50,
															@parameter_name=N'SYNCHRONIZED',
															@parameter_value= 1
	EXEC [SSISDB].[catalog].[start_execution] @execution_id;

	/*
	throw error if execution status is not = 7 ("Success")
	*/

commit transaction
end try
begin catch
	if @@Trancount > 0
		rollback transaction;
end catch

The problem is that the package reaches a timeout and gets a status = 5 ("Pending").

If I remove the Synchronized setting, it works. If I remove the transaction, it works. But a combination of both will not work. Can anyone think of a simple workaround for this?

Thank you,

Filip

Using [dbo].[SSIS Configurations] with sensitive data - how to migrate to next environment?

$
0
0

We have recently started using SSIS 2014 and for our changing values we use [dbo].[SSIS Configurations] (SQL Server table). We are connecting to a DB that requires a UN/PW combo to connect.  I was pleased to see the password was encrypted in the table.

In the past, we always scripted out the insert/update for the next environment as we don't have permissions on production so the dba just needs to execute the script and viola, the production values are in the config table.

How does one do that if the password field is encrypted and we don't want to insert plain text...  We tried updating the value via the package properties on the server, but that doesn't change the configuration values.

The username/password changes for each environment, how do we migrate this?

Thanks

The package failed to load due to error 0xC0011008

$
0
0

Hello Everyone,

I am trying to run a SSIS package using ASP.NETs loadpackage(). when ever the code tries to run the package i get the following error:

{"The package failed to load due to error 0xC0011008 \"Error loading from XML. No further detailed error information can be specified for this problem because no Events object was passed where detailed error information can be stored.\". This occurs when CPackage::LoadFromXML fails.\r\n"}

I am extremely new in this field. Please help!

Deploy tabular model to new environment and update connection

$
0
0
To try and speed up our deployments into new environments (test and live), we've produced an SSIS package that undertakes many of the tasks (backing up and deploying databases, etc.). This has worked well for dramatically speeding up deployment and ensuring that all of the sizeable list of tasks are done correctly. However, we're struggling when it comes to updating connections in our tabular models.

Example:
1. Backup MyTabularModel.abf using an Analysis Services Execute DLL Task
<Backup xmlns="http://schemas.microsoft.com/analysisservices/2003/engine"><Object><DatabaseID>MyTabularModel</DatabaseID></Object><File>F:\TM\MyTabularModel.abf</File></Backup>

2. Restore MyTabularModel.abf to new environment using an Analysis Services Execute DLL Task
<Restore xmlns="http://schemas.microsoft.com/analysisservices/2003/engine"><File>F:\TM\MyTabularModel.abf</File><DatabaseName>Acorn</DatabaseName><AllowOverwrite>true</AllowOverwrite><DbStorageLocation xmlns="http://schemas.microsoft.com/analysisservices/2008/engine/100/100">K:\TM\</DbStorageLocation></Restore>

3. Update the connection string:
from
Provider=SQLNCLI11;Data Source=OldEnvironment;Integrated Security=SSPI;Persist Security Info=false;Initial Catalog=MyDatabase

to
Provider=SQLNCLI11;Data Source=NewEnvironment;Integrated Security=SSPI;Persist Security Info=false;Initial Catalog=MyDatabase

How do we change the connection string programatically?

Stuart

[ SQL query execution Task ] Error: "The execution of the request " DECLARE ? NVARCHAR (255) DECLARE ? NVARCHAR (255) OF ... "failed with the following error: " No value given for one or more of the required parameters . ". Possible causes for this failu

$
0
0

Hi,

   I got the error :  [ SQL query execution Task ] Error: "The execution of the request " DECLARE ? NVARCHAR (255) DECLARE ? NVARCHAR (255) OF ... "failed with the following error: " No value given for one or more of the required parameters . ". Possible causes for this failu

and my program is : 

DECLARE ? NVARCHAR(255) DECLARE ? NVARCHAR(255) DECLARE ? NVARCHAR(255) DECLARE ? NVARCHAR(255) DECLARE ? NVARCHAR(MAX); DECLARE ? NVARCHAR(255) 
DECLARE ? NVARCHAR(20) DECLARE ? NVARCHAR(20) DECLARE ? NVARCHAR(20) DECLARE ? INT DECLARE ? INT = CAST(CONVERT(NVARCHAR(8), GETDATE() - 1, 112) AS INT)
SET                ? = ?
SET                ? = ?
SET                ? = ?
SET                ? = ?
SET                ? = ?
SET                ? = ?
SET                ? = ?
SET                ? = ?
SET                ? = ? CREATE TABLE #tmp(granularityValue INT NOT NULL)
SET                ? = '
 INSERT INTO #tmp
 SELECT Calendar.' + ? + '
     FROM ' + ? + '  AS Calendar 
 WHERE  Calendar.' + ? + ' BETWEEN ' + CAST(? AS nvarchar(8)) 
                         + ' AND ' + CAST(? AS NVARCHAR(8)) + ' 
 GROUP BY Calendar.' + ? EXECUTE sp_executesql ?
SET                ? =
                             (SELECT DISTINCT sqlStmt AS 'data()'
                               FROM            (SELECT        N'ALTER DATABASE ' + DB_NAME() + + ' ADD FILE (NAME='+ REPLACE(DB_NAME(), ' ', '_') + '_FN_' + UPPER(?) 
                                                                                  + '_' + cast(#tmp.granularityValue AS nvarchar(8)) + ' , FILENAME=''' + ? + REPLACE(DB_NAME(), ' ', '_') + '_FN_' + UPPER(?) 
                                                                                  + '_' + cast(#tmp.granularityValue AS nvarchar(8)) 
                                                                                  + '.ndf''' + ' , SIZE=' + ? + ', MAXSIZE=' + ? + ', FILEGROWTH=' + ? + ')' + ' TO FILEGROUP ' + REPLACE(DB_NAME(), ' ', '_') 
                                                                                  + '_FG_' + UPPER(?) + '_' + cast(#tmp.granularityValue AS nvarchar(8)) + N';' AS sqlStmt
                                                         FROM            #tmp LEFT OUTER JOIN
                                                                                      (SELECT        master_files.name filename
                                                                                        FROM            master.sys.master_files INNER JOIN
                                                                                                                  sys.databases ON databases.database_id = master_files.database_id
                                                                                        WHERE        databases.name = DB_NAME()) files ON files.filename = REPLACE(DB_NAME(), ' ', '_') + '_FN_' + UPPER(?) 
                                                                                  + '_' + cast(#tmp.granularityValue AS nvarchar(8))
                                                         WHERE        files.filename IS NULL) tmp FOR XML PATH('')) EXECUTE sp_executesql ? DROP TABLE #tmp

Can you help me pls?

[ SQL query execution Task ] Error: "The execution of the request " DECLARE ? NVARCHAR (255) DECLARE ? NVARCHAR (255) OF ... "failed with the following error: " No value given for one or more of the required parameters . ". Possible causes for this failure : problems related to the application, property " ResultSet " not set correctly, parameters not set correctly, or connection not established correctly. "
[ SQL query execution Task ] Error: "The execution of the request " DECLARE ? NVARCHAR (255) DECLARE ? NVARCHAR (255) OF ... "failed with the following error: " No value given for one or more of the required parameters . ". Possible causes for this failure : problems related to the application, property " ResultSet " not set correctly, parameters not set correctly, or connection not established correctly. "

SSIS Script component

$
0
0

Hi,

I am getting column  from the query 48 columns,  but  am using the script component  pass all the column up to 45, still am able to access 48 columns . can you please suggest me how to remove the 46,47, and 48 columns in Flat file.

SSIS Compatibility Concern - SQL Server 2008 R2 vs SQL Server 2008

$
0
0

Hi community,

Our team is about to migrate SSIS packages developed in "Microsoft SQL Server 2008 R2 (SP1) - 10.50.2500.0 (X64)" to a database server with the version "Microsoft SQL Server 2008 (SP4) - 10.0.6241.0 (X64)".

Will those SSIS packages (SQL Server 2008 R2) experience compatibility issue in "Microsoft SQL Server 2008 (SP4) - 10.0.6241.0 (X64)".

Let me know. Thanks.

Mel


Change in order of fields in Target

$
0
0

All,

I am loading a table in oracle with SSIS. Coding was done on dev server and the ETL is working as expected. When the ETL was executed in assembly environment, it failed due to metadata issues. When I checked both the environments, the datatypes, column names are all same. The difference is with the order of columns. Something as below: -

If you can observe from above pic, Col1 is the first column in Dev but in asm it is Col3. I was until now assuming that the mapping happens by name and has no relation with Order of columns in target. Is my assumption wrong? The metadata is dependent on the order of columns in target?

Is there a way to handle this in SSIS?

sql server package error

$
0
0

my package is running fine locally

when i run into sql server agent job, its creating following error, when i expand error message its showing me sql server destination

Error throws up when running SSIS package upgrade wizard

$
0
0

Hello All,

I currently have a SSIS package that is running fine in visual studio 2010 (and SQL Server 2012) environment.

Now, I wanted to upgrade it to visual studio 2013 (and SQL Server 2014). I installed SSDT for Visual studio 2013, opened my package and ran SSIS package upgrade wizard. 

It throws me the below errors:

In short the error message is "The connection type "SPCRED" specified for connection manager "SharePoint Credential" is not recognized as a valid connection manager type.....

I guess it is because of the SharepointListadapter. I am loading data from a SharePoint site using this adapter I got from codeplex. I don't see a new version of this software in codeplex. Can someone please help me on how to move ahead with this.

Any help is highly appreciated. Thanks in advance!!

How to improve SSIS performance

$
0
0

I have an simple ssis package where it has extracts data from OLE DB source and dump into file..in source  i am using store proc to execute results....when i run this store proc in my environment it takes 2 minutes but ssis package is taking 45 mins...i implemented all techniques i found in google such as increasing DefaultBufferMaxRows from 10000 to 30000

making "runInoptimizedMode" to true and Enginethreads to 10..but still performance hasnt been improved...any other suggestions to improve SSIS package?

Bulk Insert in Execute SQL Task

$
0
0

Hi,

As part of a POC, I am in process of using the Bulk Insert command inside a Execute SQL task to read a CSV file. The file has been intentionally tampered to generate error rows, which I handle through an OnError exception handling on the task.

I have been able to load the valid rows in the destination table and the error rows in the custom error table via an INSERT statement in an Execute SQL task in Event Handler's OnError.

BUT, the problem lies with the fact that the errors generated, though handled with Event Handler, cause the package load to fail.

I am looking for an approach to ensure that the package does not fail due to the error, because in the final implementation this logic will be a part of a repetitive process for 200+ sources implemented through may be a ForEach container.

Note: I have already tried setting the MaxErrorCount with no success.


Cheers!! Sumit Bhatnagar


SSIS Bulk Insert Error Rows

$
0
0

Hi,

I am working on a POC to load data from CSV files into the SQL tables. I am using the SQL Bulk Insert command inside the EXECUTE SQL TASK instead of the SSIS' Bulk Insert Task is that I have the flexibility to identify and capture the Error rows. But with this decision I am dealing with its own share of problems.

I can think of using the SSIS Bulk Insert Task if I am able handle and use the error rows as well. Is there a way to do this?


Cheers!! Sumit Bhatnagar

delete files in App Server using SSIS

$
0
0

Hi

i need delete around 5 GB files from App server using SSIS monthly. can SSIS to do that?


SSIS Script component - remove unwanted columns in Flat File

$
0
0

Hi,

I am getting column  from the query 48 columns,  but  am using the script component  pass all the column up to 45, still am able to access 48 columns . can you please suggest me how to remove the 46,47, and 48 columns in Flat file.


SSIS 2012 Script always throwing same error

$
0
0

Hi,

I am writing the following code in my SSIS 2012 script task.I am deliberately trying to fali this code by adding some typos in the connection string.I want to catch the exception and display the exact exception message.but SSIS runtime is always throwing same error message as follows

Exception has been thrown by the target of an invocation.

at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)

at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)

at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)

at System.RuntimeType.InvokeMember(String name, BindingFlags bindingFlags, Binder binder, Object target, Object[] providedArgs, ParameterModifier[] modifiers, CultureInfo culture, String[] namedParams)

at Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTATaskScriptingEngine.ExecuteScript()

below is the code

  public void Main()
  {
    //TODO: Add your code here
            try
            {
                SqlConnection conn = new SqlConnection("Data Source=apsed1674;Integrated Security=true;database=EDX");
                //"Data Source=apsed1674;Initial Catalog=EDX;Provider=SQLNCLI11.1;Integrated Security=SSPI;Auto Translate=False;"
            }
            catch (Exception e)
            { 

MessageBox.Show(e.InnerException.ToString());
                throw e;
            }

##Temp table not creating suing SSIS package

$
0
0

Hi All,

In my SSIS package I want to create ## Global temp table.

below is the sample script.

IF OBJECT_ID('TempDB..##tmpv') IS NOT NULL
        DROP TABLE ##tmpv;

    CREATE TABLE TempDB..##tmpv
    (
            CountryCode     nvarchar(3)         NOT NULL
        ,   StateCode       nvarchar(3)         NOT NULL
        ,   Name            nvarchar(30)        NOT NULL
    );

when I am executing the above script from SSMS it worked fine and table gets created under the Tempdb database.

but when the same script I am trying to execute from Execute SQL Task in SSIS package, nothing gets created.

Drop table work fine with execute sql task in SSIS package.only problem with create table ##

I have updated 2 properties of OLEDB connection manager

Retainsameconnection=True

DelaValidataion=True

Please help me in above query.


Thankx &amp; regards, Vipin jha MCP


Execute SQL task fails with Error: 0x0 at : String or binary data would be truncated

$
0
0

I am using MS SQL2012  DB and I have a Execute SQL task to run a stored procedure from SSIS package, which fails with following errors.

Error: 0x0 at <Process Name>: String or binary data would be truncated

Error: 0xC002F210 at <Process Name>, Execute SQL Task: Executing the query "exec StoredProc1 ?" failed with the following error: "The statement has been terminated.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.

Error: 0x0 at <Process Name>: String or binary data would be truncated.

I have this execute SQL task inside a loop, which fetches each file from a folder and imports the data into a table. This stored procedure is called to process this table and update other tables. I am passing filename to this stored procedure as that has to be stored into different tables along with the data.

I have following settings

User::FileName is the only variable in the package as string

Execute SQL task has following settings

Connection Type :- OLE DB

Connection :- <Connection string to the DB>

SQLSourceType :- Direct Input

SQL Statement:- exec StoredProc1 ?

IsQueryStoredProcedure:- False

ByPassPrepare:- False

I have Parameter Mapping set to the User::FileName variable as Input, Varchar,0, -1

Could you please help me identify the cause of the failure and possibly the fix? 

Jet driver Excel problem again ....NULL values when reading XLS

$
0
0

Well, the first item about this problem, started in 2004 and still this is a problem in the year 2016. A collegae is testing an import from excel. I load the data in SQL with a SSIS package. I haven't tweak this yet. And the problem is this. The values:

text1

text2

tesx3

1

2

3

4

in a column is read as 

NULL

NULL

NULL

1

2

3

4

I would expect that the Jet engine identified the column a text but it seems that the column is identified as integer and the text is ignored. I can see 'quotes in the column for the text and when i enter text it doesn't have a quote ('). What do you think? 

Now how to solve this. Is there a best practice to solve this? I mention a couple of options:

  • Convert it to csv and then import it?
  • Create a template with couple of rows as text, hide them, delete them in import. Why is my import not working then because first lines are text?!
  • Registry change and IMEX adjustment
  • 1) Export the excel data sheet to a csv file, 2)  Change the csv extension to txt, 3) Open the txt file in Excel and use the Import Wizard to change all columns to Text, 4) Now Save the file as a Normal excel file and import it using SSIS Import Wizard

Are there better or other options?

The solution is that I first export the data into XLS, I let users change this and then I import these files into SQL Server. So I've a certain degree of freedom in exporting the file..

Hennie



Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>