Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Cannot create activeX components

$
0
0

Hi,

My SSIS package is running successfully in when run manually through visual basic but fails after I deploy it and run it as a job from SQL server agent. the same package was functioning in development environment but it is not working in QA environment.

Task : open macro enables Excel spreadsheet

Error : cannot create ActiveX component

there were many solutions suggested around DCOM. I have tried them, but it's not working. Excel 32 bit is installed on the server. SQL is also 32 bit.

Can someone please help me with the same?


Synchronize data between servers

$
0
0

What is the easiest way to synchronize all data and database objects between my development machine and hosting server? Is there any SSIS free script I can use?  

Could not load file or assembly 'Microsoft.AnalysisServices.Design'

$
0
0

Hi,

I have sql server 2012 and I am trying to create an SSIS package. It went fine on the first day of installation. But now I am getting the following error when ever I open the SQL Server Data Tools:

TITLE: Microsoft Visual Studio
------------------------------

Could not load file or assembly 'Microsoft.AnalysisServices.Design' or one of its dependencies. The module was expected to contain an assembly manifest.

------------------------------
ADDITIONAL INFORMATION:

Could not load file or assembly 'Microsoft.AnalysisServices.Design' or one of its dependencies. The module was expected to contain an assembly manifest. (mscorlib)

------------------------------
BUTTONS:

OK
------------------------------

Thanks in advance,

Pavan.

Data Flow Task BufferSize Tuning

$
0
0

Hello everyone,

I have encountered a problem when tuning the performance of a Data Flow Task recently. The DFT uses Flat File Source and OLE DB Destination to load data into a staging table. The DFT doesn’t contain any other asynchronous transformations except the Flat File Source. The overview of the DFT is as follows:

 

The package runs in 64-bit runtime mode. The DFT takes about 50 minutes to process 40 million - 50 million rows.

By enabling the BufferSizeTuning property on the DFT, I am able to obtain the buffer related information. First, I use the default settings for DefaultBufferMaxRow (10000) and DefaultBufferSize (10MB). However, in the package log, there are both 10MB buffers and 64KB buffers allocated. Please see the following log info:

User:BufferSizeTuning,TestDW,Test\administrator,Insert into Staging Table and Production Table,{feb3e0dc-f5db-400f-87f5-1561d93bc30f},{FFFC0B10-7BC3-43BC-85AC-6557CA654FA0},2014/12/15 19:34:45,2014/12/15 19:34:45,0,0x,Rows in buffer type 0 would cause a buffer size greater than the configured maximum. There will be only 3901 rows in buffers of this type.

……

User:BufferSizeTuning,TestDW,Test\administrator,Insert into Staging Table and Production Table,{feb3e0dc-f5db-400f-87f5-1561d93bc30f},{FFFC0B10-7BC3-43BC-85AC-6557CA654FA0},2014/12/15 19:34:46,2014/12/15 19:34:46,0,0x,Rows in buffer type 9 would cause a buffer size less than allocation minimum, which is 65536 bytes. There will be 1638 rows in buffers of this type.

…….

User:BufferSizeTuning,TestDW,Test\administrator,Insert into Staging Table and Production Table,{feb3e0dc-f5db-400f-87f5-1561d93bc30f},{FFFC0B10-7BC3-43BC-85AC-6557CA654FA0},2014/12/15 19:34:47,2014/12/15 19:34:47,0,0x,Rows in buffer type 10 would cause a buffer size less than allocation minimum, which is 65536 bytes. There will be 2730 rows in buffers of this type.

……

Buffer manager is throttling allocations to keep in-memory buffers around 850MB.

……

I also enable the Performance Monitor when the package runs, and I find that the number of buffers in use is around 19000, and the number of buffers spooled is a little larger than 19000. I understand that this happens because of the RAM pressure, and the buffers are spooled to hard disk. 

Now the questions are: 

  1. The flat file source doesn’t have BLOB type columns, and the size of different rows should be roughly the same. Why some buffers are 10MB, while some others are 64KB?
  2. For the 64KB buffers (which means the estimated row size * 10000 < 64KB), should not they have more than 10000 rows? Why only 1638 or 2730 rows are filled into the buffer?
  3. When I change the DefaultBufferMaxRow or DefaultBufferSize, it only affect the number of rows filled in the large buffers (I understand this is because the size of the buffers changes). There are still 64KB buffers allocated. So, I still not clear why and how the 64KB buffers are created. If it is because there are few large memory chunks (10MB) available for buffer allocation, I also set the DefaultBufferSize to 1MB or 5MB, but it doesn’t change the situation of the 64KB buffers allocations.
  4. Why is the memory used by all the buffers limited to 800-900MB? I suspect that most of the buffers are 64KB, and the SSIS pipeline controls the number of buffers to a certain number, thus, the total size of the buffers are even less than 1000MB.
  5. There is another package running at the same when this package runs as a job. I changed the BufferTempStoragePath of this package to a different folder than the TEMP folder, however, it seems doesn’t affect the package performance in the main.
  6. Could you give some suggestions to improve the performance of the package significantly without increasing the physical memory? 

Thank you very much if you could spend some time reviewing the scenario, and clearing up some of my doubts or giving some suggestions. 


Mike Yin
TechNet Community Support

How to generate SSIS packages using BIML

$
0
0

Hello friends,

i am writing BIML Code using C# for creating SSIS packages dynamically but my requirement is create ssis package with multiple data flow tasks.

Can any body have BIML(c#) Code to create SSIS packages with multiple data flow tasks dynamically  please send me.

Reagards

Anji

change-data-capture-oracle-attunity configuring CDC against RAC implementation

$
0
0

Can Oracle attunity CDC for SSIS be configure on Oracle RAC implementation ?

SQL Server 2012 - SSIS 2012 - Unable to connect oracle 32 bit

$
0
0

Hi Team,

I have a SSIS package which gets data from Oracle and load into SQL Server. When I run this package from a SQL job, its failing with below Error.

Attempt to load Oracle client libraries threw BadImageFormatException.  This problem will occur when running in 64 bit mode with the 32 bit Oracle client components installed

My source connection is : Oracle 11g 32 bit

I have used the ".NetProviders\Oracleclient Data Provider" Provider to connect my source system which is a oracle 11g 32 bit

When use this connection from SSDT, the connection is success and able to get data from oracle but when i configure this package in SQL 2012 job, its failing with below Error.

Attempt to load Oracle client libraries threw BadImageFormatException.  This problem will occur when running in 64 bit mode with the 32 bit Oracle client components installed

I have oracle client 32 and 64 bit both installed in my production where i am trying to run the package from Job.

Note : In Job step Properties-->Execution Options--> I have checked the "Use 32 bit run time" check box

Please help!


Dynamic connection string not working in SSIS package 2008R2

$
0
0

I am using SSIS package for Import data from excel sheet to SQL DB. In the configuration file I'm using following variables.

Name                     scope     DataType   Value
----------------------------------------------------------
 DBName                  package   String     DB_Master
 Password                package   String     xx
 UserName                package   String     sa
 ServerName              package   String     xxx.xxx.x.xx
 SqlConnectionString   package   String     DataSource=xxx.xxx.x.xxx;UserID=sa;Provider=SQLNCLI10.1;Integrated Security=SSPI;Auto Translate=False;Initial Catalog=DB_Master;Password=xx

Right click OLEDB ConnectionManager then click properties window below values assign

ConnectionString - Initial Catalog=DB_Master;DataSource=xxx.xxx.x.xxx;UserID=sa;Provider=SQLNCLI10.1;Integrated Security=SSPI;Auto Translate=False;

DelayValidation - True

Expressions     -ConnectionString - @[User::SqlConnectionString]

In SqlConnectionString variable properties window below values assign

EvaluateAsExpression    -True
 Expression              -"DataSource=" +  @[User::ServerName] + ";UserID=" +  @[User::UserName] + ";Provider=SQLNCLI10.1;Integrated Security=SSPI;Auto Translate=False;Initial Catalog=" +  @[User::DBName] + ";Password=" +  @[User::Password]

After deploy the package file I change the DBName in SqlConnectionString DB_Master to Master but package execute the files in DB_Master.

and also if i give invalid ServerName like 198.152.1 but package executed successfully.

Please tell me where i made mistake. what's goes wrong...?

I just use variable like below link

https://anothersqlgeek.wordpress.com/2013/03/28/ssis-dynamic-connections-part-1/comment-page-1/#comment-48



Pass Parameter to IN Operator in SQL Command in OLEDB source

$
0
0

Hi,

I am trying to pass multiple values as one parameter. Eg: I need to get the employess with gender in ('M','F')

query: select eno, ename, sal, gender from emp where gender in (?)

Created a variable 'varGender' with the value - 'M','F'

And passed the parameter mapping in OLEDB Source. But this is not returning any records.

Please advise.

Thanks.

Parameters cannot be extracted from the SQL command

$
0
0

Hi,

I'm trying to use SSIS OLE <acronym style="border-width:0px 0px 1px;border-bottom-style:dotted;border-bottom-color:#000000;cursor:help;color:#333333;font-family:Verdana, Arial, Tahoma, Calibri, Geneva, sans-serif;font-size:13px;line-height:normal;" title="Database">DB</acronym> Source to get some data using a logical date filter such that it only returns the data that has been added into the the data source since after the last execute time of the SSIS package.

The problem is I have to use a parameter in the query, and it spits out an error as soon as i click on the Parameters to add parameter to it.

here's the error content:

Parameters cannot be extracted from the SQL command. The provider
might not help to parse parameter information from the command. In
that case, use the "SQL command from variable" access mode, in which
the entire SQL command is stored in a variable.

Please i need help on this ASAP.

Thanks.


me

Data load from Multiple tables

$
0
0

Hi,

I have a requirement in which i have my source data in Oracle, DB2, excels and txt etc..! i have more than 100 tables of data which needs to be loaded into SQl serevr destination and also incremental logic should also be applied on top of it.

So can anyone suggest me the best approach in SSIS, So that i can design the package without creating so many data flow tasks and also there should not be any peformance degrade.. ! Please guide me on this..!

Thanks in Advance


Balaji - BI Developer

regarding ssis

$
0
0

Hi,

 in source table data having like this

Eno

Ename

Esloc

Deptno

1

Sreenu

Hyd

10,20,30,40,50

 

I want like this

Eno

Ename

Esloc

Deptno

1

Sreenu

Hyd

10

1

Sreenu

Hyd

20

1

Sreenu

Hyd

30

1

Sreenu

Hyd

40

1

Sreenu

Hyd

50

 How to do this?

regarding ssis

$
0
0

Hi,

I have one folder with 5 file text files by using for each file enumerator we store the files in to one folder but suddenly tomorrow one file add to that folder how to store the file into same destination?

Backword Compatibility with VS2013

Connection Manager - Expression ConnectionString

$
0
0

Hi

I have been unable to find the answer to this question and would appreciate any advice.

I have taken over a number of SSIS packages and wonder if the existing practise is fairly normal as I have not seen it done quite like this before. I need to create/modify the packages for changes to the existing import files or for new import files.

Each package imports a number of different text files with different columns, each input file has it’s own Connection Manager however all the Connection Managers share the same Expression ConnectionString and DelayValidation is False.

When looking at the Connection Manager I can set the Filename to one of the corresponding input files and preview the data etc., however once I open the Flat File Source Component I can no longer preview the data as the default value for the variable in the Expression Connection String is used which points to a file that is not there.

Should I

  1. Just set DelayValidation to True
  2. use separate variables for each Connection Manager (1 per input file format)
  3. change the default value for the file in the variable to match the components I am looking at
  4. something else

Thanks in advance

Shaun




Error importing text file into SQL Server when last column is null

$
0
0

Hello all. Happy holidays!

I'm trying to import a text file into a SQL Server table, and I get the error below when it gets to a row (row 264) that has null in the last column. I'm guessing the null jumbles up the delimiters somehow. The nulls are not errors, and I need to import them into the table with the rest of the rows. Any idea how I can do that?

Thanks!

[Flat File Source [1]] Error: Data conversion failed. The data conversion for column "XYZ" returned status value 2 and status text "The value could not be converted because of a potential loss of data.".

[Flat File Source [1]] Error: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "output column "XYZ" (178)" failed because error code 0xC0209084 occurred, and the error row disposition on "output column "XYZ" (178)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.

[Flat File Source [1]] Error: An error occurred while processing file "ABC.txt" on data row 264.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "Flat File Source" (1) returned error code 0xC0202092.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.


WeeLass

Kerberos authentication with SSIS 2014

$
0
0

Hello,

I have a test package deployed to SSIS catalog on SQL server. When the package is ran from SQL agent job, run the package locally from the server itself or when it is ran from visual studio, it runs just fine. But when try to execute from SSMS or DTEXEC from another machine (my pc), it gives the this error Login failed for user 'NT AUTHORITY\ANONYMOUS LOGON'. It appears to be a Kerberos issue and I have done few set up of Kerberos for SQL servers and Analysis service, but not sure how to set it up for SSIS service. So, I have couple of questions.

1. Does anyone know if SSIS 2014 service (with SSIS catalog) can delegate the credentials?

2. If I need to create SPN for SSIS then When creating SPN for SSIS service, what is the Service Class name? For example: for SQL server it's MSSQLsvc.

I appreciate your help.

Raj


SSIS - BypassPrepare what does this mean ?

$
0
0

Please look at SQL task, General > SQL Statement > BypassPrepare. It says that BypassPrepare indicates whether the task should prepare the query before executing it.

What is meant by "prepare the query before executing it". Why do we need to do this ?

Also, when I press "parse query" button for my SQL query, then I see this warning "this operation has no effect since bypassprepare property was set to true". What is the meaning of this and should I be concerned about it ?

Connectivity issue with Oracle Source

$
0
0

Hi,

Am trying to run a SSIS package to pull data from Oracle. Package was running fine from BIDS.But when i run the job from Sql Agent am getting the below error.Can you please help me on this.Am using 2012 version of SSIS

Message
Executed as user: ABCDEF\SQLDEV015. Microsoft (R) SQL Server Execute Package Utility  Version 11.0.5548.0 for 64-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  9:32:29 PM  Error: 2014-12-22 21:32:31.32    Code: 0x000002BD     Source: Package4 Connection manager "ORACLE"     Description: Oracle Home not found.  End Error  Error: 2014-12-22 21:32:31.32     Code: 0x0000020F     Source: Connect to ORACLE Oracle Source [2]     Description: The AcquireConnection method call to the connection manager ORACLE failed with error code 0x80004005.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.  End Error  Error: 2014-12-22 21:32:31.32     Code: 0xC0047017     Source: Connect to ORACLE SSIS.Pipeline     Description: Oracle Source failed validation and returned error code 0x80004005.  End Error  Error: 2014-12-22 21:32:31.32     Code: 0xC004700C     Source: Connect to ORACLE SSIS.Pipeline     Description: One or more component failed validation.  End Error  Error: 2014-12-22 21:32:31.32     Code: 0xC0024107     Source: Connect to ORACLE      Description: There were errors during task validation.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  9:32:29 PM  Finished: 9:32:31 PM  Elapsed:  1.422 seconds.  The package execution failed.  The step failed.

Cannot create activeX components

$
0
0

Hi,

My SSIS package is running successfully in when run manually through visual basic but fails after I deploy it and run it as a job from SQL server agent. the same package was functioning in development environment but it is not working in QA environment.

Task : open macro enables Excel spreadsheet

Error : cannot create ActiveX component

there were many solutions suggested around DCOM. I have tried them, but it's not working. Excel 32 bit is installed on the server. SQL is also 32 bit.

Can someone please help me with the same?

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>