Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

SSIS Performance/architecture

October 30, 2012, 10:17 am
$
0
0

Hi folks,

i read it in a thread here that says SSIS has a buffer based architecture and the ability to 'chunk' the load into manageable pieces etc and so would be powerful than using linked server. can someone please provide more details about how the ssis architecture is better for performance etc as opposed to linked server? thanks for helping out.

↧
Search

Extract Data from SharePoint List Performance Issue

October 25, 2012, 1:25 pm
$
0
0

Hi All,

I am extracting records from SharePoint List to SQL Server by using SharePoint List Source Adapter in SSIS. It is working well if I have small amount of records whereas I am trying to pull around 50.000 records and package is always failing. It says 'The value is too large to fit in the column data area of the buffer'.Beside this when I am loading SharePoint List I am having performance issue,it is taking too long. Does someone have an idea about these issues?

Thanks in advance 



↧
↧

Foreach Loop Container in SSIS

October 25, 2012, 8:14 am
$
0
0
I am using for each loop container in ssis. I need to extrat excel file from my folder.
example file names:- january 2012, march 2012 etc. My problem is i need to extract only current month file (which is October 2012). Any idea?

pulikondas

↧

SSIS Export to Excel 2007 and re-import of .xlsb causes "previous beta version of Excel 2007 file format" error

February 1, 2010, 5:05 pm
$
0
0
Hi,

I'm experiencing a problem that first surfaced around the time hotfix KB973593 was released in Nov 2009.

This patch was released and our WSUS server automatically updated all our client workstations running Office 2007 SP1 with it.  Note that SP2 hadn't yet been deployed to these workstations.

I run a series of SQL Agent jobs executing SSIS packages that export data from SQL Server 2005 to a .xlsb Excel file.  These files are then picked up by operators using the above mentioned workstations, modifed in some way, and then saved.  The saved files are then re-imported by another SSIS package back into the same database, updating data where relevant.

This was what was occurring without error until KB973593 was deployed (automatically) by WSUS.

Now, the package that reimports the .xlsb file is failing, with the error message:
"SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft Office Access Database Engine"  Hresult: 0x80004005  Description: "This file was created in a previous beta version of Excel 2007.  Open the file with Excel 2007 to save it to the most recent version of the Excel 2007 file format before opening the file in Access 2007."."

I was able to replicate the problem on my local development workstation.  Whenever I tried to test the SSIS connection to the (saved) .xlsb file, I would get a similar message.  The solution I found was to apply Office 2007 SP2 to my machine.  Now the connection manager can open the .xlsb file.

However, when I run the package on the development server (and the same behaviour occurs on our Production server), the same error occurs.  Obviously, I need to apply Office SP2 to our servers.

Except they do not have MS Office installed on them!

So, what do we know? 
The version of Excel has been increased from 12.0.6214.1 (which works) to 12.0.6514.5 (by KB973593).  This would appear to contain some changes to how the file is saved.
Business Intelligence Development Studio (BIDS) is fixed by deploying Office 2007 SP2 on to local workstations.
BIDS (and by extension, SSIS) is not fixed on servers that do not have Office 2007 installed on them.

What patch / hotfix do I need to apply to our servers in order for SSIS to be able to interpret the new file format for Excel 2007 SP2?

Version of MS Office Access Database Engine 2007 12.0.4518.1031
SQL Server 2005 SP3 is installed.  (v9.0.4035)

Any (speedy) help greatly appreciated.
↧

SSIS UI question about Available Output Columns in script task

October 25, 2012, 11:58 am
$
0
0

For some reason I have columns in "Available Output Columns".  How did these get there?  I did not explicitly add them.  I recognize they are in the first table added to the script task output but I could not find any additional properties in the UI or XML Code to earmark this table/coloumns for output.  28 other tables exist, but those tables' columns do not exist.

This is how to navigate to that dialog box: Data Flow -> Script Task -> Advanced Editor -> Column Mappings -> Available Output Columns

Thanks for any explanation!
-r

↧
↧

SSIS 2012: Package execution hierarchy recorded in new Project Mode SSISDB Event Logging?

October 29, 2012, 12:38 am
$
0
0

Hello,

We have started using the new "Event Logging" feature provided for SSIS 2012 Project Deployment model.

We have a complex ETL system comprised of multi-level package calls between parent-child packages.

For example, a Master package has a For Each Container, which contains a "Execute Package Task", which runs child packages 1 to 5. Each Child package has Data Flow Tasks (which contain data flow sources, transformations and destinations.) and For Each Containers which can contain level 2 child-packages via "Execute Package Tasks"

Master Pkg
  Level-1 Child Pkgs
     Level-2 Child Pkgs
       .........

How can we use event logging data to trace back executales in Level 2 child packages to their calling Level 1 and Master Package executables?

I notice that [SSISDB].[catalog].[executable_statistics] view has a column '[execution_path]' which shows the execution hierarchy textually, however, we would like to be able to link it back via the Executable Ids.

In addition, can we find out the values of variables, parameters at the time when an executable (control flow components) got executed? For example, It is handy to know the relevant Loop variable value of "For Loop" and "For Each Loop" containers for each iteration.


↧

[Excel Destination [156]] Error: Cannot create an OLE DB accessor. Verify that the column metadata is valid.

October 24, 2012, 2:23 am
$
0
0

Hi,

I am trying to insert data from Sql to excel destination,but I am getting error as below:I have tried many ways but no luck.This is urgent requirement ,can any one help me asap.

[Excel Destination [156]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E21.

[Excel Destination [156]] Error: Cannot create an OLE DB accessor. Verify that the column metadata is valid.

[SSIS.Pipeline] Error: component "Excel Destination" (156) failed the pre-execute phase and returned error code 0xC0202025.

Regards,

sudha

↧

SSIS Raw Files

October 25, 2012, 6:21 pm
$
0
0

HI,

I have a question regarding SSIS raw files .. we create SSIS raw files in the C:\Temp\ folder on our server .. This is the SQL server 2008 server.

Creating raw files and then loading them into the database via BCP has acutally made our loads faster for huge files using SSIS. However occasionally due to some rogue process running  on our production server the C drive becomes full and the SSIS load process crashes causing much overhead to make space on the C drive and restart the loads again. 

Can this raw file generation process be moved to D folder (where there is more space and very minimal chance of this crashing ?), I explicitly have this question because I have been told that - creating this on the C drive actually makes this faster - I just want to substantiate this thought.

Any thoughts on this would be appreciated.


↧
Search

flat file connection manager

October 25, 2012, 8:12 am
$
0
0
my file is like this

TH*4.2*857463*01**20091015*1045*P**~~IS*7564*ORACLE~

i have two table

table : TH
ID      TH1     TH2     TH3      TH4       TH5       TH6    TH7  TH8 TH9
TH      4.2      857463 01         *     2009105   1045    p   *        ~~

TABLE : IS

ID       IS01      IS02
IS       7564       oracle


now in my flat file connection manager i am using column delimeter as *,but then i cannot store values in
TH04 and th08
it just skip *,

how do i store value i shown here
↧
↧

OLE DB configuration in SSIS package run from Command Prompt

October 25, 2012, 5:58 am
$
0
0

Hello

I think this is probably a very basic question but I'm new to SQL so having trouble figuring this out.

I am executing an SSIS package from the command prompt using the dtexec command. My SSIS package moves data from a flatfile source to a table in a SQL database. I'm using the /connection to configure my flat file source in the command prompt and this is working fine.

However I'm having trouble configuring the location of the SQL database (I want to override the connection in the original package through the command prompt). My code looks like this (I'm passing parameters into the command prompt which will replace the %1 and %2):

dtexec /f "C:\Users\s813\Documents\Visual Studio 2008\Projects\Import_Valuation_RPTs\Import_Valuation_RPTs\Import_NL_Run.dtsx" /CONNECTION "Import_NL";%2 /CONNECTION DHX31118.RPTs.dbo.RPT_Run1;DHX31118.RPTs.dbo.RPT_Run%1

I'm quite sure I've specified the connection to the SQL database incorrectly but I'm not sure how to specify it? The SQL Server is on my C drive.

Any help would be much appreciated!

↧

Analyze ExecuteSQLTask output to and make decision ?

October 31, 2012, 1:42 am
$
0
0

I have a SSIS ExecuteSQL task which will return 1 on success and 0 on failure. I want to analyze the output from ExecuteSQL task and execute some taks (Ex:- FTP....etc) if the query output is 1 and if the query output is 0 i want to exit the package.

Please let me know if you need more information.


↧

how to export SQL data to xml file for each record.

October 31, 2012, 3:09 am
$
0
0

How to export SQL data to xml file for each record using SSIS 2005.

Thanks

Ashish

↧

importing data from excel to sql server 2008 using ssis

October 31, 2012, 5:12 am
$
0
0

Hi

I have project of import data from excel and insert it to sqlserver 2008 using ssis

dataconversion i have use for data type conversion but from excel sheet having date column having some date like "#######","31 oct 2012" and "31-10-2012" so which data type i have to use during conversion ...i have tried with "text stream" but gives error multiple-step oledb...

↧
↧

how to tranfer file from one folder to another incremetally

October 31, 2012, 2:49 am
$
0
0

Hello everyone,

I have two folder

1)Source Folder

2) Destination Folder

i want to copy file from source folder and paste it into destination folder

i want to make it incremental load means file copied previously should not be copied again

can i do this using SSIS .I will put the scheduler which will run for every hour

↧

Is It Bad to Update the 'catalog.environment_variables' View?

October 31, 2012, 6:19 am
$
0
0

Hello

I'm looking for a way to programmatically update the variables associated with a particular environment in the Integration Services Catalogs (using SSIS 2012). For instance, a user needs to update an environment variable via a web front end - I want to be able to show the user the current value of the variable, and have the new value written back so that the environment variable reflects the change.

I have managed to achieve this by performing an update on the catalog.environment_variables view, which seems to work fine. I'm wondering, however, whether this is dangerous/bad practice, and whether another approach exists.

Thanks.

↧
Search

failed with error code 0xC0202009

October 31, 2012, 6:39 am
$
0
0

Good Morning All,

I have no idea why the SSIS is so complicated. I have a package in BIDS and its part of a project that i created. The source is ORACLE and the destination is SQL SERVER DB. The package is staright forward load from tables in the oracle database into the SQL SERVER db. It ran fine yesterday and all of a sudden when i opened it in BIDS to run its giving me the following error:

[HISTORY_TBL [1]] Error: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "PROD.USER" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

In the connection manager i checked the box: saving the password.

In the properties i changed the delay validation from false to true.

The protection level is "Do not save sensitive".

In spite of all this its giving me the error messages.

Please need help.

Thanks

↧

Oracle Connection Error in SSIS

October 25, 2012, 6:58 am
$
0
0

Hi All

I am trying to connect oracle connection in ssis packge.I am getting below error. But already I have one connection for production oracle database server. I am getting below error for QA Oracle Server.

Test connection failed because of an error in initializing provider.ORA-12514: TNS: listener does not currently know of service requested in connect descriptor

Thanks

CMK

↧
↧

How to Load Data to Relational Tables without violating constraints in SSIS?

October 31, 2012, 8:32 am
↧

biml mysql ado

October 31, 2012, 7:12 am
$
0
0

Hi,

I need to create a MySQL connection using ado in biml.

Does anybody know how to do this?

Mr Shaw

↧

.net in script component

October 31, 2012, 8:30 am
$
0
0
hi,

my table field is getting value from file,if * is there, then it null.

now in my script component ,

Select Case (segmentcode.ToUpper())

            Case Segments.EMP.ToString.ToUpper()
                Row.empno = Convert.ToInt32(SegmentValue(arrLine, 1))
                Row.empname = SegmentValue(arrLine, 2)
            --    Row.salary_IsNull = Convert.ToInt32(SegmentValue(arrLine, 3))
                Row.manager = SegmentValue(arrLine, 4)

if you see here ,salary is null in file,means it has *,i need to put blank in my table.

if i run this script ,i am getting error,because of third line,  Row.salary_IsNull = Convert.ToInt32(SegmentValue(arrLine, 3))

how to handle this
↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>