Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

How do I set a ComponentID for a Custom Dataflow component (derived from DtsPipelineComponent).

$
0
0
Data flow components have different ComponentID's depending on what type of component they are.  If I build a custom dataflow component I would want it to have a ComponentID that is different from the standard 'out of the box' components.   Is there some way that I can explicitly set the componentID of a custom component?  By default they have the ComponentID of a 'Script Component' (this is also the case for the MS samples including 'RemoveDuplicatesCS').  This does not seem correct.   I have other code that interrogates SSIS packages and does different things depending on what type of component something is.  Is the ComponentID the 'best' way to programmatically determine the type of a given component or is there a 'better way' that is supported by the SSIS object model.  If the ComponentID is the best thing to use is there some way I can give my custom components different ComponentID's from the 'Out of the box' script component.   (I have just extensively edited this as first post got truncated and format was mangled - hopefully this might be a bit better). 

Visual Studio 2005 SSIS solution. How to re-include excluded package ????

$
0
0

Hello,

I have an SSIS solution in Studio 2005.

I excluded one of the packages in it by highlighting the package and then

right clicking on SSIS packages and clicking "EXCLUDE FROM PROJECT"

Now,

I would like to include that same package back into by solution.

How do I do that?

When I add existing package and I click on the same package name, it brings in the package

as the same name but with a (1)

package.dtsx

package (1).dtsx.

How to include the original package in the solution??????

Thanks.

UniData to SQL Server using ODBC

$
0
0

I am trying to do simple import of UniData into SQL Server 2008 using SSIS 2008.

This is my first time using SSIS, so I want to keep the dataflow simple.  I am transferring data from an ADO NET Source directly into an ADO Net Destination and receive an error when I try to read in varchar values into the source.

When previewing the data in the ADO NET Source, all the data previews correctly, however when I try to execute the package I receive the following error:

SSIS package "Package.dtsx" starting.
Information: 0x4004300A at Data Flow Task, SSIS.Pipeline: Validation phase is beginning.
Information: 0x40043006 at Data Flow Task, SSIS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Data Flow Task, SSIS.Pipeline: Pre-Execute phase is beginning.
Information: 0x4004300C at Data Flow Task, SSIS.Pipeline: Execute phase is beginning.
Error: 0xC0209029 at Data Flow Task, ADO NET Source [1233]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "component "ADO NET Source" (1233)" failed because error code 0x80131937 occurred, and the error row disposition on "output column "ID" (1248)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.
Error: 0xC02090F5 at Data Flow Task, ADO NET Source [1233]: The component "ADO NET Source" (1233) was unable to process the data. Pipeline component has returned HRESULT error code 0xC0209029 from a method call.
Error: 0xC0047038 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "ADO NET Source" (1233) returned error code 0xC02090F5.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.
Information: 0x40043008 at Data Flow Task, SSIS.Pipeline: Post Execute phase is beginning.
SSIS package "Package.dtsx" finished: Canceled.

The dataflow does however run to completion if I only select columns of integer, date, float, etc datatype.

backup of 2000 database to 2012

$
0
0

i wan tot back 2000 database to sql 2012.

but it shows an error : "not compatible with this version."

is there any other way i can do it

Why are the columns off in my SSIS output table?

$
0
0

This is what the SSIS package does:

- Pulls file from FTP 

- LOOPS

- Parse Data (Fixed width)

- Stores data to database.

It had been running fine but now the issue i have been facing is that, for instance, data that was supposed to be added to column A is now added to column M (this is an example), I know, if it could start adding data from column A, everything would be fixed. 

Could somebody please explain me why this happened and how can I fix it?

Thank you,

SSIS, FTP, and a Proxy server

$
0
0

Hello, I'm hoping someone can help or at least say that what I'm being told is "inaccurate"

Our team has had to keep a SQL Server 2000 box (no snickering please) around b/c it has an old scripted FTP job that sends files across to a remote server through a firewall with specific rules to allow this.

We've been wanting to move this to a new SQL 2008 box for some time and have a package already written to do so.  However, our network folks have said that the server cannot have any direct internet access and the FTP job will have to go through a proxy server.  A web browser on the server works but needs the proxy server setup (under LAN Settings) to work.  After searching the web and looking at the FTP connection manager and the FTP task I can find no explanation of how this would be accomplished.  Arguments to the effect that this is the way it's already being done and we are not proposing anything new, only to replace one server with another have been rejected.

Is this possible? if not, it'll give me some backing as to why what they are telling me will not work and we need a new firewall rule put in to allow this.  Help!

Building solution independant of server

$
0
0

Hi,

i have a  solution of SSIS package with me.

Whenever, i try to deploy it in either dev or test environment using only, DTSX, CONFIG, DeploymentManiFEst files,

I am not able to deploy it successfully.

Instead i need to go for taking the whole project file to that environment and then i have to test run that from BIDS and then i am taking out the package files to do the deployment.

Is there any way, so that only taking those 3 files from local, and installing the package using Manifest file and modifying the Configuration as per DEv or Test server to deploy the solution? instead of taking up the whole project ?

Please let me know how can we build solution independent of any machine which can fit into Dev or TEst just only by modifying the package's server name in config file?

Thanks !


--------------------------- Radhai Krish | Golden Age is no more far | --------------------------

audit table with pacakge info

$
0
0

Need to create audit table with data for each package exectution

source excel filename, source row count, insert row count, error count, update row count, Loadstatus etc..

How to use trigger for this criteria ? shall i use event handers ? can u share any example

ShanmugaRaj



Package not running on SQL Server Agent Job

$
0
0

Hi Experts,

I have created one package this just like exporting files to the FTP site. When I run manually it is running successfully and able to export files to the FTP site. 

I tried it through SSMS(integration services) when I run here it is working fine.

But When I set up this in the SQL Server agent Job it is failing. 

Note: This agent Jobs running under Admin Account and I have developed  the package under Admin account only 

It is throwing an error like this 

Message
Executed as user: XXXX\Administrator. Microsoft (R) SQL Server Execute Package Utility  Version 9.00.4035.00 for 32-bit  
Copyright (C) Microsoft Corp 1984-2005. All rights reserved.    Started:  09:09:45  Error: 2012-11-07 09:09:46.12    
 Code: 0x00000004     Source: Script to check whether the WamNet task succeeded or failed      Description: 
The Script returned a failure result.  End Error  DTExec: The package execution returned DTSER_FAILURE (1). 
Started:  09:09:45  Finished: 09:09:46  Elapsed:  0.968 seconds.  The package execution failed.  The step failed.

Any Idea please.

Importing multiple tables from multiple databases with same design.

$
0
0

Hey everyone,

I'm going to admit upfront, I'm pretty new to the SSIS world, I have background in SQL Server but not much with these DW tools.

Here is my "situation"

I have a tool that when used creates a new database per project (uses MySQL). Each project has a shared schema, however depending on which plugins within the tool are run will determine whether a specific table exists or not. I'm in the early stages of beginning to build a DW for these projects. We have used this tool for some time but don't have a good way to perform historical analysis on the data as each project is fragmented into its own database and there is little data cleansing performed.

Here is my initial desire/"vision"

I was going to create an SSIS package that performs the initial ELT on these databases, what I would like would be to create a situation where I could do as follows:

Connects to our MySQL database server where there are multiple databases per project/user. I assume I can use a solution similar to here, here and here. All of these databases share a similar schema, however they may not all have the same "extra" tables (all have the same core tables).

Loops through and in turn connects to each database and first imports the core tables that are the same for every table and puts them in a staging database.

Then, and this is the part I'm not sure on (I think I can figure out the stuff leading up to this). I'd like it to import all "extra tables that exist in the current database" ie all extra tables are prefaced with the same leading name like"preface_table_name" so I would like it to import all tables it finds with that preface.

I'm comfortable with stored procs and the like so I planned on utilizing them to then dice and clean up the various imported tables for adding them to the dw.

I'm more then willing to put in the work figuring this out, but was hoping someone could point me in the right direction. It's a bit of a crazy project for my first serious work with SSIS and I'm trying to wrap my head around all the concepts. If I am completely out in left field, by all means correct me as needed.

Thanks in advance for any help you can lend!

Error:ADO.NET source connection issue

$
0
0

Hi,

I am using ADO.net source in ssis package to pull the tablesto destination.But I am getting the error as attached document.

Can anyone help me on this.This si svery urgent requirement;


sudha

file system task source mutiple files

$
0
0

I want to use file system task to move all the files in the source path with *.csv  

@[User::FolderPath] + "*.csv"

I dont want to use for each loop for this..

Is it possible ? any suggestion ?


ShanmugaRaj


Designing packages programatically + disposing

$
0
0

I am designing packages using DTS libraries and what I am wondering is that no one is DTS objects (Packages, ConnectionManagers, Variables...almost everything) disposing (even most of them are disposable). Neither on MSDN. Why?

Why are for example variables disposable?

BULK Insert got incorrect data

$
0
0

Hi Guys,


I have an excel data.
just save the file as CSV and TXT file format.
I'm using  BULK insert to replicated or insert the data into temporary table and i got an error.
I notice also when i tried to change the size of each datatype to a bigger size something like
10 for itemid and the rest i change it to 100 and it works fine but all those records with comma
the records was not completed especially for descript, model and category column where some text has a comma.

Any idea guys to fix this issue. Thanks.

Bulk Insert #VPTable
From '\\Reportdata\Axapta Reports\MPA TEST DATA.csv'
With
(
DATAFILETYPE = 'char',
FieldTerminator = ',',
CODEPAGE = 'OEM',
KEEPNULLS,
RowTerminator = '\n', FirstRow = 2)

CSV FILE

RESULT after BULK INSERT:


Can I create macros for VSA of SSIS Script Components/Tasks?

$
0
0

Hello all,

Is it possible to write macros for VSA used for Script Components/Tasks?

I have a way handling columns in script component transforms that is used often.  I would like to create a macro that will prompt me for the column name, then insert the default lines of code using that column name.

FYI: I have almost no experience with VS other than using the version of VS/BIDS that came with SQL Server 2005 to create SSIS packages...which doesn't appear to have (please excuse my ignorance) any major programming languages "associated" with it/very limited project template selection...mainly just BI projects.  Most of my coding experience is VBA behind Excel.  Can the macro I'm wanting to create be done in VB Express Edition?  If possible, just give me the major points to start me in the right direction...hopefully I can figure out the rest.

Thanks,

CTB


Excel error 64-bit version of SSIS

$
0
0
I have a 64bit system and installed ssis on my system.
How do I changed the ssis project to 32 bit. I have this error:

Information: 0x4004300A at Data Flow Task, SSIS.Pipeline: Validation phase is beginning.

Error: 0xC00F9304 at Package, Connection manager "Excel Connection Manager": SSIS Error Code DTS_E_OLEDB_EXCEL_NOT_SUPPORTED: The Excel Connection Manager is not supported in the 64-bit version of SSIS, as no OLE DB provider is available.

Error: 0xC020801C at Data Flow Task, Excel Source [1]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC00F9304. There may be error messages posted before this with more information on why the AcquireConnection method call failed.

Error: 0xC0047017 at Data Flow Task, SSIS.Pipeline: component "Excel Source" (1) failed validation and returned error code 0xC020801C.


Joe

CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER

$
0
0

Hi,

I have a SSIS package that runs ok when Im running from any desktop. (It works in BIDS and SSMS)

But when I log onto the server (with the same account) -  SQL Server 2008 R2 - I get an error

SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009

I get this on the server in BIDS, SSMS and when running from an agent job.

Any ideas what this might be?

Thanks,

Zoe

Cannot deploy SSIS project to the new SSISDB get error message

$
0
0

I recive the following error message trying to deploy a  SSIS project from VS2010 to SQL SERVER 2012.

A .NET Framework error occurred during execution of user-defined routine or aggregate "deploy_project_internal":
System.ComponentModel.Win32Exception: A required privilege is not held by the client
System.ComponentModel.Win32Exception:
   at Microsoft.SqlServer.IntegrationServices.Server.ISServerProcess.StartProcess(Boolean bSuspendThread)
   at Microsoft.SqlServer.IntegrationServices.Server.ServerApi.DeployProjectInternal(SqlInt64 deployId, SqlInt64 versionId, SqlInt64 projectId, SqlString projectName)
. (.Net SqlClient Data Provider)

I change the SQL servers account to use a local admin account  that is a member of local administrators , and have added the SQL server account to DCOM Config  Microsoft SQL Server Integration Services 11.0,” node security as per Peter instructions , however still cannot deploy a project get the some error message.

Please advice.


drop table

$
0
0

when i am uploading data using import export wizard,i got execute sql task,

which create table,so when second time i run the package i need to drop the table and then execute the package.

is there anything i can do in execute sql task. si dont need to drop the table again and again

SQL Server Destination failed

$
0
0

SSIS job was working fine from sql server agent with local sytem account. it is started failing since the account is changed from local system account to a domain account. the new domail account is also added into administrators group in that server.

 Error:

 SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E14.  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80040E14  Description: "Could not bulk load because SSIS file mapping object 'Global\DTSQLIMPORT              ' could not be opened. Operating system error code 5(Access is denied.). Make sure you are accessing a local server via Windows security."

windows account also has all the permissions as mentioned here. 

http://technet.microsoft.com/en-us/library/ms143504.aspx#Review_windows_permissions

 


Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>