Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Shared and re-use common SSIS packages with other projects

$
0
0

Hi,

As the SSIS related projects are continue to grow in our team.

Please advise whether we can reuse SSIS packages from one project to other projects .  (Similar to share with C# objects)

Ideally, if we can point common SSIS packages from one common project (with all common SSIS packages).

Appreciate your help.

Regards,

Peter


SSIS Package - An OLE DB error has occurred. Error code: 0x80040154.

$
0
0
I am getting below error when i try to execute a package using batch file 

Microsoft (R) SQL Server Execute Package Utility
Version 9.00.1399.06 for 64-bit
Copyright (C) Microsoft Corp 1984-2005. All rights reserved.

Started: 7:15:29 AM
Progress: 2014-10-01 07:15:36.05
Source: Data Flow Task 
Validating: 0% complete
End Progress
Error: 2014-10-01 07:15:36.05
Code: 0xC0202009
Source: ADTM001_UPDATE_COSTS_TIU0560 Connection manager "Excel Connection Manager"
Description: An OLE DB error has occurred. Error code: 0x80040154.
An OLE DB record is available. Source: "Microsoft OLE DB Service Components" Hresult: 0x80040154 Description: "Class not registered".
End Error
Error: 2014-10-01 07:15:36.05
Code: 0xC020801C
Source: Data Flow Task Read Data From XLS [1]
Description: The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009.
End Error
Error: 2014-10-01 07:15:36.05
Code: 0xC0047017
Source: Data Flow Task DTS.Pipeline
Description: component "Read Data From XLS" (1) failed validation and returned error code 0xC020801C.


I have tried to use 32 bit exe as well , But then i get below error , 

Could not load package because of error 0xC0014062.
Description: The LoadFromSQLServer method has encountered OLE DB error code 0x80004005 (An error has occurred while establishing a connection to the server. When connecting to SQL Server 2005, this failure may be caused by the fact that under the default settings SQL Server does not allow remote connections.). The SQL statement that was issued has failed.

How do I import a SPSS .sav file into SQL 2008 r2 using SSIS

$
0
0

Hi there,

Like the title says, I'm trying to import an SPSS .SAV file into an SQL 2008 R2 database using SSIS.
I've tried a few things, but i cant seem to get it to work properly. I'm hoping there's someone out there who could point me in the right direction.

I've tried the following:

  • Tried the IBM step by step manual (http://pic.dhe.ibm.com/infocenter/spssdc/v6r0m1/index.jsp?topic=%2Fcom.spss.ddl%2Faccess_odbc.htm)
    --Couldnt folow this guide because I didnt have the SPSS MR DM-2 OLE DB Provider.
  • Tried installing the provider using (http://pic.dhe.ibm.com/infocenter/spssdc/v7r0m0/index.jsp?topic=%2Fcom.spss.ddl%2Fdts_troubleshooting.htm) as a guide to download the provider listed (www-03.ibm.com/software/products/nl/spss-data-model).
    --This didnt work, I still could not see the provider listed after install and rebooting the server.
  • Tried to get the file as CSV (Company couldnt provide it in CSV or another format)

The server is a Windows Server 2008 R2 Enterprise 64-bit, has the Data Collection Data Model installed on it with SQL Server 2008 R2.

If anyone could point me in the right direction they could make my day!

Thanks in advance!

Ronny




Log to text file contained in variable name

$
0
0

Hi,

I order to create a log for my SSIS Package, I want to log to a text file.
I can do so on my own PC to a location like:

C:\Users\PCUSERNAME\Documents\Visual Studio 2008\Projects\Project Name\log.txt

What I would like is to have that as a variable, so that, it can be easily changed to wherever the log file will reside once the job is in production?

Is it possible to do so?

If I try putting a variable name instead of a file name, it doesn't let me press 'OK' on the logging provider.

How to Format a excel template sheet column data using ssis

$
0
0
Hi,
I am filling an excel sheet named sheet1 of a predefined template using SSIS. The template has many other sheets which are calculated using predefined formulas referring sheet 1. Currently I am able to successfully fill the data in sheet1 but other sheets not getting populated until I manually perform Text Column conversion on few columns like Date,Time(hh:mm:ss). Could some one please help me to achieve this task. Can I automate the Text to Column conversion operation after filling the excel.

Thanks in advance,
Jithu

SSIS 2008 R2 - How to determine if GUID is from this package

$
0
0

Hi,

I need to check if the GUID stored in the System::SourceID in an event handler is from a Task in the current package.

I’m thinking on doing a loop thru all Task in the package do see if I get a match. However, I do not know how to do it.

If you have a better way to do it, I would appreciate the help. However, I would like to avoid any solution that needs to write and read data from a table…

Thanks in advance,

Tiago.


Excel error 64-bit version of SSIS

$
0
0
I have a 64bit system and installed ssis on my system.
How do I changed the ssis project to 32 bit. I have this error:

Information: 0x4004300A at Data Flow Task, SSIS.Pipeline: Validation phase is beginning.

Error: 0xC00F9304 at Package, Connection manager "Excel Connection Manager": SSIS Error Code DTS_E_OLEDB_EXCEL_NOT_SUPPORTED: The Excel Connection Manager is not supported in the 64-bit version of SSIS, as no OLE DB provider is available.

Error: 0xC020801C at Data Flow Task, Excel Source [1]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC00F9304. There may be error messages posted before this with more information on why the AcquireConnection method call failed.

Error: 0xC0047017 at Data Flow Task, SSIS.Pipeline: component "Excel Source" (1) failed validation and returned error code 0xC020801C.


Joe

Project Model Organization Best Practices?

$
0
0

Hello all,

I'm trying to find best practices on organizing ETL with the newer project deployment model. We have a large amount of packages in 2008r2 and some of my coworkers have expressed concern about having to always deploy entire projects instead of just packages that change. We do have TFS source control but it is fairly new to us. Our ETL is currently organized by destination subject area, such as Finance, HR, Legal, etc. Some of the loads are fairly small consisting of a few packages. A few of the loads are much larger such as 60 - 80 or more packages. It's these larger ones that often have multiple developers working on different aspects at the same time. One approach I've thought of is to split these larger groups into multiple projects. Maybe something like a stage load, DW load, etc. However, the SSIS catalog is now limited to having only one level of folders without any subfolders. I understand a project is like a subfolder but I can't find any examples on how to organize multiple large projects in SSIS. Is there a recommended approach? How granular should each project be? If it's a good idea to split a load into multiple projects are there any naming conventions to follow?

Thanks for your help! 


Value of date from Excel changes only when run via agent

$
0
0

Hi everyone. I'm a bit of an SSIS newbie, and I'm stumped on something that should probably be really easy. I'm hoping someone has seen something like this before.

I am importing an excel file into a SQL Server table. There is one date column that is formatted as m/d/yyyy in Excel, and as yyyy-mm-dd in the SQL Server table. I handle that format change by adding a derived column.

If I execute the package manually, either locally during debugging or from the SSIS package store on SQL Server, it works perfectly. If I execute the package via SQL agent, I get no errors, but the value of the date changes. It consistently subtracts 4 years and 1 day. Some examples are below.

Excel source:

SQL server destination table:

Any suggestions are much appreciated! I'm out of ideas. :-/

Thank you!



WeeLass

Assigning value to a variable in Script Component.

$
0
0

I'm pretty new to SSIS development and need to figure out a problem with assigning a value to a user defined variable. I created a pretty simple package. It reads a flat file, extracts date from a header record and subsequently uses derived column component to reformat data to the desired output format. One of the columns (FileRunDate, string, length 8) in the derived component is defined as a string and in the expression I'm assigning it to a variable I set earlier in the script component - @[User::vRunTimeDate]. When the process runs, the output file gets generated, however FileRunDate reflects originally set varible's value. It seems that the variable assignment in the script task does not work, even though in the debug mode, I do see how the value is being set. The variable has an attribute of ReadWrite. Is it due to the fact that the value is being set in the same workflow?

Any feedback is greatly appriciated.

To save as Backup on different server

$
0
0

Hello,

I have a question about backup file. I was wondering if there is an option(can be with SSIS, or SSRS or any other way) to create a Backup file directly on different server (and not create file on original and then move it to different).

For Example: I have server A and DB Prod, and Server B for tasks/backups. What I need is to create a backup file for DB Prod(that on server A) directly on server B (and not to create on A and then to move).

Thank you

Daniel

Need to sequence duplicate records in source and destination.

$
0
0

We have a need to copy records from a table in SQL Server 2008R2(source) to an Oracle 11g(destination) table.  If there are no duplicates of a record in the source table, I have a column named SequenceNumber in the destination table with the value of 1.  If there are duplicates in the source table I want the SequenceNumber to increment.  And if there are records in the source table that are already in the destination table I want the SequenceNumber to increment.  The source table can have duplicate records.  The destination table cannot have duplicates.  I want the SequenceNumber in the destination table to provide uniqueness.

What would be the simplest way to do this?

Thanks for your help,

Fred


Fred Schmid

SSIS package throws system resource exceed

$
0
0

I am receiving a very general error in both the Debugger and the EXE (32-bit) when importing an Excel workbook.

-600K rows, issue started coming up after adding a single bit column to it.
-importing from Excel in 32-Bit mode
-SQL 2008
-using DTexec.exe without switches
-have also used the debugger
-the event log does not show anything except that there has been an SSIS error.

The error message is very generic and I know there is a specific error for memory so I am having trouble determining what resource has been exceeded.

How do I track this thing down?

thanks.


Calling all SSIS Gurus! Now is your time! Step up and be counted!

$
0
0

Dear clever clogs and smarty pants!

We need YOU to lighten up our dark evenings and warm our hearts with your TechNet Wiki articles!

Yes, it's THAT time of the month again, submissions time!

September has seen a huge amount of amazing content from our community, providing plenty of fresh and fruity facts and figures to fill the tummies of techies, the world over.

We have some new manes. Some legends. Some icons!!

TechNet Wiki Gurus are beloved the world over and treasured by their countries.

Now is your turn.

You've waited all of your life for this.

Mark this moment as where it all began...

This is where your amazing future starts for you!

 

All you have to do is add an article to TechNet Wiki from your own specialist field. Something that fits into one of the categories listed on the submissions page. Copy in your own blog posts, a forum solution, a white paper, or just something you had to solve for your own day's work today.

Drop us some nifty knowledge, or superb snippets, and become MICROSOFT TECHNOLOGY GURU OF THE MONTH!

This is an official Microsoft TechNet recognition, where people such as yourselves can truly get noticed!

HOW TO WIN

1) Please copy over your Microsoft technical solutions and revelations toTechNet Wiki.

2) Add a link to it on THIS WIKI COMPETITION PAGE (so we know you've contributed)

3) Every month, we will highlight your contributions, and select a "Guru of the Month" in each technology.

If you win, we will sing your praises in blogs and forums, similar to the weekly contributor awards. Once "on our radar" and making your mark, you will probably be interviewed for your greatness, and maybe eventually even invited into other inner TechNet/MSDN circles!

Winning this award in your favoured technology will help us learn the active members in each community.

Feel free to ask any questions below.

More about TechNet Guru Awards

Thanks in advance!
Pete Laker


#PEJL

Got any nice code? If you invest time in coding an elegant, novel or impressive answer on MSDN forums, why not copy it over to the one and onlyTechNet Wiki, for future generations to benefit from! You'll never get archived again!

If you are a member of any user groups, please make sure you list them in the Microsoft User Groups Portal. Microsoft are trying to help promote your groups, and collating them here is the first step.

SSIS/Oracle occasionally truncating the last character on one row, one column

$
0
0

This problem is driving me up a wall. It will typically just be one record out of many (1000's ++), and seems like it happens on one day out of 10. If i rerun the extract all records come through fine. For the longest time I thought it was some mystery process running on the source database that was messing with the data while I was trying to extract it. Now it's happening on a new table... this is going to be a big problem for me very soon.

It's not consistent in any way that I can see other than it seems to be the same column.  However that could be just because of the data mart logic, other columns could miss a character on just one row and no one would notice.  In this case it causes a duplicate in a key.

Does anyone have any leads for me to follow?  Oracle OLEDB to MS-SQL OLEDB.  Have now seen the issue in SSIS 2008R2 & SSIS 2012.

-Ken


Multiple runs of same stored procedure

$
0
0

I am an SSIS newbie so please excuse how little I know.

We have a manual job that I would like to automate in SSIS.

We run the same stored procedure six times with different parameters. Each run creates a csv file that we load into excel and then mail the attachments to the user. Can SSIS run the SP, and in a send mail task, send the six outputs?

SSIS Package not getting executed from batch file on window server 2008

$
0
0

Hi ,

I am migrating a window 2003 server to window 2008 server. The SSIS packages are running fine on 2003 server. But on 2008 server same ssis packages do not get executed.

I am using Batch files to execute ssis packages, I do not get any error, Please help.

Thanks 

ActiveX Script Task: DTSGlobalVariables.Parent.Tasks("DTSTask_DTSDataPumpTask_1").CustomTask

$
0
0

Hi to all

i must migrate a DTS package to SQL Server 2012 SSIS package.

The DTS package has the following form:

ActiveX Script Task -------> Database Connection ---------> TextFileDestinationNEWBacket1

The goal of DTS package is transfer data from table of database in "Database Connection" to text file in "TextFileDestinationNEWBacket1".

The table in "Database Connection" is created and populated with a stored procedure "StoredProcedure".

The ActiveX Script Task contains code like the following:

Function Main()

Set oPackage = DTSGlobalVariables.Parent

Set oPump = oPackage.Tasks("DTSTask_DTSDataPumpTask_1").CustomTask

oPump.SourceSQLStatement = "Exec StoredProcedure"
Set oFileDestination = oPackage.Connections("TextFileDestinationNEWBacket1")
oFileDestination.DataSource = DTSGlobalVariables("Path").Value & DTSGlobalVariables("FileName").Value


End Function

Please, can any one, if possible, explain me the code in the Active Script task?

I do not understand what are and what does the following statements in the Active Script Task:

  • Set oPackage = DTSGlobalVariables.Parent
  • Set oPump = oPackage.Tasks("DTSTask_DTSDataPumpTask_1").CustomTask
  • oPump.SourceSQLStatement = "Exec StoredProcedure"
  • Set oFileDestination = oPackage.Connections("TextFileDestinationNEWBacket1")
  • oFileDestination.DataSource = DTSGlobalVariables("Path").Value & DTSGlobalVariables("FileName").Value

Why Is there that ActiveX Script Task?

What if do we delete the ActiveX Script Task?

What if do we delete the ActiveX Script Task?

thanks in advance.



how to maintain error logs in SSIS?

$
0
0

Hi,

    Recently I went to one of my interview,she asked me from a flat file how you maintain error logs, I told using oledb destination and using rediect row option.again she asked me how to know where the error  among lot of records. I told using data viewr.but she denied my answer and told using data reader destination we can do that, she told. I am still in confusion with her answer,can any body clarify with one example using data reader destination.




SSIS - An OLE DB error 0x80004005

$
0
0

Hi,

When I try to connect to ssis packages from DTEXECUI.exe, I get below error , Please help

TITLE: SSIS Execution Properties
------------------------------

An OLE DB error 0x80004005 (An error has occurred while establishing a connection to the server. When connecting to SQL Server 2005, this failure may be caused by the fact that under the default settings SQL Server does not allow remote connections.) occurred while enumerating packages. A SQL statement was issued and failed.


------------------------------
ADDITIONAL INFORMATION:

An OLE DB error 0x80004005 (An error has occurred while establishing a connection to the server. When connecting to SQL Server 2005, this failure may be caused by the fact that under the default settings SQL Server does not allow remote connections.) occurred while enumerating packages. A SQL statement was issued and failed.


------------------------------
BUTTONS:

OK
------------------------------

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>