Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS ADO NET Destination Error: There is already an open DataReader associated with this Command which must be closed first

$
0
0
    • I have execute sql task(EST) which creates transaction.
    • Another EST to insert data to table and gets identity value.
    • Data Flow Task(DFT1) which has excel source to ADO.NET destination in data flow.
    • Another DFT2 which has ado.net source to ado.net destination.
    • Another DFT3 which has ado.net source to ado.net destination.
    • File system task to move excel file to archive
    • Commit transaction in EST.
    • In event handler on error option have rollback transaction in EST.

    My ADO.NET connection manager

    RetainSameConnection is true

    because I want to rollback all if something goes wrong, and I don't want to involve in this DTC .

    Now when I executed the package, it failed at 3rd point above.  In 3rd DFT ADO.NET destination property, changed value of UseBulkInsertWheneverPossible to false. This error got solved.

    Got another error at 4th point in ADO.NET Destination, the error message is posted below,

    [ADO NET Destination [2]] Error: An exception has occurred during data  insertion, the message returned from the provider is: There is already  an open DataReader associated with this Command which must be closed  first.

    [SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The  ProcessInput method on component "ADO NET Destination" (2) failed with  error code 0xC020844B while processing input "ADO NET Destination  Input" (9). The identified component returned an error from the  ProcessInput method. The error is specific to the component, but the  error is fatal and will cause the Data Flow task to stop running.

    I am trying to resolve this still, any help would be greatly appreciated


"Failed to open package file ..." when modifying job step on remote server

$
0
0

I have SSIS package setup on a remote SQL Server to run on schedule via SQL Server Agent. It was setup initially by remote desktop-ing to the server and connecting to it via SSMS running on the same machine where SQL Server is running. Package source is"File System" and absolute path is specified (D:\Folder1\Package1.dtsx). There is just one step in the job - to run SSIS package. Everything works as it should.

Now I want to modify this job - change number of retry on failure attempts. I can successfully connect to this SQL Server instance via SSMS from my developer workstation. I can then go to "Advanced Settings" for this job step and change "Retry attempts" to some other number. However, when I press "OK" I get this error message:

TITLE: SSIS Execution Properties
------------------------------

Failed to open package file "D:\Folder1\Package1.dtsx" due to error 0x80070003 "The system cannot find the path specified.".  This happens when loading a package and the file cannot be opened or loaded correctly into the XML document. This can be the result of either providing an incorrect file name was specified when calling LoadPackage or the XML file was specified and has an incorrect format.
 ({105912C7-6345-42B4-99B4-58566291867B})

------------------------------
ADDITIONAL INFORMATION:

Failed to open package file "D:\Folder1\Package1.dtsx" due to error 0x80070003 "The system cannot find the path specified.".  This happens when loading a package and the file cannot be opened or loaded correctly into the XML document. This can be the result of either providing an incorrect file name was specified when calling LoadPackage or the XML file was specified and has an incorrect format.
 ({105912C7-6345-42B4-99B4-58566291867B})

Interestingly enough, in spite of this error message the number of retries is successfully changed.

I understand it happens because SSMS tries to locate package on my local hard drive and the same folder doesn't exist on my development PC. It still doesn't make sense to me. Does SSMS not know I am accessing remote server? How come I don't get any errors when I just execute this job via SSMS when SSMS runs on my development PC?

Failed to open package file due to error 0x800C0006 "The system cannot locate the file in C# code.

$
0
0

Hi, Am facing issue when I try to run SSIS package via C# code, I have given full access to all the folder in which the package is available.

In the below line am getting error,

using Microsoft.SqlServer.DTS.Runtime;

Application app=new Application();

Package package=null;

package=app.LoadPackage("PackageFullPath",null) --error line

Failed to open package file "C:\SSIS\Package.dtsx" due to error 0x800C0006 "The system
cannot locate the object specified.".  This occurs when loading a
package and the file cannot be opened or loaded correctly into the XML document

VSTA ScriptTask Errors In BIDS Sql Server 2008 R2

$
0
0

I am at my wits end with the error "Microsoft Visual Studio For Applications 2.0 Registration for this application needs to be updated".  I have had this problem for some time on my development laptop running Windows 7.  Fortunately I had a desktop with Windows XP that I could do my SSIS development work on.  Now the company gives me a brand new desktop running Windows 7 since XP is going a way. 

A Brand New Machine remind you! The only software installed is MSOffice 2010.  I am thinking ok finally i will have a decent development environment and will not get the ScriptTask errors. 

So off I go and download Sql Server 2008 R2 Standard SP3 edition from my MSDN subscription.  After waiting who knows how long to download and three times as long to install I open up my SSIS project and excitely open a Script Task and click on Edit Script....Same error.  Are you kidding me?

I uninstall SQL Server 2008R2 Standard edition and download Sql Server 2008 R2 Developer edition.  Surely, just surely Microsoft will allow me to develop with the Developer edition! Wrong.

I have been through all the gyrations of removing registry entries, running setups, uninstalling VSTA and reinstalling. I used this link as a reference: http://blogs.msdn.com/b/jason_howell/archive/2010/08/18/vsta-setup-and-configuration-troubles-for-ssis-2008-and-r2-installations.aspx.  I still get the same error.  Can anyone give me some kind of answer?  Your help will be greatly appreaciated and I will give you my first born daughter.  Granted she's 23 and the college tuition and car insurance payments come along with her. 

Microsoft, I greatly thank you for the ability to use vb and c# scripts inside of SSIS packages.  BUT WHY IS IT SO FREAKING HARD TO ACTUALLY USE IT AND WHY IS IT SO HARD TO ACTUALLY INSTALL A PIECE OF YOUR SOFTWARE AND EXPECT IT TO WORK?  Maybe it's me and not you.

Frustration has entered the meeting...

Execute SQL Task ADO.NET connection type insert query values getting truncated in DB

$
0
0

I am passing SSIS variables from C# code and getting it in SSIS package execute sql task

and SQL query is like below,

 insert into Table values(@FileProcessStatusId,@FileTypeId,@FileName,@SharePath,@UploadedBy,@UploadedDate,@Error)

in the above query few values are string and int.

the task is executing successfully but the value stored in table is only 2 char. i don't know what went wrong. Any help.

Output a derived column to a flatfile destination

$
0
0

I'm a newbie. My source is a sql server table. Then I dropped a derived column icon. And finally a flatfile destination.

When I open the flatfile destination, it does show the new column as 'Derived Column 1' in the Available Input Columns, but it's not shown in the Available Destination Columns.

How do I add it to the Available Destination Columns?

SSIS multiple table loads using single DFT

$
0
0

Hi,

I am new to the SSIS. I am trying to load multiple tables from my staging database to multiple tables in the data warehouse. My staging database is nothing but a database with all the tables from all my source databases copied to it. I found that each data flow task only allows to connect one source table to one destination table.

I am having 100 of SSIS package of 100 Tables.
I want to make single SSIS package to laod all the 100 tables usning single DFT.
I have a filmaster table which containing the list of source table and destination table name, and input will be the filename , on the basis of filename my DFT will take the source and derstination table and run the package accordingly.

Is this approach is correct, or is it possible, is dynamically column mapping is possible.

Please suggets some ideas on above concern

Regards,
Vipin Jha


Thankx & regards, Vipin jha MCP

Adding extra data into warehouse and cube

$
0
0

Hi,

I have a data warehouse and an SSAS cube on top of that. The schema is  as per below.

Time dimension columns:- Week_id,Week,Month,Year

Item dimension columns :- Item _id, Item, Item name

Product dimension columns :Product_Id,  Product code, Product name

Fact columns : Week_id,Item_id,Product_id,Sum of Sales

Every week i get the order level data(Ord_number,date,product_code,item,sales_qty) for one week and aggregate that data into week at item.product level and load that into fact. It is incremental load and the fact contains data of last 3 years.

Now, i have received a new requirment from client that, We need include some extra data for last 3 years.The metadata data looks like below.

Item name,Product name, Month,Discount amount.

He provide the data in the above structure in txt file. What is best method to include this data into my warehouse and cube? 

Do i need to create one extra dimension for this or need to add into fact(discount amount). I think adding in fact is complicated as i need the order level data for last 3 years. Please help..



Loading dynamic files from a table that has header and detail records

$
0
0

All,

I have a table, say, FooTest that has 2 columns, 1 column (say, Message) has header and detail records stored and the 2nd column in "Status". This is how the table structure looks like:

Message                                 Status

1|HDR|abc|121|qwasdf             0

2|DTL|abc|121|qwfggjg            0

3|DTL|abc|121|cvmcbnv           0

4|HDR|def|134|dghmcbq          0

5|DTL|def|134|dghmcbq           0

6|HDR|abc|173|mnxccvc           0

7|DTL|abc|173|ndsjkdnx          0

I want to dynamically generate files from this table. So, for example, when my first loop runs, a file named, "abc_12142014_6:10:23 (Filename_Date_Time)" would be generated and status column should be updated to "1" and that file will have 3 records i.e.:

1|HDR|abc|121|qwasdf

2|DTL|abc|121|qwfggjg

3|DTL|abc|121|cvmcbnv

Similarly, once, the "def" file has been loaded, the status column should be updated to 1 and file name should have date and time (including milliseconds).

Also, even though the filename is same for the last 2 records (i.e. abc), i want this one to be a different file than the first one. This filename should be "abc_12142014_6:10:45" (milliseconds or minute would be the only change), but, still it would be a different file with 2 records, i.e.:

6|HDR|abc|173|mnxccvc

7|DTL|abc|173|ndsjkdnx

Basically for each "HDR" record there should be a new file with header and detail records specific to that header (doesn't matter even the filename (abc) is same).

Is there a way to achieve this in SSIS?

Can I Create Teradata Volatile Tables using SSIS ?

$
0
0

Hi 

I am able to extract the Teradata using ODBC Source in ssis package and loading into sqlserver or flat file .In same query i want create one volatile table ,inserting the values and i want join that volatile table to existing source query. Can you please help me to complete that task. 

Thanks,

CMK.

Need help on Scenario based questions and answers...

$
0
0

Hi,

I have worked a bit on SSIS. I am preparing for SSIS interviews. I have faced some. Mostly they ask for scenario based questions. If anyone can provide some scenario based questions, it will be great help.

Thanks in advance.


Anujit Karmakar Sr. Software Engineer

Problem in converting string to date datatype while loading data from excel into database.

$
0
0

Hello,

                Daily we have to load data from excel to databse. But in excel source file, date format is not unique i.e. some column have 5/30/2014  4:18:55 AM pattern and some column have 41789.1798032407 pattern. So data conversion using derived column is not easy here.

Now we are manually changing the data type to short date in excel file and then we'll execute the job. I want to automate this job without manual work. So can we able to convert data from string to date or is there any other process to do this.

Pls help.

My variable not visible during debug in (Local) ssis 2014

$
0
0

Hi All,

Recently i deployed my SSIS package from 2008 to 2014(Still in dev Env), all working fine, but during my debug mode , i couldn't able to find variable list in locals (to see values) as you can see in below image, i have around 50 variable but not even one is listed? is there a bug in Data tool?

and also i just created new package in 2014 and tested variable that are working fine during debug, but not on migrated package?

Thanks



Script Task Or Execute SQL Task to set variable value from Database

$
0
0

I have say for example five variables. I want the values of these variables should be populated from database. I can use Script Task to connect to database and set the variable values by writing .net code.

I can do the same thing using Execute SQL Task by parameter mapping.

As far as performance is concerned,which one is better? Is there any other measures that should be considered in this scenario?

Thanks


Abhi

"DBSTATUS_UNAVAILABLE" Error while importing Excel File

$
0
0

Hello,

I am getting following error while importing data from Excel 2003 to SQL server using SSIS 2008,  [Excel Source [1]] Error: There was an error with output "Excel Source Output" (9) on component "Excel Source" (1). The column status returned was: "DBSTATUS_UNAVAILABLE".

If i open the excel file and done any editing then the same file loads without any issue. Can you guide me why it's  happening ? , i have edited "TypeGuessRow" property to 0 , IMEX = 1 but no help.

Thanks


Unable to preview SSIS Excel source data after skipping first few rows

$
0
0

I am using SQL Server 2008 BIDS. I am trying to read in an Excel file, having multiple sheets. The names are mostly alphabetical( and few with special char '&'). The data starts at row 8. I have skipped the blank rows by setting the rows and columns in the open rowset property for the Excel source. I get the exact mappings. However, I am not able to preview the data. The package runs successfully(everything turns green), but there is no data in my destination.

The error I receive while I try to preview is:

There was an error displaying the preview.

Additional Information:

Index and Length must refer to a location within the string. Parameter name: Length(mscorlib)

Please let me know if I am doing anything wrong or I am missing any settings.


Opening a row set for object failed.Check that the object exists in the database.

$
0
0

I tried to create a ssis package.But i am getting below error.

Error at dat flow Task[OLE DB Source 1 [132]]:SSIS Error Code DTS_E_OLEDBERROR.An OLE DB error has occurred.Error Code:0X80040E37

Error at Data Flow Tsak [)LE DB Source 1[132]]:Opening a row set for ''XXXX" failed.Check that the object exists in the database.

Additional information :

Exception from HRESULT:0XC02020E8(Microsoft.SqlServer.DTSPipelineWrap)

Can anyone suggest on this.

Thanks in advance.


Deploy SSIS 2012 projects to IS catalog using T-SQL

$
0
0

Hi All,

I have couple of SSIS 2012 projects having protection level set to encrypt sensitive with password. I have used the inbuilt stored procedure catalog.deploy_project sp to deploy the project  to IS catalog. Now, when a SQL agent job is build on top of this package, it errors out saying "Failed to decrypt an encrypted XML node because the password was not specified or not correct. Package load will attempt to continue without the encrypted information."

http://msdn.microsoft.com/en-us/library/ff878004.aspx  Remarks on this page: During a project deployment or update, the stored procedure does not check the protection level of individual packages in the project.

If I use the deployment wizard to deploy the package to the IS catalog, and create a job on top of it, it works fine. It is so becuase wizard prompts me to enter the project password while deploying.


Thanks, hsbal

store multiple file names in sql tables

$
0
0

Hi,

I have requirement here, I have multiple files(xls, txt, csv) there.

I want to take the name of those files and file locaiton store into one sql table how can I do that..

please any one help on this...

SSIS Lookup Task is running endlessly.

$
0
0

Hello,

I have a Problem. At our SSIS package we have a lookup task running on full cache mode and finds no matches. It runs endlessly and doesn't fail, allthough it's configured at this case.

SQL Server (SSMS/SSIS/SSAS) is running on a virtual machine with windows server 2012 and SQL Server 2012 built 11.0.5058. 

Does anybody has/had a similar problem and solved it?

Thanks,

Thomas 

Viewing all 24688 articles
Browse latest View live