Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Error installing SSDTBI_VS2012_x86_ENU.msi

$
0
0

Hello,

Please can you help me solve the below error when installing Microsoft SQL Server Data Tools - Business Intelligence for Visual Studio 2012.

Below is the exact error :-

---------------------------
Microsoft SQL Server Data Tools - Business Intelligence for Visual Studio 2012
---------------------------
An error was encountered.

Unspecified error
---------------------------
OK   
---------------------------

Softwares I have installed :-

1. OS : Windows 8 Pro 64 Bit

2. Microsoft SQL Server 2012 (SP1) - 11.0.3128.0 (X64)
    Dec 28 2012 20:23:12
    Copyright (c) Microsoft Corporation
    Enterprise Edition (64-bit) on Windows NT 6.2 <X64> (Build 9200: )

3. MS Visual Studio 2012 v11.0.50727.1 RTMREL

Note : Same setup works on Windows 7 OS meaning the msi is NOT corrupt.

Thanks,

Shirish


stored procedure to excel sheet

$
0
0
I want to get the data from a stored procedure to excel sheet. I want to use SSIS package for this solution.

I am in process of creating a control flow task for this solution. I have Data flow task as source and File system task as destination.


I tried creating the OLE DB source editor with variable which can pass the stored procedure, but I am getting an error.

Any suggestions???

OLEDB Source to return nil data

$
0
0

Hi,

I have a data flow task that contains OLEDB Source and OLEDB Destination.

The OLEDB Source has this SQL command:

DECLARE @cnt AS TINYINT
SELECT @cnt = COUNT(*) FROM person.[Age]

IF @cnt = 0 
SELECT 'Unknown' as Value

The OLEDB Destination has person.Age table tied to it.

Here's the table schema for person.Age:

CREATE TABLE [person].[Age](
	[ValueID] [tinyint] IDENTITY(0,1) NOT NULL,
	[Value] [varchar](10) NOT NULL,
) ON [PRIMARY]

I want the "Unknown" value to be inserted into person.Age if the table doesn't have any data but do nothing if person.Age already have a data. it works well for the 1st scenario but stuck running if person.Age already have a data.

Is there an efficient way to do this?


cherriesh

Creating a dynamic excel file

$
0
0

Is it possible that i can create a dynamic excel file (destination)

 

ex, i want to create a Dyanamic Excel destination file with a filename base on the date

this will run on jobs. Is this possible?

11172006.xls, 11182006.xls

Error while enabling transactions in SSIS

$
0
0

Hi Experts,

I'm trying to understand how transactions work in SSIS. For this purpose, I've created a demo package that reads data from an excel and then loads into a SQL Server table. Then I have an Execute SQL Task (which is set to fail by giving a wrong syntax in the sql statement). I had put these 2 tasks in a sequence container whose TransactionOption isRequired and IsolationLevel is Serializable. Both the Data Flow Task and the Execute SQL Tasks inside the sequence container have TransactionOption set toSupported.

Basically what I am looking for is to see how the rollback happens when my Execute SQL Task fails. But I'm getting an error when I execute my container.

Error: The SSIS Runtime has failed to enlist the OLE DB connection in a distributed transaction with error 0x8004D00E "The transaction has already been implicitly or explicitly committed or aborted"

I had started the MSDTC service on my system and tried but with no luck. Could you let me know what other settings I can possibly check?

Thanks in advance

   

XML Source - how to stream a 50GB XML file to a database?

$
0
0

Hi guys!

I have been trying to load a 50GB XML file (well, just a 1 "row" at first) in to SQL server via OleDB connection. It seems that this component does not stream the data, but tried to load it into memory - I have only 8GB, so that might be an issue.

Very few people will have 50GB mem on their development machines, so how do I get around this limit? Is there a streaming version of the XML source????

I did make a test with a 500MB subset version of the same file, and it worked just fine. All became green - with 50GB I do not even get to the "yellow stage". :-(

Thanks


Automation for Teradata to SQL Server PDW transformation

$
0
0

Hi all,

  We are working on a trasformation project where the requirement is to migrate both objects and data from teradata to SQL server PDW.

  Is it possible to automate some part of work while transforming from teradata to Sql server PDW??

 Your suggestion will be very helpful.

Thanks,

Dinesh

 

ssis 2012 High Aviaiblity and Sepearate SSIS Runtime Engine

$
0
0

Hi Guys,

I would like to Know pro's and Con's.

I mounting

  • SSIS Runtime Engine on SERVER1
  • SSISDB and Agent JOB on SERVER2

Issues/prerequisite for make SSISDB as a part of High Aviaiblity group.

What happens when my SERVER 1 fail and DB is Still on How the failover happens, What problem does I encounter?

Can we use CNAME for SSIS Servers?

Regards,

Navin


Navin.D http://dnavin.wordpress.com


Is SSIS 2012 metadata case sensitive?

$
0
0

Hi,

I haven't been active in the forum for a few months, way to busy. But this merits a post.

The question is: Is SSIS 2012 metadata case sensitive?

I think the answer is yes but would love definite confirmation.

This is what has triggered the question:

We are moving a package between a Development environment and a UAT environment. In the process of moving the package an SSIS OLE DB Destination task lost a column  mapping. After some investigation we arrived to the conclusion that the column mapping was lost due to a metadata validation problem trigger by case sensitivity.

What was the difference? In the development server the target database column looked like Firstname (all lower case except for the letter F). In the UAT environment the target database column looked like FirstName (please note the camel case). We are 99.99% the difference in casing caused a metadata validation error when the package was deployed to UAT.

The rub with this is that schema compare did not catch the case difference between both columns.

Kind regards,

Modesto


Kind regards M

How to export the results of a stored procedure to dynamic excel file with timestamp

$
0
0

Hi,

Is it possible to create a dynamic excel file (destination) ?

I trired the below steps but it is giving the following error:

1--In data flow, drag OLEDB Source, then select data access mode as SQL Command, in pane Write EXEC dbo.YOURPROCNAME, On top you have to select the connection to your database.

2--Now you would have all the records, Drage Excel Destination. Connect them and then create Excel Connection manger by using Wizard. Define where you want to put the file.

3--Creat a variable called ExcelFileName. get the properties of this variable, It will be string type variable. In properties you will see Expressions.. you need to writte the expression here, how you want the name.

Your expression would be something like this... "D:\\MyFolder\\MyExcelFiles\\Report_"(DT_STR,1252)(getdate()... this is just an example you have to replace . with _ in expression, Here is linke , how to create timestamp with file name

 

--Edited:

Expression Script

"D:\\MyExcelFolder\\report_"+Replace(Replace(Replace(Replace((DT_WSTR,50)(getdate()),"-","")," ","_"),":",""),".","_")+".xls"

output will be like this D:\MyExcelFolder\report_20100624_145946_836000000.xls

You can change according to your requirement.

http://consultingblogs.emc.com/jamiethomson/archive/2007/02/07/SSIS-Nugget_3A00_-Construct-a-timestamp-value.aspx

4--Once you will be done, then you need to go to Excel connection manger properites, there you need to go to expressiona and then have to select property--->FileExcelpath and then Expression-- @[User::ExcelFileName]

You might have to set Delay Validation property to true for this connection in propery pane.

5-go to variable property and set it to EvaluteExpression property to True.

The error which i am getting is 

Error: 0xC0202009 at Data Flow Task, Excel Destination [20]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E37.
Error: 0xC02020E8 at Data Flow Task, Excel Destination [20]: Opening a rowset for "Excel_Destination" failed. Check that the object exists in the database.
Error: 0xC004706B at Data Flow Task, SSIS.Pipeline: "Excel Destination" failed validation and returned validation status "VS_ISBROKEN"

Can any one please help me out ? 

Thank you


Need To Create a table in Sql Server and do some culculation into the table from Oracle and Sql

$
0
0

Hello All,

I'm moving a data from Oracle to Sql Server with ETL (80 tables with data) and i want to track the number of records that i moving on the daily basis , so i need to create a table in SQL Server, wilth 4 columns , Table name, OracleRowsCount, SqlRowCount, and Diff(OracleRowsCount - SqlRowCount) that will tell me the each table how many rows i have in Oracle, how many rows i have in SQL after ETL load, and different between them, something like that:

Table Name  OracleRowsCount   SqlRowCount  Diff

Customer                150                 150             0

Sales                      2000                1998           2

Devisions                 5                       5              0

(I can add alot of SQL Tasks and variables per each table but it not seems logicly to do that, i tryid to find a way to deal with that in vb but i didn't find)

What the simplest way to do it ?

Thank you

Best Regards

Daniel

Lookup, Columns, Cannot map the input column, 'LastName', to the lookup column, 'LastName' because the data types do not match

$
0
0
Hello everyone,

I am using SSIS 2008.

I am trying to do a lookup to see if a student already exists.  I have tried several things but I keep running up against the same roadblock.
 
I am importing from an Excel spreadsheet.  In it is a name field, which has the last name first, a comma, then the first name and middle name.  I am exporting to a table StudentIdentification.  LastName, FirstName and MiddleName are all varchar(100) columns.

When I edit the Lookup Transform, On the Connection screen, I pick the StudentIdentification table.


Try 1: I wrote a view against StudentIdentification to produce a Fullname_LNF (last name first) column.

On the Columns screen, I click on the Excel Name column and drag it to the Fullname_LNF column and I get the error: Cannot map the input column, 'Name', to the lookup column, 'Fullname_LNF' because the data types do not match

Try 2: I dropped the view.  I made a computed column in StudentIdentification, called it Fullname_LNF, with the formula RTrim(LastName + ', ' + FirstName + ' ' + Coalesce(Middlename, ''))

On the Columns screen, I click on the Excel Name column and drag it to the Fullname_LNF column and I get the error: Cannot map the input column, 'Name', to the lookup column, 'Fullname_LNF' because the data types do not match

Try 3: I made a derived column within the Excel input stream, called it LastName.  The expression is Substring(Name, 1, Findstring(Name, ",", 1) -1)

On the Columns screen, I click on the Excel LastName column and drag it to the LastName column and I get the error: Cannot map the input column, 'LastName', to the lookup column, 'LastName' because the data types do not match

I appreciate any assistance in this matter.

Thank you,

Bryan Shaw
bryanshaw46@yahoo.com

Export to CSV delimiter change

$
0
0

Hi, how can I change the delimiter to the regional settings one while exporting from report builder client to CSV ?


Thank you !

Yannick Skelling

yskelling@arcosi.ca

Flat Files - Column Concantenation

$
0
0

I was just wondering if anyone has ever written something or knows of a source where one can get a list of handy hints of dealing with flat files in SSIS so as to avoid common drawbacks associated with loading data from flat files. In my experience I have noticed that flat files can be such a headache. I have worked with flat files for a wile now and I’m relatively comfortable with them. Occasionally I hit on stubborn issues. My latest challenge is that I’m getting two of the columns from a CSV file being concatenated in the intended destination. Please see the illustration below.

  • Surprising thing is that the concatenated columns have a coma separating them.
  • The rows affected by this end up with associated columns being shifted out of proper mapping.
  • In the illustration below the first two rows are the offending rows and the last two rows show what the expected results should look like.
  • Data type is VARCHAR on all columns

ProductCode

ProductName

Quantity

BestBeforeDate

NULL

BRD

Bread

13,2014-03-06

NULL

MLK

Milk

5,2014-03-15

BTR

Butter

4

2014-05-02

EGG

Eggs

12

2014-03-12

The following are the things which I have tried without success yet

  1. Ticking box “Retain NULL Values” box on the Flat File Source component
  2. Using double quotes for Text Qualifier when exporting data to CSV
  3. Using double quotes for Text Qualifier when loading data from CSV
  4. Not using anything for Text Qualifier
  5. Exporting data to a Raw File destination and importing data from a Raw File source hoping that raw file might preserve the original format.

Please note that the data which is being exported has none of the values from the source columns with comas in them. All values in all columns do not have any special characters. They are simple alphanumeric.

Suggestions will be warmly welcome.

Many thanks,


Mpumelelo

Is SSIS Faster Than SQL?

$
0
0

This question is not about any particular code, but more of a general, overall nature.

As may already be known by some, I am trying to optimize a SQL stored procedure. It takes about three hours to run and we need it to go faster.

In it, there are two cursors. I have replaced them with CTEs, so they should run faster.

But, I'm wondering, would it be faster, still, to do them in SSIS?

The sp does several - maybe a dozen or so - updates to a table and then runs what was cursors and is now CTEs, followed up with a few more updates before emailing the results to various recipients.

The updates are pretty straight forward, though one of them does do several joins with more than two tables.

This sp is ultimately being converted to use in an SSIS package, but, basically, I'm wondering if, in general, it is faster to do as much as possible in SQL - say, as Execute SQL Tasks in the ControlFlow - than to redesign the queries using the tools provided in the Data Flow.

My guess is that it's faster to use SQL to perform SQL tasks, but maybe SQL is foreign enough to SSIS to make it faster to do the same task in SSIS' Data Flow.

Any thoughts?



ssis/sql agent job as seperate servers

$
0
0

Hi,

We would like to do the following,

  • SSIS run time engine on Server1
  • SQL Agent on Server2
  • .Dtsx packages on differnt file system Server3

Can my Job scheduled on SQL Agnet (Server 2) able to execute the SSIS package located on Server3??

If So what should be my server capacity for server 1 through 3 -- Standard 64gb, 16 core, 500 GB storage enough??

Regards,

Navin


Navin.D http://dnavin.wordpress.com

Configuration File using a different user id and Password

$
0
0

Hi,

I have a SSIS package that I have deployed to various environments and was able to successfully run.  The last environment causes some problems.  At first I thought that it was a connection issue with SQL Server.  I attempted to change the user id and password for the db in the configuration file and am still getting errors.

When I attempt to connect to the db using those same credentials, I can log in to the database.

Any idea's what to look for?  Is there anything else I can try?

Thanks in advance and regards,

Nadim

SQLServer SSIS package failed when it executed as a scheduled job with same errors

$
0
0

The SSIS jobs failed with below error, could you please check and update us what could be the issue.

Executed as user: AU\ACOE_SPRDB_PROD. ...r code: 0x80004005.  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80004005  Description: "Unable to complete login process due to delay in opening server connection".  End Error  Error: 2014-03-03 01:30:58.34     Code: 0xC00291EC     Source: log  end_time Execute SQL Task     Description: Failed to acquire connection "SPARRDM". Connection may not be configured correctly or you may not have the right permissions on this connection.  End Error  Error: 2014-03-03 01:30:58.38     Code: 0xC004701A     Source: Insert CalculationDateKeyID SSIS.Pipeline     Description: component "tmp_ProductPricingApproval x dimDate" (1) failed the pre-execute phase and returned error code 0xC020801C.  End Error  Error: 2014-03-03 01:30:58.49     Code: 0xC0202009     Source: 70_Load_Product_Level_Results_Monthly_Fact_Ph3 Connection manager "SPARRDM"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x8004D00E.  End Error  Error: 2014-03-03 01:31:19.52     Code: 0xC0202009     Source: Run_DM_ETL2_Ph3 Connection manager "SPARRDM"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80004005  Description: "Unable to complete login process due to delay in opening server connection".  End Error  Error: 2014-03-03 01:31:19.52     Code: 0xC00291EC     Source: log  end_time Execute SQL Task     Description: Failed to acquire connection "SPARRDM". Connection may not be configured correctly or you may not have the right permissions on this connection.  End Error  Error: 2014-03-03 01:31:19.52     Code: 0xC00291EC     Source: log  end_time Execute SQL Task     Description: Failed to acquire connection "SPARRDM". Connection may not be configured correctly or you may not have the right permissions on this connection.  End Error  Error: 2014-03-03 01:31:19.70     Code: 0xC0202009     Source: 70_Load_Product_Level_Results_Monthly_Fact_Ph3 Connection manager "SPARRDM"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x8004D00E.  End Error  Error: 2014-03-03 01:31:19.76     Code: 0xC00291EC     Source: log  end_time Execute SQL Task     Description: Failed to acquire connection "SPARRDM". Connection may not be configured correctly or you may not have the right permissions on this connection.  End Error  Error: 2014-03-03 01:31:19.91     Code: 0xC0202009     Source: 70_Load_Product_Level_Results_Monthly_Fact_Ph3 Connection manager "SPARRDM"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x8004D00E.  End Error  Error: 2014-03-03 01:31:19.94     Code: 0xC00291EC     Source: log  end_time Execute SQL Task     Description: Failed to acquire connection "SPARRDM". Connection may not be configured correctly or you may not have the right permissions on this connection.  End Error  Error: 2014-03-03 01:31:40.96     Code: 0xC0202009     Source: Run_DM_ETL2_Ph3 Connection manager "SPARRDM"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80004005  Description: "Unable to complete login process due to delay in opening server connection".  End Error  Error: 2014-03-03 01:31:40.96     Code: 0xC00291EC     Source: log  end_time Execute SQL Task     Description: Failed to acquire connection "SPARRDM". Connection may not be configured correctly or you may not have the right permissions on this connection.  End Error  Error: 2014-03-03 01:32:02.06     Code: 0xC0202009     Source: Run_DM_ETL2_Ph3 Connection manager "SPARRDM"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x...  The package execution fa...  The step failed.

switching flat file from unicode and getting ntext error on error output column

$
0
0

Hi we run 2012 enterprise and as i change a flat file source component over from delimited/unicode to fixed width ansi i get an error on "flat file source error output column"  which in the advanced editor is still dt_ntext but as i take the error message advice (the component has detected potential metadata corruption...) to convert it to dt_text in the advanced editor i get an invalid property value.  

Here is the error i get when doing the latter...

Error at Untyped Inventory (DFT) [Flat File Source [27]]: The data type for "Flat File Source.Outputs[Flat File Source Error Output]" cannot be modified in the error "Flat File Source.Outputs[Flat File Source Error Output].Columns[Flat File Source Error Output Column]".

Error at Untyped Inventory (DFT) [Flat File Source [27]]: Attempt to set the data type properties on "Flat File Source" failed with error code 0xC020400B. The error occurred while attempting to set one or more of the data type properties of the output column.

I've already changed theexternal and output column properties in the advanced editor to dt_str.  I've also disconnected the flat file source component from the derived column component that follows it in hopes of keeping ssis from getting too confused.  This seems like its going to be very painful.  Is there a silver bullet?

SSIS logging

$
0
0

Hello All,

I created a SSIS package and the SSIS package is executed by the batch file. The output of the ssis process is captured in the log file using the below command line;

DTEXEC.EXE /f TestPkg.dtsx >> LogFileName

I want to store the text that goes into the LogFileName into the database table.

Is it possible to do it?

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>