Consultant Brian Larson - UDM kills ETL and ETL jobs ?
I read a book by Brian Larson which says that Unified Dimensional Model or UDM, which was introduced with SQL server 2005 eliminates the need for ETL and creatin. It achieves this by querying the OLTP...
View ArticleSSIS best practice on importing External text files
Hi - I am a fairly seasoned SSIS/ETL developer and I am struggling with the best architecure on how to import vendor files into a shared database. I see there being 2 methods with in importing files,...
View ArticleDownload XMl file from SFTP: performance issue
Hi All,I am downloading an XML file of size almost 15-20 MB from an SFTP using winSCP.A C# code is written in SSIS script component which loops the remote directory to find the recent file then it...
View ArticleMaximumConcurrentExecutables Property - Why +2
While setting up the Parallelism in SSIS it is widely accepted that the total number of concurrently running executable will be No. of Logical/Physical processors+ 2, but no one explains how can we...
View ArticleSSIS with SQL 2014
I have recently installed SQL2014 and currently have 2 issues which may be BIDS 2012 or SQL2014 related.1. If I deploy a package to MSDB, then try to re download and open the package in BIDS it...
View ArticleLoad flat files from S3 into SQL Server 2008 R2
Hi, We have a few customers dropping files in Amazon S3. Could you please let me know how to load this data into SQL Server 2008 R2 database using SSIS? We are 2008 R2 BIDS environment.Thanks in...
View ArticleDynamically set Analysis Services Connection Manager in a Fooreach loop [SSIS...
I am storing connection strings for "Analysis Services Connection Manager" in a database table and on run time i am fetching them all, storing in an object and iterating through them inside a Foreach...
View ArticleSSIS package to do SSRS email subscriptions
I know how silly the title is, but anyways I am going to ask this question...I have a Main report and a sub-report in SSRS, I need to send out an email every time a new entry is generated/added to the...
View ArticleHow to eliminate last row from the flat file source
Hi,This time i have a question that is based on SSIS DFTI have a textfile that having data likecol1,col2,col3,col41,2,3,42,3,45,C,3where last row, C,3 is data about data info, i.e. showing number of...
View Articlecreating file lay out in ssis
how to create a file with header record? and detail record from table rows?file lay out should be like thisH123456YYYYMMDDD12345PETER20120521D12345JOHN20130522D12345ADAM20130523hOW CAN I CREATE HEADER...
View ArticleClik here to view.
Pass Variable in Execute SQL Task
Hi,I'm using below task but getting error . I want to pick a single value with where clause(using variable @[User::SPID] in) then store the select record in another variable (USER_NAME)Please Help .
View ArticleError in SSIS projects
Hi All, I have a SSIS package. Very Simple one. Two OLEDB connection for SQL Server. I am trying to copy data from a server to another server by column mapping.The source Server is SQL 2000 and...
View ArticleError: An error occurred while skipping data rows
I am constantly getting error message “Error: An error occurred while skipping data rows”. Here is my scenario:I am pulling data from a text flat file which is Vertical Bar {|} delimited. My data...
View ArticleSSIS 2008 Package with OLE DB provider MSDAORA.1 does not pass validation
Hello there---I have run into a problem that apparently others have hit, too, but I don't seem to see any definitive solutions to the problem... I have created a package in BIDS (VS2008) for SQL 2008,...
View ArticleClik here to view.
String Datatype between MDX & SSIS
Hi,I'm TRYING to STORE string DATATYPE value of MDX query into variable under SSIS Package .MDX Query Is& Storing this into String variable through Execute SQL Task in SSIS Package .But this Task...
View Articleimport excel ssis pivot unpivot
I am trying to pivot the table to sql server 2008 R2. source excel file is like this. date 1/1/2000 2/1/2000 money 5 7 name Julie tom I want to make the first column on the...
View Articlevisibility to excel namespace from script task
Hi. We run 2012 enterprise. I took a quick look at using a c# script task to get metadata (1st worksheet name) about an excel file for later use in a dataflow which will use a variable i map the...
View Articleissues using HTTP Connection Manager to run SSRS reports from SSIS
In my package, I have a HTTP Connection Manager called "ReportServer". And I have two variables called "ReportURL" and "ReportFile". "ReportURL" is the URL for the report. I won't get into the details...
View ArticleSSIS Execute Process Task DDE/OLE
I have a package that executes an executable via Execute Process task, and that executable needs Adobe Reader to work. It sends PDF faxes to Adobe which converts them to tiff. This is a third party...
View ArticleCan I preserve carriage returns in a string variable from SQL Server?
I have an OLE data source that pulls data from sql server via a SELECT query. One of the fields is an NVARCHAR(max) which goes into a string variable which is later used in an expression. I am...
View Article