Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

BIML - SSIS Packages practical use

August 17, 2016, 6:47 am
$
0
0

Hello,

I am trying to learn BIML and understand "practical scenarios" where it can be used.

Based on what I researched (A scenario explained in a blog\video):

It can be used to generate multiple "similar" packages without having to design each package or task separately.

Example: You have a two task package   Task 1: Truncate table

                                                             Task 2: Dataflow task to copy the table data

Now, if this package has to be created multiple times for different tables, you will have to design those tasks separately but with BIML, you can code this to dynamically generate the SSIS packages.

 

 So, this seems to be a valid reason, however, I have few questions:

 

   Question 1: I think the same can be done using Data Import\Export wizard. So, I am not sure the additional advantage you have with BIML in this scenario. Sure, if there are other workflow tasks that needs to be done, BIML might be between solution. any thoughts on this?

  Question 2: I do not think I design same package with different tables on everyday basis(I do not remember doing it),so, I do not think I would encounter the above scenario to practically make use of BIML. Do you guys encounter doing this frequently?

  Question 3:  Are there any other practical scenarios where we can use BIML and BIML provides additional advantage over SSIS.

Looking for you ideas on where using BIML compared to BI\SSDT is better.

Hope it Helps!!

↧
Search

SSIS Package Restartability

August 14, 2016, 4:06 am
$
0
0

Hi Pals,

Iam trying to implement an  SSIS package restartabilty where a Master Package loops some bunch of child dimensional packages.

We have used For each loop container to execute child packages, now if a child package fails and issue is resolved, when i start the master package, it should run from failed child package and not from first child package. how to do this

If there is any workaround please let me know.

↧
↧

SSIS to Excel

August 17, 2016, 11:47 am
$
0
0
I am using SSIS/SSDT (SQL 2012 64-bit) Execute SQL Task to connect to an Excel (2010 64-bit) file to DROP TABLE/CREATE TABLE so I can refresh a data sheet.  I know I had to add a compatibility package to make it work (32-bit?). I'm getting an error now (unable to acquire connection [to excel]), when I didn't before.

I had to re-install from Standard to Enterprise, so I lost something in the upgrade.  What do I need to do to restore my package capability?  I know there was a link or something...along the line of un-installing 64-bit excel, installing 32-bit excel, install 32-bit compatibility pack, and use 32-bit excel.  I forget.

Can someone who knows, remind me how it works.  I may have answered my own question...but I hope someone has a better answer.

↧

I am trying to deploy an SSIS package using Visual Studios 2013 with SSDT installed

August 17, 2016, 3:28 pm
$
0
0

The Integration Services Deployment Wizard returns the error below after "Loading project" passed, "Connecting to destination server" Passed, "Changing protection level" Passed then "Deploying Project" Failed with error below.

The path for 'ISServerExec.exe' cannot be found. The operation will now exit. A .NET Framework error occurred during execution of user-defined routine or aggregate "deploy_project_internal": System.Data.SqlClient.SqlException: The path for 'ISServerExec.exe' cannot be found. The operation will now exit. System.Data.SqlClient.SqlException: at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction) at System.Data.SqlClient.SqlInternalConnectionSmi.EventSink.DispatchMessages(Boolean ignoreNonFatalMessages) at System.Data.SqlClient.SqlCommand.RunExecuteNonQuerySmi(Boolean sendToPipe) at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(TaskCompletionSource`1 completion, String methodName, Boolean sendToPipe, Int32 timeout, Boolean asyncWrite) at System.Data.SqlClient.SqlCommand.ExecuteToPipe(SmiContext pipeContext) at Microsoft.SqlServer.Server.SqlPipe.ExecuteAndSend(SqlCommand command) at Microsoft.SqlServer.IntegrationServices.Server.ServerConnectionControl.RaiseError(SysMessageId messageId, SysMessageSeverity severity, Object[] args) at Microsoft.SqlServer.IntegrationServices.Server.ServerApi.DeployProjectInternal(SqlInt64 deployId, SqlInt64 versionId, SqlInt64 projectId, SqlString projectName)

Thanks Rick

↧

HTTP Connection Manager - file size > 2GB = blank file

August 17, 2016, 1:42 am
$
0
0

Hi, I'm using this in SSIS SQL Server 2008 R2 to download a file

Recently the file size has increased >2 GB.

The downloaded file is now blank - it produces a file of about the right size but full of blank lines (CR LF with nothing in between).

Anyone else seen this or can suggest what the issue is?


↧
↧

SSIS Script Task Error through SQL Server Agent Job - The package execution returned DTSER_FAILURE (1).

August 17, 2016, 4:39 pm
$
0
0

Hello Everyone,

I badly need help here. I tried various suggestions from different posts in msdn and others , but nothing work out . I have created a package using SSDT for VS 2013 which has  a script task with VB 2012 code which refreshes Excel workbooks which in turn pull the data from tabular cubes. This works fine when executed in Visual studio. But fails everytime with below error , when run through SQL server agent Job 

Error - 

Executed as user: *****. Microsoft (R) SQL Server Execute Package Utility  Version 12.0.4100.1 for 32-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  4:12:44 PM  Error: 2016-08-17 16:13:35.23    Code: 0x00000001     Source: FileName      Description: Exception has been thrown by the target of an invocation.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  4:12:44 PM Finished: 4:13:35 PM  Elapsed:  50.562 seconds.  The package execution failed.  The step failed.

Couple of suggestions i have tried 

1) Made sure that the Proxy account has read/write access on the folder where the excel file is present

2) Followed instructions in the below thread and created this folder - C:\Windows\SysWOW64\config\systemprofile\Desktop

https://social.msdn.microsoft.com/Forums/en-US/b81a3c4e-62db-488b-af06-44421818ef91/excel-2007-automation-on-top-of-a-windows-server-2008-x64?forum=innovateonoffice

3) Checked the option in job to run  in 32-bit mode

None of these suggestions work for me . Thanks in Advance. This would be a great help 

SG

↧

How to load Flat file which has UTF-8 encoded data? SSIS 2014

August 17, 2016, 4:01 pm
$
0
0

The source flat file is read using UTF-8 

I am trying to follow the below article and load the UTF-8 data but I have issues with it

https://www.mssqltips.com/sqlservertip/3119/import-utf8-unicode-special-characters-with-sql-server-integration-services/

I want to know if

1. If all the target table datatypes have to be nvarchar (unicode) ?

2.Can I have some columns as Varchars in target table ? If so how do I ensure they are loaded in a table which has combination of unicode and non-unicode data?

3.I tend to get codepage errors when I am building mapping in the ssis package?

I have a following flow 

a.Read data using flat file source configured to pick file as utf-8 

b.Use a data conversion transformation to transfer non-unicode to unicode 

c.Use oledb destination to load data in sql server table.




↧

Launching SSIS Report

August 16, 2016, 9:44 am
$
0
0
Is there a way to launch the built in reports via code? I want to have it displayed after the package completes whether it succeeds or fails instead of manually right clicking in sql server management studio and going to all reports to see the status. Thanks
↧
Search

Removing parameterize connections from ssis package

August 16, 2016, 1:18 pm
$
0
0

Hi,

I have parameterrize some of the connection strings in ssis package but after that i have removed these parameters from the parametes tab but when i deploy the ssis package to sql server 2012 and check the configurations of the package there i can see the pld removed parameters how to remove these parameterize connection.

i am using visualstudio 2010 and sql server 2012.

please let me know if you have any questions.

Thanks



↧
↧

Problem with Sql Execute Package Utility and SQL Server Import Export Wizard and MS SQL Server 2008 R2 SP3 - KB2546951

August 16, 2016, 3:00 am
$
0
0

Since last july I'm unable to use the Execute Package Utility and the SQL Server Import Export Wizard doesn't show the Save SSIS Package option.

I suspect that this situation is related with the instalation of the Service Pack 3 for SQL Server 2008 (KB2546951)

My MS SQL Server (2008 R2) Management Studio is as this:
Microsoft SQL Server Management Studio   10.50.1600.1
Microsoft Analysis Services Client Tools 10.0.5500.0
Microsoft Data Access Components (MDAC)  6.1.7601.17514
Microsoft MSXML                          3.0 4.0 5.0 6.0
Microsoft Internet Explorer              9.11.9600.18376
Microsoft .NET Framework                 2.0.50727.5485
Operating System                         6.1.7601

In the Execute Package Utility I get this message:
ERROR: The Execute Package Utility requires Integration Services to be installed by one of these editions of SQL Server 2008 R2: Standard, Enterprise, Developer, or Evaluation. To install Integration Services, run SQL Server Setup and select Integration Services.

In the SQL Server Import Export Wizard I see this message:
In SQL Server Express, Web or Workgroup, you can run the package that Import and Export Wizard creates, but cannot save it. To save packages that wizard creates, you must upgtrade to SQL Server Standard, Enterprise, Developer or Evaluation.


Can someone confirm that this is related with SP3 instalation ?

Thanks
João

Joao Simplicio Rodrigues

↧

SSIS script task (vs15) not work when deploy on sql server 2014 through ispac

August 18, 2016, 7:02 am
$
0
0

Hi,

Im using SQL Server 2014 and Visual Studio 2015 to develop the packages.

Package works well in my machine but when i deploy through ispac and run through SQL Agent the job is failing.

The issue with script task

Please find the error message below.

The ERROR:

There was an exception while
loading Script Task from XML: System.Exception: The Script Task
uses version 14.0 script that is
not supported in this release of Integration Services. To run the
package, use the Script Task to create a new VSTA script. In most
cases, scripts are converted automatically to use a supported version,
when you open a SQL Server Integration Services package in
%SQL_PRODUCT_SHORT_NAME% Integration Services.    at
Microsoft.SqlServer.Dts.Tasks.ScriptTask.ScriptTask.LoadFromXML(XmlElement
elemProj, IDTSInfoEvents events)

If any one had faced this issue and got resolved please help me.

The reply is really appreciated

Thanks,

Raghu

↧

SSIS Package does nothing after starting debugging

August 18, 2016, 7:18 am
$
0
0

HI - 

I am trying to debug the package and the package does nothing and I have to stop debugging every time. I don't understand what might have happened. <g class="gr_ gr_113 gr-alert gr_spell gr_run_anim ContextualSpelling ins-del multiReplace" data-gr-id="113" id="113">becuase</g> the same package was running fine but now when I start the debugging nothing happens. Even I execute the <g class="gr_ gr_196 gr-alert gr_spell gr_run_anim ContextualSpelling ins-del multiReplace" data-gr-id="196" id="196">pacakge</g> nothing happens and then I have to stop debugging <g class="gr_ gr_337 gr-alert gr_spell gr_run_anim ContextualSpelling" data-gr-id="337" id="337">everytime</g>. Please let me know what could be the reason?

↧

parallel load

August 18, 2016, 8:29 am
$
0
0

Hello,
We have one package which loads data into database...

Question:
How is it possible to run several of this package at the same time?

Thank you

↧
↧

Error while running SSIS Package in the SQL Server Agent.( Transfer Sharepoint List data into SQL Server)

July 7, 2016, 8:17 pm
$
0
0

Hi Everyone,

 I created a SSIS package that reads data from a Sharepoint List and export these data into SQL Server.

I did installed Share point Adapters(from Codeplex) in my machine and the Server too. I am able to run the package in my local machine. But when I try to run the package through SQL Agent I am getting the following error:

 Description: The connection type "SPCRED" specified for connection manager "SharePoint Credential" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.  End Error  Error: 2016-07-07 23:02:32.32     Code: 0xC0010018     Source: SNPDischargeCompletedCalls      Description: Error loading value "<DTS:ConnectionManagers xmlns:DTS="www.microsoft.com/SqlServer/Dts"><DTS:ConnectionManager DTS:DelayValidation="0" DTS:ObjectName="EIDS" DTS:DTSID="{40AFD788-0544-4322-A096-04228838AEA9}" DTS:Description="" DTS:CreationName="OLEDB"><DTS:ObjectData><DTS:Con" from node "DTS:ConnectionManagers".  End Error  Could not load package "\\awsapsql21\FHNCCA_DAILY\SNPDischargeCompletedCalls.dtsx" because of error 0xC0010014.  Description: The package failed to load due to error 0xC0010014 "One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.". This occurs when CPackage::LoadFromXML fails

Thanks.

↧

Best approach to waiting for a file

August 17, 2016, 5:06 pm
$
0
0

I've built a "listener" job that runs a stored procedure every 15 minutes to see if a file has landed in an import directory. There are several files from different sources, and they can come in at any time of the day. The listener goes through a table of filenames using a cursor, then checks to see if each file exists using xp_cmdShell...

SET @Command = 'Dir "' + @FromFile + '"';
EXEC @xpRetVal = master.dbo.xp_cmdshell @Command, NO_OUTPUT

If it exists, the table contains the name of a stored procedure that will then import and process the file. The file is moved into an archive when that's complete.

My listener code works fine as far as finding a file that's in the directory. What I'm wondering is how do I know if the file has completely landed before I start importing it. Is there a way to tell?

Darrell H Burns


↧
Search

Stored Procedure to execute SSIS. Stored procedure does not wait SSIS complete before the next task is executed.

August 18, 2016, 8:14 am
$
0
0

I use store procedure to execute the SSIS package.  

The SP is just to execute the SSIS package by using EXEC SSISDB.CATALOG.START_EXECUTION.  

The issue is store procedure executes the SSIS package successfully, but it doesn't wait for the SSIS package to complete.    It return the execution is successfully within couple seconds, while the SSIS package doesn't finish in 10 minutes. 

The reason why I want to use store procedure instead of agent job, is because our ETL process is intergrated with a 3rd party.   The existing integration only allow to use store procedure.   

Thoughts? 



↧

Jobs are getting cancelled whenever fail over occurs in SQL Agent

August 18, 2016, 12:03 am
$
0
0

Resilience Engineering Implementation possibility -

Issue:We are in process of auto triggering of cancelled jobs whenever Server fail-overs from one node to another node.

Description:When ever server fail-overs we have to manually re trigger the jobs by making the respective process instance status to 0 since all the jobs will get cancelled.

Is there any way to trigger the job automatically from SQL agent when ever server fails?


↧
↧

Debugging and data flow row counts incorrect

June 26, 2012, 9:43 am
$
0
0

I've recently upgraded several packages to SSIS 2012, and I'm finding that the row counts shown in the data flow while debugging are entirely nonsensical. My data flow goes something like this at the moment:

OLE DB Source - 138,292 rows

RowCount - 325,974 rows

Lookup - 730,972 rows

Derived Column - 9,878 rows

Lookup - 29,634 rows

RowCount - 148,170 rows

OLEDB Destination

This is very different from what I saw in 2008 R2. The first row count and lookup should most certainly not exceed the number of rows that have been read from the source at any given time. Are these counts being displayed counting something different in 2012 than what they counted in 2008 R2?

I can also see when it goes into post execution that in both the output windows/progress the number of rows that have been actually been written to the OLEDB Destination is an entirely different number than what is shown flowing through the data flow pipeline while debugging (251,1095).

Another oddity - the data flow tasks never turn green, even after the control flow shows that the data flow task has completed successfully.

↧

Compare and delete records from Source

August 18, 2016, 1:50 pm
$
0
0
I'm comparing SharePoint list - source file with an excel file and i have to delete all unmatched records from the source - SharePoint list. How to achieve this in SSIS package?
↧

Merge Join in SSIS package

August 4, 2016, 1:00 pm
$
0
0

I have 2 sorted data sets in my package , DataSet A and DataSet B, I want a merged Output with all rows from DatasetA and only rows from DataSet B thatdoesn’t match with dataset A. How can i do this, any ideas?

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>