Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS: Data Extraction from SAP: Biztalk Acceleartors

$
0
0

I am trying to extract data from SAP. Can somebody guide me for followings:

1. Do I need to have [SQL Enterprise] edition for using SAP Connection manager or it can work with [Standard Edition]

2. Do I need [BizTalk] license for using [Biz Talk Accelerators] for data connectivity with SAP.


Database Profiling results back to a DB

$
0
0

Was wondering if anyone has set up data profiling to process an entire DB of tables and store the results back into a DB repository for analysis?

I'm hoping there is either a sample package to start with or at least some instructions to set this up.  I know it should be possible to do, was hoping to not start completely from scratch.

Thx

The file name property is not valid. The file name is a device or contains invalid characters.

$
0
0

Hi Gurus,

I have a foreachloop package and the files folder is a n/w drive. When I ran the pkd on my laptop using BIDS it is running fine but when I skeduled to run it showing me errror:

The file name property is not valid. The file name is a device or contains invalid characters.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).

The n/w drive has acess to agent defualt user(dba). and while imporing the package to IS services i used the protection level "Rely on server storage and roles for access control".

I am banging my head all week but cudnt resolve this issue.

Please help me with this.

How to undo SSIS.ReplacementTask?

$
0
0

It seems that in the 2016 SSIS tooling, if you open a package and the task cannot be found, the package XML is changed and any invalid creation name references are replaced by "SSIS.ReplacementTask". So if I then fix the issue, such as installing the missing task, I'm still stuck with a broken package, because nothing changes "SSIS.ReplacementTask" back to "NowInstalledTask" or whatever it was before.

Have I misunderstood this, or was this a by design that the designer will corrupt your package, and assume you have your own backup to revert to?

Thanks


http://www.sqlis.com | http://www.konesans.com

Bypass Request For Permission to Use a Key

$
0
0
We are using a SSIS package to connect to a web service and send information.  It uses two way SSL certs.  It successfully connects and sends the information, but always opens a request for permission to use a key box.  You have to choose Grant, and then click OK.  We want to bypass this dialog box so that it automatically grants permission to the dts package.  Can someone please help?  Thank you.

SSIS Task Required to Download the encrypted file using azure key Vault from Blob and load data into SQL table

$
0
0

Hi All 

we have a requirement to download the encrypted file using Azure key vault  stored in Blob  and load the data into SQL table .

we are able to decrypt and downlaod using Cloudblob class . ie  blob.DownloadToStream(stream, null, options, null);

The challenge here is  we are not allowed download decrypted file on sql server as per our security policy , 
we need to download , decrypt and load directly to sql server without keeping on sql server physical drive.

Please suggest us good way to achive that 


Surendra Thota

Error calling dtsx package from C#

$
0
0

Hi all, I've written a small winForm application to call a SSIS package with a configuration file.

In addition I've added a class EventListener inherited from DefaultEvents to log execution error.

Here you are application code:

            string pkgLocation;
            Package pkg;
            Microsoft.SqlServer.Dts.Runtime.Application app;
            DTSExecResult pkgResults;
            MyEventListener eventListener = new MyEventListener();
            pkgLocation = txtDTX.Text;
            
            app = new Microsoft.SqlServer.Dts.Runtime.Application();
            pkg = app.LoadPackage(pkgLocation, eventListener);
            pkg.ImportConfigurationFile(txtConfig.Text);
            pkgResults = pkg.Execute(null, null, eventListener,null,null);

and this is MyEventListener class

public class MyEventListener : DefaultEvents
    {
        public override bool OnError(DtsObject source, int errorCode, string subComponent,
     string description, string helpFile, int helpContext, string idofInterfaceWithError)
        {
            StreamWriter oFile = new StreamWriter(ConfigurationManager.AppSettings["ErrorFile"],true);
            oFile.WriteLine("Error in {0}/{1} : {2}", source, subComponent, description);
            oFile.Flush();
            oFile.Close();
            oFile.Dispose();
            return false;
        }
    }

Running the application on a Windows Server 2008 R2 (64 bit) machine with SSIS 2012 installed (my code refers to Microsoft.SqlServer.ManagedDTS.dll version 11.0.2100.60)

the package fails and I took the following error on my EventListener: Error in Microsoft.SqlServer.Dts.Runtime.TaskHost/ : The Execute method on the task returned error code 0x80131621 (Mixed mode assembly is built against version 'v2.0.50727' of the runtime and cannot be loaded in the 4.0 runtime without additional configuration information.). The Execute method must succeed, and indicate the result using an "out" parameter.

Can someone help me to investigate the problem?

Perhaps I need to use a different way instead of MyEventListener class?

Thank you in advance for your help.

Best regards

Fabrizio

SSIS Decompostion

$
0
0

hi 

Can processes be divided into smaller units / blocks (Modular programming)?


SSIS -How To Get Most Recent File from Directory And Load To a Table [ SSIS Script Task ] SQL 2012

$
0
0

Hi All

We get the files in our Source Folder on monthly basis. This source folder contain all previous months CSV files however, we want to create a SSIS Package that will load only the most recent file based on filename month naming convention from the source Folder. For Example, The latest file is 'Finance31-May-2016.csv' in below

Source Folder: D:\SSISImport

Finance31-May-2016.csv

Finance30-April-2016.csv

Finance31-March-2016.csv

Can anyone please let me know step by step how above requirement can be achieved?

What is the your recommendation to pick-up the latest file based on timestamp in filename or file created date or any other option?

Thank you.


Cheers, Badal Ratra MCTS

SSIS DB Log files

$
0
0

To all of you SSIS Gurus out there,

I have a 25 GB (and growing ..) log file belonging to the SSIS catalogs DB.

I set my retention period to 14 days but still no decrease in size. The SSIS Server Maintenance Job

SQL Agent task is running daily but with no significant affect so I am looking into ways of truncating the entire log file, start from scratch and investigate. I have two questions:

  1. Do you guys agree with stuff like this Link ? is it safe to use in your opinion?
  2. Can the recovery model for the SSIS DB be simple as oposed to full?

Appreciate your input, Zeev

Batch processing Transnational Data Suggestions

$
0
0

Hello,

I have a requirement where Data comes in flat file format.  This data need to go through various step of transformations and lookup . I have broke down the process in steps.  1. Stage 2. Collect Needed Data 3. Validate Data 4. Store Them in incremental order for Future use. 5. Generate More transaction related to incoming rows. 6 Send it to Target system.  

Through out the process data will be going across many tables and servers and i have following requirement.

1. I need to create process so that in case of failure  if data has not gone through all steps  and in to target system i need  process to start from where it left off and finish processing the data to target.  ( Requirement ask not to use Check Point in SSIS)

2. In case failure require to process that same file again then all data should be wipe Cleaned in step 1 to 5 and new file should process  

I have looked in to batch processing so in all steps batch ID will be there but need better suggestions. Please let me know if you have any suggestion or route i should avoid.

Microsoft.SqlServer.Dts.Pipeline.DoesNotFitBufferException: The value is too large to fit in the column data area of the buffer.

$
0
0

Hello All, 

I am reading an EBCDIC file into SQL database table with 329 fields. 

I am getting the following error :

[EBCDIC File Source [113785]] Error: Microsoft.SqlServer.Dts.Pipeline.DoesNotFitBufferException: The value is too large to fit in the column data area of the buffer.
   at EBCDICSource.EBCDICSource.PrimeOutput(Int32 outputs, Int32[] outputIDs, PipelineBuffer[] buffers)
   at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPrimeOutput(IDTSManagedComponentWrapper100 wrapper, Int32 outputs, Int32[] outputIDs, IDTSBuffer100[] buffers, IntPtr ppBufferWirePacket)

How can I identify which field is causing the BufferException Error? 

Thank you in Advace.

Package task won't populate all fields unless that task is run independently

$
0
0

I'm running SQL8 R2.
I have a package which pulls data from our production server into our data warehouse for several tables. 

One table that is built in the process depends on an earlier table being populated, from which it should be retrieving an Admission Date and a Discharge Date.

When I run the solution (created in SQL Server Business Intelligence Development Studio) it appears to run fine but in 1 table the dates are populated as NULL.  After the solution has completed I can right click on the Execute SQL Task component in the Control Flow and when it completes the dates are now populated with the expected data.

I thought maybe something wasn't "completing" from an earlier task so I set all of the constraint values to Completion (previously they were on Success).  That did not help.

I thought maybe it was a timing issue so I added a 10 second delay and that did not help.

Am I missing some kind of "commit" that needs to run between the components?

Count 10 rows delete til text change

$
0
0

Hi, i need to count 10 rows of a spreadsheet that has matching data in column b and C then delete any other rows that has the same data, these follow one and another.

So there maybe 130 rows with same data i only need 10 the rest deleted.

When the name changes in column C, leave 10 rows delete the rest and so on.

Any and all help is vastly apprecited

Regards

M

SSAS Cube deployment issue

$
0
0

Hi,

I am getting below error when deploying ssas cube in our server :

Erreur OLE DB*: Erreur OLE DB ou ODBC*: Login timeout expired;*HYT00;*A network-related or

instance-specific error has occurred while establishing a connection to SQL Server. Server is not found or not accessible. Check if instance name is correct and if SQL Server

is configured to allow remote connections. For more information see SQL Server Books Online.;*08001;*SQL Server Network Interfaces: No remote client protocols are enabled and no

remote protocol was specified in the connection string [xFFFFFFFF]. ;*08001.

Have you ever got such an error or do you know how to fix this problem ?

Sincerely, 






Find the CSV file for updating data

$
0
0

Hi,

   I have created a SSIS Package, for this package the input is CSV file. The file will get updated once for two or three days. I have scheduled the Agent Job for this package to run it daily. What i wanted is, when the file is updated the package should run completely and update data in the Database, if the file is not updated then the package should identify that the file is the old and should not run the whole package. I think we can achieve this using SCRIPT task, if yes how we can??

Thanks,

Bhanu

"Package failed validation from the ExecutePackage task" error

$
0
0
I have an SSIS package which calls two other SSIS packages as part of it's control flow (using the Execute Package task). Both packages are stored in the same parent folder on the same server. The first child package runs successfully, the second does not. It ran fine for days until yesterday. Not sure what I might have done. I have tried to delay validation and recreate the connection. No go. Has anyone else run into this. I am running SQL 2005 RTM and VS 2005 RTM on XP Pro SP2. Any suggestions would be welcome.

Syntax to Set FileName Variable value to Shared Location in SSIS

$
0
0

Hi All,

What is the syntax to set the FileName variable value to shared folder location in SSIS Package.

For Example.

SSIS Package Name: FileName

ShareLocation: \\SeverUAT\SSIS Source File

Syntax: ???

Thank you.


Cheers, Badal Ratra MCTS

How to run SSIS Package with different user account using SQL Agent Service

$
0
0

Hi All,

What are the steps to run the SSIS Package with different user account in SQL Agent Service:

My problem is SQL Agent service is running on local account "NT Service\SQLSERVERAGENT" and this account doesn't have access to "SSIS Flat File Source Folder" and "SSIS .dtsx" Package sitting in SharePoint App Server.

Or What do you recommend to overcome this issue?

That result not loading of CSV data into Loading Table. Here is the SQL Agent Job History Error details:

06/20/2016 20:04:27,Monthly Finance CSV Import,Success,1,SERVERUAT1,Monthly Finance CSV Import,Monthly Finance CSV Import,,Executed as user: NT Service\SQLSERVERAGENT. Microsoft (R) SQL Server Execute Package Utility  Version 11.0.6020.0 for 64-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  8:04:27 PM  Error: 2016-06-20 20:04:40.70     Code: 0xC020200E    Source: Monthly Finance CSV Import CSV Source File [2]     Description: Cannot open the datafile "D:\SSIS Source File\FinanceCSV31-May-2016.csv". End Error  Error: 2016-06-20 20:04:40.71     Code: 0xC004701A     Source: Monthly Finance CSV Import SSIS.Pipeline     Description: CSV Source File failed the pre-execute phase and returned error code 0xC020200E.  End Error  DTExec: The package execution returned DTSER_SUCCESS (0).  Started:  8:04:27 PM  Finished: 8:04:40 PM  Elapsed:  13.166 seconds.  The package executed successfully.  The step succeeded.,00:00:15,0,0,,,,0

Thanks for your help.


Cheers, Badal Ratra MCTS

assign max value to a variable in ssis

$
0
0

Hello experts,

i am getting max date from text file and i would like to assign max value to a variable with script component

can you please help me

thanks in advance


ADKR

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>