Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Convert RTF to Text Format through Script Component

November 18, 2014, 8:20 am
$
0
0
I have pre written VB Code in Script Component for converting RTF Data to Plain Text 
    Public Overrides Sub Input0_ProcessInputRow(ByVal Row As Input0Buffer)
        '
        Try

            Dim enc As New System.Text.UTF8Encoding()
            Dim RTFConvert As RichTextBox = New RichTextBox
            RTFConvert.Rtf = enc.GetString(Row.Body.GetBlobData(0, Convert.ToInt32(Row.Body.Length)))
            Row.ConvertedBody.ResetBlobData()
            Row.ConvertedBody.AddBlobData(System.Text.Encoding.UTF8.GetBytes(RTFConvert.Text))
        Catch E As Exception
            E.Message.ToString()
        End Try
    End Sub

End Class
I am getting a Weird Error in which Script Component Converts RTF Data for only 9000 rows and does not convert after that.Can anyone please let me know alternative..Thanks 

Srikanth

↧
Search

SSIS ETL package that also needs to update a table

March 21, 2019, 10:34 am
$
0
0

Hello,

I have an SSIS package that runs a query to create an Excel spreadsheet. 

The package retrieves a value from a table for the last ID processed from the previous day and uses that in the query that is used to create the spreadsheet.  I need to get the last ID processed for the current run and write that back to the table so the cycle can be repeated.

What would be the best way to determine the last ID processed for the current run?

↧
↧

How to Develop SSIS package in SQL 2016 !

March 20, 2019, 9:04 pm
$
0
0

Hi Experts,

One of our new project vendor need to develop SSIS package and run it manually very frequently.

It is a new SQL 2016 installation,we don't see any visual studio installed though SSIS is part of installation.We tried to install SSDT but it is understood that it need visual studio to be installed. Now we are worried ,does visual studio installation involves separate license or community edition can be installed and then SQL server can be integrated to it ?

Do iam missing anything here ? .My objective is to give SSDT tools without any extra license. So please advise

Many thanks in advance ! 

Regards,

Naren


↧

SSIS export to Excel shows success but no output is sent to excel

October 1, 2008, 6:24 am
$
0
0

 

Can someone please help me??

 

I'm running simple t-sql command  and exporting output to excel.  The execution results indicate it's writing rows to excel but the spreadsheet is empty after package successfully completes.  I was originally looping through a table containing both valid and invalid sql servers so I eliminated the invalid ones just to see if those failures were part of the problem, however I got same results when all  connections were successful.

 

I changed the Source Output Output Columns to the supported datatypes  of double precision point float (RT_8) and unicode string (DT_STR) 255.  I  was not able to change Source Output External Columns (I could change and save but when I went back to verify, they had been reset to default (??).

 

This is beyond frustrating. I had this working several days ago until I started fiddling with re-directing rows upon error, which I eliminated for troubleshooting purposes.

 

Here's the t-sql command (intentionally written for SQL 2000 compatability)

 

SELECT CONVERT(nvarchar(20),serverproperty('servername')) as instance 
,d.name as dbname,
sum((convert(bigint, (Size) * 8)) /1024) as 'dbsize in MB'
 FROM master..sysaltfiles af join master..sysdatabases as d on af.dbid=d.dbid  
group by d.name

 

Oh - this works fine when I send output to a table in the database. 

↧

Faulting application name: DTExec.exe, version: 2017.140.3049

March 22, 2019, 3:41 am
$
0
0

Hello, we migrated to Windows 2016 / SQL 2017 CU3 from an Windows 2012 with SQL 2012

No we are getting a lot of SSIS Errors like this one:

Faulting application name: DTExec.exe, version: 2017.140.3049.1, time stamp: 0x5c1551d5
Faulting module name: kerberos.DLL, version: 3.5.1.300, time stamp: 0x5b318b23
Exception code: 0xc0000409
Fault offset: 0x000687df
Faulting process id: 0x2e88c
Faulting application start time: 0x01d4dfe5fef47a9f
Faulting application path: C:\DTS32\DTExec.exe
Faulting module path: C:\Windows\System32\kerberos.DLL
Report Id: 978608ea-c8d5-47eb-a427-dd8a11f7a154
Faulting package full name:
Faulting package-relative application ID:

We also have a lot of Informationals like

Fault bucket , type 0
Event Name: BEX
Response: Not available
Cab Id: 0

Problem signature:
P1: DTExec.exe
P2: 2017.140.3049.1
P3: 5c1551d5
P4: kerberos.DLL
P5: 3.5.1.300
P6: 5b318b23
P7: 000687df
P8: c0000409
P9: 00000002
P10:

Attached files:

These files may be available here:
C:\ProgramData\Microsoft\Windows\WER\ReportQueue\AppCrash_DTExec.exe_53669f70f863516132f36ceade495c0ab31e3ca_189b24e5_06526423

Analysis symbol:
Rechecking for solution: 0
Report Id: ab08c2ee-8949-4284-a3a4-7ddec31cebe9
Report Status: 96

and in the folder C:\ProgramData\Microsoft\Windows\WER\ReportQueue

a lot of report.wer

Any hints to find the cause ?

↧
↧

Job is failing at 4 and half hours every time it runs

March 22, 2019, 5:40 am
$
0
0

I got this loop in a SSIS package waiting for a file. The package is created in VS2017 and deployed into a SQL Server 2014 in SSISDB.

The Agent gives me an error message saying: "The step did not generate any output.  The return value was unknown.  The process exit code was -1073741571.  The step failed."

The SSISDB still thinks the package is running, no errors from the reports generated.

And, a final thing, it always fails around 4½ hours.



Any idea why it would fail at this time...? The package works fine as long as the file is delivered within this time interval. After approx 4 and a half hours, it always will fail with exit code -1073741571


The package works as long as the file is delivered within this time interval
↧

SSIS Command Line using dtexec verification not working

March 22, 2019, 8:02 am
$
0
0

I'm trying to setup a command-line call to dtexec to validate packages, using the project model. I'm calling dtexec like this:

dtexec /val /proj my.ispac /pack my.dtsx  /rep v

Though the real paths to the ispac and dtsx are longer. WHen I run this, all I see on the console is:

Microsoft (R) SQL Server Execute Package Utility
Version 11.0.7001.0for32-bit
Copyright (C)2016 Microsoft.All rights reserved.

Started:10:40:01 AM
PS D:\>

The whole thing runs in under a second which leads me to believe that it did nothing. And no messages of any kind are issued., even though I asked for verbose reporting.

Any ideas out there as to how to make this work?

(SQL Server 2012)

↧

SSIS Variable not changing with Script task

March 4, 2013, 4:25 pm
$
0
0

Hi

I have a written a script component to only read in the first row of a flat file and read one of the column values into a variable called MyVariable.

The following is my PostExecute method in the script task:

public override void PostExecute()
    {
        base.PreExecute();
        this.Variables.MyVariable= "MyTestValue";
    }

Now I am using SSIS 2012 so I am able to set a breakpoint on

this.Variables.MyVariable= "MyTestValue";

and when debugging I can see that MyVariable has been assigned the "MyTestValue" value.

However, when executing the package the variable does not seem to change.

If I use a derived column directly after the script component with the expression:

@[User::MyVariable]

nothing is returned.

Can anyone tell me why the variable value in the package is not updating, but it is when debugging the script?

This is the first time I've used variables so I've probably missed something really obvious.

↧
Search

SSIS User Variable is not getting updated via SQL Task

December 14, 2012, 3:46 am
$
0
0

Hi,

My package contains a User variable "User::IncrementalDate" String type.

I am using below query in SQL Task to update this variable:

Select ? = incremental_date from dbo.Audit where tablename = 'Sales'

In parameter mapping I use VARCHAR datatype for the variable and set parameter name as 0.

The sql task executes successfully but th evariable is not getting updated. Can anyone suggest solution for it.

Thank you.

↧
↧

SSIS - Multiple DBF Files In, single CSV file Out - Query / Issue

March 22, 2019, 9:42 am
$
0
0

Hi all

I'm new to SSIS and I'm trying to troubleshoot an SSIS package I've built which is meant to: -

Loop through dbf files in a directory, and for each file, extract and translate data, with the results being pushed to a single CSV file (there's a separate output for a configuration CSV as well).

I've had moderate success so far, but I've hit a bit of an issue since the introduction of the for each loop to my solution.

Basically, when the package runs, I can see it is looping through the files in the directory, but seemingly it is only writing data to CSV for one of the dbf files (which is seemingly the one specified in my OLE DB Source Data Flow Component).

Can anyone advise how I might solve this problem. I'm sensing it will be as part of the For Loop with the utilisation of variables and expressions but I'm not 100% sure. Thanks in advance for any assistance, I've placed some screenshots below of the setup...

Michael

↧

Failed to retrieve long data for column

March 5, 2010, 11:33 am
$
0
0
Hi,

      I am calling an SSIS package inside a SQL Server Agent job step. Almost half the time, the package fails with the following error and it works fine other times. The column that it complains about is a nvarchar(max) column and the maximum data length for the records we have in that column is around 3600.

Message

Executed as user: abcdef. Microsoft (R) SQL Server Execute Package Utility  Version 10.0.2531.0 for 64-bit  Copyright (C) Microsoft Corp 1984-2005. All rights reserved.    Started:  4:30:00 PM  Error: 2010-03-03 16:30:02.84     Code: 0xC0047070     Source: Data Flow Task 1      Description:   End Error  Error: 2010-03-03 16:30:02.84     Code: 0x80004005     Source: Data Flow Task 1      Description:   End Error  Error: 2010-03-03 16:30:02.84     Code: 0xC0208266     Source: Data Flow Task 1      Description:   End Error  Error: 2010-03-03 16:30:02.84     Code: 0xC0208265     Source: Data Flow Task 1 Source - Query [1]     Description: Failed to retrieve long data for column "Response".  End Error  Error: 2010-03-03 16:30:02.84     Code: 0xC020901C     Source: Data Flow Task 1 Source - Query [1]     Description: There was an error with output "OLE DB Source Output" (11) on component "Source - Query" (1). The column status returned was: "DBSTATUS_UNAVAILABLE".  End Error  Error: 2010-03-03 16:30:02.84     Code: 0xC0209029     Source: Data Flow Task 1 Source - Query [1]     Description: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "output "OLE DB Source Output" (11)" failed because error code 0xC0209071 occurred, and the error row disposition on "component "Source - Query" (1)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.  End Error  Error: 2010-03-03 16:30:02.84     Code: 0xC0047038     Source: Data Flow Task 1 SSIS.Pipeline     Description: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "Source - Query" (1) returned error code 0xC0209029.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  4:30:00 PM  Finished: 4:30:02 PM  Elapsed:  2.012 seconds.  The package execution failed.  The step failed.

 Could you please let me know why this error is happening randomly and how I could avoid this error?

Thanks,
JayaMS

↧

SQL 2014 Enterprise Attunity v3 for Oracle Import Package to SSISDB Error

July 5, 2016, 8:36 am
$
0
0

I have successfully installed the Attunity v3 (32bit and 64bit) on Windows 2012 (Oracle 11g already installed) for SQL 2014 (Enterprise). I can run the project locally but if I attempt to import the package to SSISDB, I get this error:

The managed pipeline component "AttunitySSISOraSrc.8" could not be loaded.  The exception was: Could not load type 'AttunitySSISOraSrc.8' from assembly 'Microsoft.SqlServer.PipelineHost, Version=13.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91'..

I'm still awaiting activation on the Attunity forum, else I would ask there.

Any ideas?

↧

Executing a package in 32bit mode - "The path for 'ISServerExec.exe' cannot be found" error

November 27, 2017, 7:46 am
$
0
0

Hi there,

This is pretty arcane, but I've been struggling with this all morning, and I'm out of ideas. I bet one of you guys have solved this though...

I have a package which reads from Excel. It is deployed to the Catalog. I want to run it in 32bit mode, as the server has the 32bit ACE OLEDB driver on it. So far, so straightforward.

I want to give it a quick execute to test it before I create the Agent job, so I right-click on the package in the Catalog to Execute, go into 'Advanced' and as soon as I go to check the '32-bit runtime' box, I get the following error:

"The path for 'ISServerExec.exe' cannot be found. The operation will now exit."

My understanding is that when this occurs, I'm calling [SSISDB].[catalog].[create_execution] like this:

Declare @execution_id bigint
EXEC [SSISDB].[catalog].[create_execution] @package_name=N'Package.dtsx', @execution_id=@execution_id OUTPUT, @folder_name=N'ETL', @project_name=N'Test_OK_to_delete', @use32bitruntime=True, @reference_id=Null
Select @execution_id
DECLARE @var0 smallint = 1
EXEC [SSISDB].[catalog].[set_execution_parameter_value] @execution_id,  @object_type=50, @parameter_name=N'LOGGING_LEVEL', @parameter_value=@var0
EXEC [SSISDB].[catalog].[start_execution] @execution_id
GO

and sure enough, when I execute that sproc directly, I get the same error.

I believe that both (the 32bit) DTExec.exe and (the 32bit) ISServerExec.exe are in play here, but I'm not sure which is calling which. It *feels* like I'm executing the 32bit DTExec, but that's unable to find the 32bit ISServerExec.

If I look in the registry

HKEY_LOCAL_MACHINE/SOFTWARE/Microsoft/Microsoft SQL Server/120/SSIS/Setup/DTSPath is set to C:\Program Files\Microsoft SQL Server\120\DTS\ which is the 64bit version.

Am I missing something obvious here?

Thanks for your help

↧
↧

can i load a table from ssis more quickly than the off the shelf fast load?

March 23, 2019, 6:14 pm
$
0
0
Hi. I just loaded 100's of millions of rows into a new warehouse using the dft fast load (I think that's what its called) available in ssis off the shelf with a default commit size. Is something faster (maybe bulkinsert) available if backing out isn't important to me?  Are there restrictions on the target (maybe indexes have to be dropped etc) in such alternatives?
↧

Connection Manager possible to move Tab/Frame to another Tab or location/float

March 24, 2019, 1:51 am
$
0
0

Hi,

Silly question, I would like to move the Connection Managers Frame to another Tab/frame to have it float or by error tab

I can only resize but not float or move

visual studio 2017 community, SSDT 15.9

Is it possible?

Regards

↧
Search

All records not loading from Flat file source

March 13, 2019, 4:42 pm
$
0
0

Hi All,

In my package i have a Flat file source and destination is a sql server table. When i run the package i do not get any error messages. It shows it loaded 30K plus records, but  when i do a count on the table i see only 195, not sure why and how. Where should i even start looking? This package was moved from 2008 to 2015 version. In the older version the developer used (Delimited file source (DFS)) from codeplex. This version doesnt have dfs plugin so i used regular flat file , please adviceThanks.

↧

SSIS - Data Flow Destination

March 24, 2019, 12:34 pm
$
0
0
Hi, I'm trying to create a simple Integration Services project. As a data source I've chosen a flat file but I have difficulties with adding and configuring a destination. The destination should be a database created in Oracle SQL Developer. I've tried to watch different tutorials, but it didn't help me at all. Does anyone have some experience with it?


↧
↧

OLAP connection manager not working with dynamic values from SSIS config file

March 24, 2019, 12:47 pm
$
0
0

Hi Team,
Could anyone provide suggestion to fix on the below issue in  my SSIS package.
I have a SSIS package designed to process SSAS cube on automated basis.first step involved is dimension processing and second is processing cube.
1) SSIS package works fine and process cube in DEV environment
2) Now generated XMLA script  from development cube and created cube structure in Testing environment
3) Ran SSIS package again with test environment config to process cube in testing environment
4)Cube process fails and observed that OLAP connection manager is not picking values from SSIS package config file. Runs only with design time value irrespective of the environment deployed

please confirm is this issue with OLAP connection manager or expected behavior.

Is there any fix available to make it work

Note: using SQL server 2017 version

Many thanks

karthi



↧

How to create a dynamic SQL Command for OLE DB Source

March 20, 2008, 8:12 pm
$
0
0

Hi All,

 

I have a requirement to create a dynamic SQL Command in an OLE DB Source due to the fact that I need to read data from another database based on a date range. For example, the SQL command would look like

 

SELECT * FROM Table1 WHERE DateField BETWEEN '17/03/2008' and '21/03/2008'

 

and I need to change the dates - '17/03/2008' and '21/03/2008' to different dates when the package is deployed in production, how do I do that ?

 

Regards

Ash

↧

Error: The version of AS400 clsid {} is not compatible with this version of the Dataflow.

March 24, 2019, 5:02 pm
$
0
0

Hi,

I am getting the following error on sql server 2016.

Error: The version of AS400 clsid {} is not compatible with this version of the Dataflow.

The error is getting only for packages which has AS400 connection and only on sql server(not in visual studio).

Naresh

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>