Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Manual Transaction: Dataflow task hangs when we use TRUNCATE TWO TABLEs in one execute SQL TASKS

$
0
0

Hi,

I am implemeting a package which has got manual transaction using execute sql task.

I have got execute SQL task for truncating table and also data flow task inside sequence container (attached screenshot).

Noticed that I cannot have two truncate table statements in execute sql task if i am loading data in to more that one destination in dataflow task. However if i am doing individually like one truncate  and one load it is working fine.

Can anyone explain how does it actually works and how can i truncate multiple tables in one execute SQL task it self and load all this tables parallelly using one dataflowtask.

Appreciate yiur help.

Thanks!

SHamsuddeen



How to get attachment URL from SharepointList using SSIS SharepointList Source?

70-463

$
0
0

Hi guys,

I am taking 70-463 in 3 months…

For me, best method is by studying from a paper-book, it always worked! I wanted recommendations on books! I have time (3 months) I have experience on both DW and SSIS; but my experience is hands-on, I want to know the internals, the theory… I know there are a lot of books out there, that’s why I want to narrow it to 3,4 books… I also know there is the book for this exam, but I want something not exam-focused, but to really learn both SSIS and DW.

Thanks in advance!

Web Service has image "field" how to save to disk?

$
0
0

I have to access a web service where I pass in a product number and it produces an XML result with an /image section where it has a long string (base64?)    I am trying to call the web service and save the image to the OS.

  I am trying to get the result into a variable and save it to disk with  the itemno.jpg as the name

This is a sample file I get back..

<NewDataSet>
  <Table>
    <ITEMNO>2065</ITEMNO>
    <Image>/9j/4QAYRXhpZgAASUkqAAgAAAAAAAAAAAAAAP/sABFEdWNr ...  removed since too long for post  ...</Image>
    <ImageDate>2015-04-15T00:00:00+00:00</ImageDate>
  </Table>
</NewDataSet>


FTP Task issue

$
0
0

Team ,

I have come across a issue , when I am calling child package ( with FTP task) from parent package( both packages are set with

encrypt sensitive with password) package will fail at FTP task saying password not allowed. When I run child package alone ( with Ftp task it will run without any issue.

Can you please let me know what is the solution for this

SCD task and Sequence generator (Next Value) dependancy

$
0
0

We have Sequence generator (Next Value) enabled for surrogate keys (SQL Server 2012). When we use the new SCD task, we get the following error:

[Insert Destination [42]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.

An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "NEXT VALUE FOR function cannot be used if ROWCOUNT option has been set, or the query contains TOP or OFFSET. ".

Is there any know issue that these two features [SCD task and Next Value] cannot be used together?


Bose

Scrip task : create excel using C#

$
0
0

I need to create excel workbook "SalesData.xlsx', which should have worksheet "POS". After creating excel file in specific location, script should be able to format cells as well.

For instance, first two column type should be numbers. Here are the columns:

ColumnName : Type

Id : Number

AccountNumber : Number

Name: Text

Address: Text

Also, it checks for existing file . If it exist, then overwrite the file.

Thanks in advance.


ZK

SSIS job failure through SQL Agent

$
0
0

My SSIS package is running fine in Visual Studio locally. The package contains (at the end) a process task to execute an .exe file that generates a xml file.

Note: Earlier, The package was scheduled in SQL Server 2005 and it was running fine. Now, I have migrated this package to SQL server 2012 and creating agent job in 2012.

On Monday 4 PM: I deployed the package to SSIS catalog and scheduled it to run every week day at 7 PM.

Monday 7 PM: Job ran successfully.

Tuesday 7 PM: Job Failed with error

Executed as user: ProxyID. Microsoft (R) SQL Server Execute Package Utility Version 11.0.5548.0 for 64-bit Copyright (C) Microsoft Corporation. All rights reserved. Started: 11:05:02 AM Error: 2015-05-11 11:12:25.65 Code: 0xC0029151 Source: Execute XML Generator Execute Process Task Description: In Executing "\Servername\path\app.exe" "" at "", The process exit code was"-532459699" while the expected was "0". End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 11:05:02 AM Finished: 11:12:25 AM Elapsed: 442.922 seconds. The package execution failed. The step failed.

Wednesday 4 PM:

  1. Opened the agent job

  2. In job step, deselected SSIS catalog option (everything got reset)

  3. Again selected SSIS catalog and provided the same server name

  4. Selected the required package from catalog

  5. Pressed OK

Wednesday 7 PM: Job ran successfully

Thursday 7 PM: Job failed with same above error.

Friday 4 PM: I did the same thing what was done in Wednesday 4 PM.

Friday 7 PM: Job ran successfully.

Why the package and SQL agent job scheduled is behaving like this? Please provide your suggestions and help. I must fix this issue before the next run. Your kind help will be much appreciated.

Note: The package is failing with same error while I select to run with option run as "32 bit" (In SQL Agent).



Updating SSIS task standard properties window

$
0
0

Hi,

    If, in an SSIS package, you put an instance of an 'Execute SQL Task' task in the Control Flow, in the Properties window, you can see the properties of the task, for example CodePage.

    If you double click on the task, the Execute SQL Task Editor appears, with several of the properties which are also in the Properties window, including CodePage.

    If, in the Editor, you update the value of CodePage, then click OK, the value of CodePage in the Properties window is updated immediately.

    I have written a custom SSIS task, which also has the same properties in the Properties window and in the Editor. The Editor also has an OK button. When OK is clicked, the values of the task properties are updated. An example property is FolderToArchive. If I open the Editor, change the value of FolderToArchive and click the OK button, the value of FolderToArchive in the Properties window is NOT immediately updated.

    If, however, I select the FolderToArchive field in the Propertiesd window, it is then updated with the value I entered in the Editor.

    How do I get my task to update the values in the Properties window, after changing a value in the Editor, when I click the OK button please?

    I would have thought I would need something like, in pseudo-code,

    Task.Parent.PropertiesWindow.Refresh

    where task is of type Microsoft.SqlServer.Dts.Runtime.Task and Task.Parent is of type Microsoft.SqlServer.Dts.Runtime.Package.

    Thanks,

    Kevin

SQL Server Variables

$
0
0

Hi I got following variable which assigns name to output file. Sample example of the variable is like "AP_201506041534.txt" .Now we want to prefix the USA/CAN to the output name depending upon Project param. If the project param is CID=100. The prefix should be like USA and output file name should be like USA_AP_201506041534.txt. If the Project Param CID= 200.The prefix should be like CAN and output file name should be like CAN_AP_201506041534.txt.

Please help me in modifying this user variable

"AP_" +  (DT_STR,4,1252) DatePart("yyyy",getdate()) +

Right("0" + (DT_STR,4,1252) DatePart("m",getdate()),2) +

Right("0" + (DT_STR,4,1252) DatePart("d",getdate()),2) +

Right("0" + (DT_STR,4,1252) DatePart("hh",getdate()),2) +Right("0" + (DT_STR,4,1252) DatePart("n",getdate()),2) +".txt"

SSIS ToolBar empty

$
0
0

Hi,

I have installed VS community edition 2013 on a widows 7 PC. When I try to create a ssis package the ssis tool bar comes up empty.  Appreciate any help to resolve this. It just says "loading" on the panel .

how to rerun from failed child package from execute package task in foreachloop container in masterpackage after wait for 30minutes without failing the masterpackage

$
0
0
hey we have master package, in that foreachloop is there and in that executepackage task is there. we are running almost 30 child packages
from masterpackages. what the issue is becasue of some network issue, sometimes it is not connectiing to source server in oledbsource in some child packages,
so master package execution fails.
my requirement is when package fails because of network issue i.e. if execute package task fails(means child package fails) in foreachloop container,
then it should wait for 30 minutes like that and again need to run execute pacakge task from the same failed package how.

tsrkreddy

Import XML files with mixed content model on Complex Types

$
0
0
Hi Masters,

I Would like to ask your help to solve a problem I have been facing in a development in SSIS.
I need to import data from several XML files, but I get erros when trying to configure the XML Source task. The error is just below "ERROR".The reason for this error is because this task does not support a schema with mixed content, as the following example XSD (Part of this xsd).
Note: this will xml content with special characters.

How can I solve this problem?

  <xs:element name="field">
    <xs:complexType mixed="true">
      <xs:choice minOccurs="0" maxOccurs="unbounded">
        <xs:element ref="import:ecs_selection"/>
        <xs:element ref="import:p"/>
        <xs:element ref="import:value"/>
      </xs:choice>
      <xs:attribute name="name" use="required" type="xs:NCName"/>
      <xs:attribute name="title" type="xs:NMTOKEN"/>
    </xs:complexType>
  </xs:element>

ERRO:
Error at Data Flow Task[XML Source[27]]: The XML Source Adapter does not support mixed content model on Complex Types

SQL server 2014 and VS 2013 - Date Column Error and Error handling for Derived column

$
0
0

Hello Everyone,

At present, I'm facing two problems in current SSIS package.

1. Date Column Error.

I'm using Data Flow Task to migrate data from CSV files to SQL tables, one by one using For each loop container for multiple CSV files.

This package is throwing following error when data in date column is null.

[OLE DB Destination [793]] Error: There was an error with OLE DB Destination.Inputs[OLE DB Destination Input].Columns[Created Date] on OLE DB Destination.Inputs[OLE DB Destination Input]. The column status returned was: "Conversion failed because the data value overflowed the specified type."

On the other hand, the same is working well with DateTime type.

Also, it is working fine with Date Type when I process a file separately in a different package.

This is really weird and I am unable to understand this.

Can anybody please shed some light on this problem?

2. Error handling/Log for Derived column

I'm using Data Flow Task to migrate data from CSV files to SQL tables, one by one using For each loop container for multiple CSV files.

I would like to log the erroneous records in a separate file at data flow task.

Say for instance, for numeric (10,2) column, if data in CSV file has value beyond this range, like 98.95784736264, then this particular record needs to be logged in a separate file and the package should process the next record.

I’ve tried to implement it over Derived Column component, but I’m facing the following error while doing so.

[Flat File Source [1]] Error: Data conversion failed. The data conversion for column "Column_Name" returned status value 2 and status text "The value could not be converted because of a potential loss of data.".

Please advise how to get rid of this problem.

Any help would be much appreciated.


Thanks, <b>Ankit Shah</b> <hr> Inkey Solutions, India. <hr> Microsoft Certified Business Management Solutions Professionals <hr> http://ankit.inkeysolutions.com

when i start the master package, it should run from failure child package and not from first child package.

$
0
0

my another scinario is I am running almost third child packages from master package using executepackagetask in foreachloopcontainer.

now if a child package fails and issue is resolved, when i start the master package, it should run from failure child package and not from first child package. how to do this. and we are using sql server logging by creating manually using stored procedures.


tsrkreddy


Teradata connector doesn't run as a scheduled job

$
0
0

Hello,

I have an SSIS package that successfully runs a Teradata connection query. However, when I schedule the job to run in the SQL Server Agent I get the following error:

Executed as user: SERVER_NAME\Administrator. Microsoft (R) SQL Server Execute Package Utility  Version 11.0.2100.60 for 64-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  7:53:26 AM  Error: 2015-06-08 07:53:26.78     Code: 0x00000216     Source: Package1 Connection manager "Teradata"     Description: There was an error trying to establish an Open Database Connectivity (ODBC) connection with the database server. SqlState = IM003 Message = Specified driver could not be loaded due to system error  126: The specified module could not be found. (Teradata<c/> C:\Program Files\Teradata\Client\15.00\ODBC Driver for Teradata nt-x8664\Lib\tdata32.dll).  End Error  Error: 2015-06-08 07:53:26.78     Code: 0x0000020F     

Could you let me know some troubleshooting steps? Why would a connection work in SSIS but not in a scheduled SQL Server Agent job?

Loading CSV file it messy the column's value

$
0
0

Hi guys, I am struggling with the csv files. I got twenty file in a folder, using ForEachLoop I load all the file in one table but some rows retrieve something like0 |credit_prem_cost,0.16 when it should be credit_prem_cost |0.16. Most of them are loaded correctly but sometimes I got these rows with two columns in one column. Bear in mind that the file has several columns but I load only the last two columns.

Any idea? Thanks

VS2008 BIDS package designer not starting and packages do not execute

$
0
0

Hi Folks,

For some reason when I double click on a package or right click and select designer all I get is the xml version of the package - no designer.  If I try to execute a package I get the following:

===================================

Unexpected internal error:  (Microsoft Visual Studio)

------------------------------
Program Location:

   at Microsoft.DataWarehouse.ProgrammingByContract.Internal.NullCheck(Object obj, String shortMessage)
   at Microsoft.DataWarehouse.ProgrammingByContract.Internal.NullCheck(Object obj)
   at Microsoft.DataTransformationServices.Project.DataTransformationsPackageDebugger.ValidateAndRunDebugger(Int32 flags, DataWarehouseProjectManager manager, IOutputWindow outputWindow, DataTransformationsProjectConfigurationOptions options)
   at Microsoft.DataTransformationServices.Project.DtsPackagesFolderProjectFeature.ExecuteTaskOrPackage(ProjectItem prjItem, String taskPath)

I have gone through days of uninstall/reinstall/restarts of VS2008 and SQL server until I'm now blue in the face.  Any suggestions would be greatly appreciated (short of reformatting the hard drive - not an option)

Exporting a table from sql to flat file in folder location

$
0
0

I have a requirement where I have to take all the data available from a sql table and write it out as a flat file in folder location.

Its a simple table have 8-10 coloumns, have to take this data on daily basis from sql table and deliver out as flat file in a folder.

Can anyone provide me detailed steps how to achieve this ?


MBH

using SSIS to call a stored procedure on AS400 iseries DB2

$
0
0

I have developed an SSIS Package which uses an ODBC connection to an AS400 iseries stored procedure. I use an Execute SQL Task. The query is Call Doctrack.PubFeed(?,?,?,?). The procedure takes 2 input parameters and 2 output parameters (3rd and 4th parameters) The data types of the output parameters are  an integer and varchar.   As part of the procedure data is inserted into a table on the iseries. 

When I run the package using breakpoints to view the values of the variables I see that the stored procedure returns values for the output parameters  and the execute SQL task is a success and proceeds to the next task in the package.  The whole package ends successfully.

However, when the table on the iseries is checked nothing has been inserted into it.  To test further,  I manually run the procedure on the iseries using the same parameters.  The run is successful.  And when the table is checked, there are in fact new rows inserted.

What can possibly be the issue since I am not getting any errors when I run the package?  Oh I should add that prior to the execute Sql Task,  there is a data flow task which moves data from a SQL Server database  to a table on the iseries (successfully) using the same ODBC connection.  The execute sql tasks uses that information for the Stored procedure.

Viewing all 24688 articles
Browse latest View live


Latest Images

<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>