Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Change ActionCode to "update" for all repeated SerialNumbers loaded into table. Allow Duplicates.

July 19, 2012, 8:40 am
$
0
0

I use SSIS to load an xml file to a sql table.  Then I use IBM Cast Iron to pick up the table's records and push them to Oracle CRM on Demand. 

I have a table called DDR.CRM_Comp_Asset, which I load xml data into.  My table has a PK on Util_Unique_Pk which is an autogenerated id incremented by 1.  Any data sent to me will be loaded into the table, even duplicate records (a requirement).  This table also has a column called ActionCode which has the default value "insert" upon new records created.

On the site, Oracle CRM on Demand, SerialNumber is a unique field.  We can only push records into Oracle CRM on Demand with a unique SerialNumber.  All repeated SerialNumbers will fail the Cast Iron integration.  I use a WSDL operation Execute to handle both inserts and updates based on the WSDL mapping "@operation" value recieved from ActionCode.  Once the correct value "insert" or "update" is mapped to @operation, the WSDL operation knows to perform that operation.

Therefore, in my SSIS package, I need a way to say "While loading xml data into DDR.CRM_Comp_Asset, after the 1st record with unique SerialNumber is created (with ActionCode = "insert"), then all the following records with a duplicate SerialNumber should be inserted into the table with ActionCode = "update"."  Is this possible?  Thanks.  

Evan Johnson

↧
Search

Data Loading Best Approach

July 19, 2012, 4:54 am
$
0
0

We have a requirement to load full table data and get only last 7 days data from OLTP to OLAP.

My approach is as follows:

1. Connect to OLTP using SSIS and load as a dimension table to store full table records or except last 7 days

2. Have 2 connections (dsn) in SSAS so that we query the Full table from DWH db, and using OLTP DB (dsn) connection we could create a named query for last 7 days which would give me the latest.

Is there any better approach to handle this requirement?

↧
↧

SSIS 2008 - Import all CSV files in folder - each target different table

April 13, 2011, 8:12 am
$
0
0

I'm new to SSIS 2008, and I'm attempting to import a series of CSV files into a database. I want to loop over every CSV file in a specified folder and import each file into a different table that must be created on the fly (name of table should be base name of file, i.e. with path and extension stripped off). The file structures are similar, but not identical, so the single target table solution won't work.

Using an example I found here:

http://microsoft-ssis.blogspot.com/2011/02/how-to-configure-foreach-loop-file.html

I'm able to successfully load all files into ONE table, but I need to load each file into a separate table. Can anyone provide some assistance on exactly how to modify the project to allow for a table to be created, on the fly, for each source file?

thanks,

Mark

 

↧

Can someone explain the purposes of some new SSIS 2012 properties?

July 19, 2012, 10:52 am
$
0
0

As someone who's learning SSIS, there are some new properties in SSIS 2012 that I can't find any documentation/explanations for. Thus, I'm hoping someone can explain them:

In the Maintenance Cleanup Task, the BIDS property grid has a DeleteFromAllBricks property. What does that property control?

In the Back Up Database Task, I see CopyOnlyBackup, IgnoreReplicaType, and UseExpiration (which is also present in 2008) properties. What are these properties for?

In one of my dtsx files, there's a Rebuild Index task with a SkipUnsupported property. What does SkipUnsupported do?

Note that none of these properties have their description fields set in BIDS and when searching online, I can't find any definitions. 

Thanks,

-Craig

↧

How to load data from SQL to TERADATA table using ODBC connection

July 20, 2012, 1:44 pm
$
0
0

Hi all,

I need to send data from SQL to Teradata destination. TPT load is not working properly on my machine. I have 32 bit ODBC driver for Tera data on my machine. SO can any one please let me know the procedure like what kind of destination i should use and how to set properties.

Thanks in advance,

Jyo

↧
↧

concatenating similar files from different folders

July 26, 2012, 1:52 am
$
0
0

Hi,

I have some folders namely FolderA, Folder B... and each folder contains some files like file1, file2..etc. File1 can be present in both folder A and B and so on. I want to create an SSIS package which merges all the similar files. Like File1 from folder A and file1 from folder B has to be merged. How can i proceed with this? All suggestions are most welcome.

Also, which one will be efficient? Using the SSIS or using windows scripting?

Thanks in advance,

Nikesh

↧

SSIS package does not respond after some time.

July 20, 2012, 5:25 am
$
0
0

i have created a package which loads data after transforming it. the source database and destination databases are on different servers. currently, the source table has 11,855,790 records. when i run package, after particualr number of records, the package does not respond. i do not get any error. the DFT (data flow task) remains yellow (in execute mode) and nothing happens even if i keep it for hours.

i tried to load data from diferent database which was on same server and has less records. the package runs successfully. after that i tried to load data again from database on different server but taking only 1,000,000 records. it worked fine. after that i tried again taking 5,000,000 records. it did not work. package stopped responding after processing particular records.

as there is not error/warning message i am not able to figure out the problem. Please suggest if there is any way to fix it.



↧

Issues accessing SSIS from remote machines

July 18, 2012, 10:34 am
$
0
0

SQL 2008 fully patched with a two node active/passsive cluster. Currently, one named instance has been created.  Connecting to the instance with SSMS and drilling down to the MSDB folder, I get an error on any remote machine (including the passive node):

Failed to retrieve data for this request. (Microsoft.SqlServer.Management.Sdk.Sfc)
The SQL Server instance specified in SSIS service configuration is not present or is not available. This might occur when there is no default instance of SQL Server on the computer. For more information, see the topic "Configuring the Integration Services Service" in Server 2008 Books Online.

Login failed for user 'NT AUTHORITY\ANONYMOUS LOGON'. (MsDtsSvr)
Login failed for user 'NT AUTHORITY\ANONYMOUS LOGON'. (Microsoft SQL Server Native Client 10.0)

I've already edited the MsDtsSrv.ini.xml file to contain the full instance name, which seemed to be the most accepted solution in my searching, but my error still remains.

The issue only occurs on remote machines, the active node works fine. Any solution to this?

↧
Search

XML to EXcel conversion

July 26, 2012, 1:38 am
$
0
0

I am looking out for vb code in Script task to convert XML to Excel 2003 format which should work even if the machine on which package has to be run doesnt have microsoft office installed on it. Is it really possible to implement ? I could find out code for conversion but that would require Microsoft office to be there on the box.

Thanks in advance !

↧
↧

Unable to parse XSD corresponding to XML in SSIS.

July 26, 2012, 3:51 am
$
0
0

validation Error:

Error at Data Flow Task 1 [XML Source [1]]: The XML Source Adapter was unable to process the XML data. The content of an element can not be declared as anyType.

xml tag:

<

xs:anynamespace="##other"processContents="lax"minOccurs="0"maxOccurs="unbounded"/>

↧

SSIS Package FTP Task Error: Directory is not specified in the file connection manager "User::ProcessingFileLocation".

July 18, 2012, 9:53 am
$
0
0

Hi,

I have one SSIS package that has FTP task which takes files from FTP and save on my local drive

but i'm getting above error.

[FTP Task] Error: Directory is not specified in the file connection manager "User::ProcessingFileLocation".

In FTP Editor setting :

User::ProcessingFileLocation used SSIS variable and values sets to this is \\MYSERVER\\Raw Data\\

why getting this error any solution ?

when i mention direct path it is working fine BUT why not for variable :( :(

I'm using same path for other packages too they all are working fine

Ashish Fugat (ashuthinksatgmail.com) SE




↧

Change Data Capture - for Incremental load - Pls help

July 25, 2012, 10:45 pm
$
0
0

Hi,
    I tried CDC for incremental load.but facing a issue. 

 1. DFT1 , I loaded ALL the records from _CT table to intermediate 'Staging_product' table.
 2. Execute SQL task with the command 'select max (__$start_lsn) as max  from  staging_product' and get the value of
max (__$start_lsn) into a variable called "Var:Max" - datatype:Object.
 3. DFT2
 3a)Source > OLEDB Source > Query: select * from staging_product where __$start_lsn> ?' and mapped
    the parameter to the variable "Max"
 3b)Conditional Split > Conditions >
          insert --__$operation == 2,
          update=__$operation == 4,
          delete=__$operation == 1
 3c) Insert output > Lookup with Target table > Select productid from productfinal > Then, OLEDB desn > Insert
 3d) Update output > OLEDB Command > update productfinal set productname=? where productid=?
 3e) Delete output > OLEDB Command > delete from productfinal where productid=?

The issue is, from source it is getting ALL the records from staging table and then splits using Conditional transformation. What i require is,
it should fetch the records only from the Max __$start_lsn,rite?

I really appreciate your help!!



↧

Error: Microsoft Visual Studio for Applications has lost the link to .

November 4, 2008, 1:42 pm
$
0
0

I keep getting the following error when debugging script tasks.

 

Error: Microsoft Visual Studio for Applications has lost the link to .

Your work will be exported to U:\My Documents when you quit the application

 

 

Any idea what causes this? There is an "OK" button, and clicking it does nothing but close the dialog box.

It doesn't seem to change anything in the debugging session.

↧
↧

Web Service task for Fetching Data

July 26, 2012, 12:06 am
$
0
0

I have a Web service using which i want to fetch data.

I have used Web Service task in SSIS in which following are my inputs:

General Tab:

1. HTTP Connection: i have provided the web URL of the Webservice

2. WSDL FIle :Created a new WSDL file on my machine

Input Tab:

1. Service - name of the service from the Web service from the drop down list

2. Method- The name of the function which i want to use as a source

3. In the input parameter i have provided a default value for now.

Output Tab:

1. Output Type - File Connection

2. File - Created new file to contain the data from web service

Now in the output i have received some XMl code.

I am not able to figure out what needs to be done next.

I want to use this data from the XML file to load one of the table in our database.

Please suggest me some possible workaround for the same.

↧

VSTADTEProvider.Interop error while working with script transformation

August 11, 2011, 4:35 pm
$
0
0

Error:

Could not load file or assembly 'VSTADTEProvider.Interop, Version=9.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. The system cannot find the file specified. (Microsoft.SqlServer.VSTAScriptingLib)

 

I get the above error when I click on the edit button under script transformation. I'm using enterprise edition SQL Server 2008 R2. I tried reinstalling SQL Server, that did not help. I am trying to repair SQL Server and none of the paths I give for the Install folder works. Please help.

↧
Search

FTP Connection Manager Password in Child Package

July 17, 2012, 7:32 am
$
0
0

I have a package made up of several "Execute Package Task" items. The first to execute is a simple package that does some directory preparation and then retrieves files from an FTP site. It works fine run independently, but when the parent package is run it fails in the first child package with the message:

[Connection manager "FTP Connection Manager"] Error: An error occurred in the requested FTP operation. Detailed error description: The password was not allowed.

It seems clear the password in the FTP Connection Manager in the child package is not available when the package is run as part of a parent package. Both the parent and child packages are saved with EncryptSensitiveWithPassword. I have pored through the properties of both the parent and child packages, but am clearly missing something.  What do I need to do to get this to work?

Echo Train Nashville TN

↧

How to get error in to sqlserver table when the package is executing in Job?

July 16, 2012, 5:18 am
$
0
0

Hi,

Is there way to log the error,when ever package is executing in sqlserveragent?

In brief,Lets say I have package that I have deployed to server.The pacakge is executing fine for two days,third day I got the error.So,now I want to see the error that occured and I dont want to open the package in BIDS.

Can anyone suggest the workflow for this.

Thanks

sudha

↧
↧

SQL SERVER 2008 memory allocation

July 26, 2012, 3:21 pm
$
0
0

Hi there,

I read some articles about SQL SErver memory allocation. I understand ,that SQL Server allocate some memory to successfully finnish tasks and when its allocated, it is not released.

I dont understand why my SSIS package, which simply move data from OLE DB source to OLE DB destination (without any other data flow component) is allocating whole 6Gigz of RAM, when DefaultBufferMAxRows = 10000 and one row has less than 20 bytes. I am moving 200 milion rows. For me there is no reason to keep in memory more than 10000-100000(200KB - 2 MB) rows,because data flow is really fast. Could you explain how it workd exactly ?

Second question is, if memory is allocated once I don't know how much is really used later. I see only, that 6 Gigz are used by SQL Server, but how much is used by another process?  How to get information, when process is spooling to HDD ?

Thanks for help

↧

Upload Two Different Text File format through One SSIS Package [SSIS]

July 26, 2012, 11:22 pm
$
0
0

Hi,

i am using sequence container in SSIS Package to run 2 text file one contain with new . i used this function for this

its right

FINDSTRING(@[strOrigFileName],"New",1)==0

↧

SSIS Package is copying empty row in excel

July 17, 2012, 4:57 am
$
0
0

I am using SSIS package to copy data from SQL DB to excel file. But the problem is while running this package some time is skiping the empty row in between and sometime not and every time the row # is different.

Can anyone help me.....?

↧
Viewing all 24688 articles
Browse latest View live
Search