Hi All,

I am searching for some help on editing the SSIS packages as XML files, Here is the scenario, I have around 50 packages(All the packages use OLEDB connections and has servername and Database name properties) now I need to modify the connection properties of these oledb connections like change the Connection name and have to add connection string property to it, with out opening the packages in SSIS I want to automate the process of changing these using a script task in SSIS or Command files. What is the best way to do it.

Appreciate your help.

I have created a knowledge base and published it.  But when I go to my SSIS package on the same SQL server and add a DQS Cleansing step I cannot see the knowledge base I have created.  I create a new data quality connection manager to the localhost and the test is successful but it doesn't show my knowledgebase.

Why?  How can I get the knowledgebase to appear

I have this package - it simple moves data out a Visual FoxPro Table and unpivots it into a SQLServer 2008 table. It works beautifully in BIDS. It's basically a Script Task with code to run through the table.

Normally it would have two R/W parameters (one of which is m_filename) - but I have also put some default values in it when I constructed the package - so hopefully it runs on its own. It doesn't have connection manager elements - as they have been hardcoded.

Dim outputConnAsNew OleDbConnection("Provider=SQLNCLI10;Data Source=localhost;Initial Catalog=Reporting;User ID=xxxxxx;Password=xxxxxx")

Dim inputConnAsNew OleDbConnection("Provider=VFPOLEDB.1;Data source="& Dts.Variables("m_filename").Value &";Extended Properties=dBase III;")

I want to call it from a .NET web application through a Stored Procedure.

When I start the job then the message comes up that it cannot set the m_filename – how can I resolve this?

When this package runs it actually works as 32-bit (in title!) So we simply need to get the variables set!

Decided to remove the need to load the m_filename etc. so no parameters were loaded and the package validation returned DTSER_SUCCESS (0). (So it would use the default values). But no records loaded!

In a stored procedure we use the following command which I simple run and what is generated is the result set with errors below.

DECLARE @result varchar(500)

EXEC @result = master..xp_cmdshell 'dtexec /x86 /f "c:\cube\VFPImport.dtsx" /SET \package.Variables[User::m_filename].Value;"C:\DBFDATA\TEST_REPORT.DBF" /SET \package.Variables[User::m_version].Value;"VT7777"'

When I run this I get the error which suggests that VFPOLEDB.1 is not registered – and yet it was registered to run when in BIDS on the same machine. How do I force the registration in SQLServer - that can work?

However note that even though I used the /X86 switch to make it 32 bit mode – the utility seems to be the 64bit utility in the debug title! So the switch doesn’t work! They say that there is a different DTEXEC: one for 32 bit and one for 64bit. I think this is the reason that the process if failing to find the VFPOLEDB.1. If it found it – we still have to get over the fact that we cannot set the parameter values.

When I took the parameters out and just run the package with defaults it still came out with the same problem

By starting up Integration Services – I was also able to load the package – but again the same no reading m_filename  error. Could this be a privilege thing do you think?

This time I ran it without the parameters so using default.

It worked perfectly.

Then I checked and the records were in place! So leaving 8702 records for 110 records in the system. But clearly I am going to have problems running this unless I can do it properly through a SP? What seems to be wrong?

The code works in BID really well - which is wonderful - as I hear so much about problems working with VFPOLEDB.1

Steve

Hi,

How to use temporary tables in ssis?

Hi,

how can we get errors in a package in a destination in text file?

I am sorry to post this question. I have read until I can't read any more, and still cannot get this to work.

VS2012, Windows 7 x64. I have defined a Data Flow contained within a Foreach Loop.

The Data Flow has a Flat File which is looped over and outputs to another Flat File. This works OK.

Each of the input CSV Flat Files has a header record in row 1. The header record looks like:

"Assessed Value","Bathrooms",...

The Output connection from the conditional split is linked to the Flat File destination. The condition for this connection is:

FINDSTRING([Assessed Value],"Assessed Value",1) == 0

And, the Connection Manager's HeaderRowsToSkip property is set to 1! Yet the destination file contains all the headers along with the regular records.

If I have one condition defined as:

FINDSTRING([Assessed Value],"Assessed Value",1) > 0

and connect its Output Name to the Flat File destination, I get 12 records, all headers (there are 12 csv input flat files).

I am confused. What am I doing wrong?

Hi Folks,

I am having  a task to load data from multiple .xls files into a SQL Server table, and the file naming pattern kind of file1, file2, file3...and so on. I have to upload these files in a sequence like file1 first then file2 and so on.

Please suggest me the best way to do that in SSIS.

Thanks

Amar Deep Singh

I see many options to make the toolbox work, like 1) right clicking and clicking refresh (can't do that because there is no refresh option in the dropdown on the right click), 2) reset the toolbox, remove the .tdb's from the appdata... etc folder, go to the registry and clean out the toolbox cache keys from the HKCU... (that didn't work).   I was thinking that maybe when SQL 2012 was released, all the old "fixes" vanished to be replaced by a new "fix".

I'm curious as to what the fix is.  I have WPF, COM, Silverlight, .Net Framework, Activities and Workflow, but at this point, I need a way to convert ntext to text to save data to a flat text file.   VS_ISBROKEN.  I made several attempts to take my concatenated field (two fields separated by a comma and used as a single field and delimited with a pipe) and import it as DT_TEXT but no matter how much I jump around and cuss, the file still thinks it is DT_NTEXT so I decided maybe I should just add a conversion.  So I clicked the toolbox and (I think I remember it also did this when SQL 2008 SSIS came out - but can't remember how I fixed it back then) BINGO, Toolbox is empty.

What sort of choices do I have here to make this work? 

R, J

I am tyring to setup a job that does a few queries and emails the results as an email with a few attachments.

So far, this part works.  However, the output isnt something that is readily viewable in Excel. 
The query is hitting sys.dm_exec_query_stats , so one of the columns includes the text of various sql queries in that column.
Something related to my formatting of the CSV file within the SSIS tasks is causing this.
When I do the following - Run query in SSMS, copy/paste results into Excel, save as CSV, then re-open in Excel - the results look as expected.  Everything is on seperate lines.

My settings for the flat file connection manager

What formatting setting(s) am I missing.

Hello

I would like to launch an SSIS Package using DTExec.exe but with the Task Scheduler instead of the SQL Server Agent. The reason being is that I am having tremendous problems creating a proxy and would like another mechanism to launch the Package. I can run it easy on the machine with dtexecui.exe. My question is:

Is this possible to do with the Task scheduler (launch at a particular time the package with DTexec.exe Package.dtsx?

Thanks!
Mike

Mike Kiser

Hello all,

I have been trying to export some data to an Excel spread sheet using SSIS. I created an execute sql task, used ConnectionType as Excel and passed in the below statement to create a table in excel file and the load the data.

CREATE TABLE [Orders]

(

[Account #] varchar(10),

[Log #] varchar(5),

[Last Update Date] datetime

)

SSIS Execute SQL Task does create this table in the excel file but all "#" in the column name get converted to "." (a dot)

So i see column names in excel spreadsheet as "Account .","Log .","Last Update Date"

Is there any way i can see the column names the way i defined above.

My customer insists that i have names in the above fashion and any help in this would be greatly appreciated

Thanks in advance

~Dennis

Hi,

I would like to assign a severity value (e.g. 1-10) in each of the task (e.g. ExecuteSQL, Script Task) in my package such that if an error occurs on that object, a row will be created (triggered by an onerror event handler) in my log table specifying the severity of the task and the task name.

How do i do this? I can't use a variable because if there are 2 parallel tasks and both of them have an error, they will update the same variable which can cause a conflict on the severity value that will be updated in the row.

cherriesh

Debug crashes when I use an Execute SQL Command or a Data Flow connection using the SQL Native client (10 or 11) in both BIDS (2008) or SDT (2012). This error has appeared very recently, within the last 10 days. A coworker also gets the same error. Problem details are below:

Hi,

i am tring to batch file like :

Step 1:

dtexec.exe /f "\\SSIS\PROD\ASchedule.dtsx" /DECRYPT password /MAXCONCURRENT " -1 " /CHECKPOINTING OFF  /REPORTING EWCDI >Y:\Final\Result.txt

Step 2: convert txt file to .bat file

Now i am double click the bat file for testing but package not executing .

Note : inside txt / bat file getting error like

DTExec: The package execution returned DTSER_FAILURE (1).

I have SQL Anywhere 9 for Windows x64 (Developer Edition) installed on a Windows 2008 R2 server and on my Windows 7 desktop.  The reason for the out-of-date SQL Anywhere is that this is the level of the embedded database used by our POS application, Micros.  I downloaded the SQL Anywhere 9 for Windows x64 (Developer Edition) back when it was available on the Sybase website as an unlimited trial version, in order to get two components: Sybase Central for querying the database, and the OLE DB provider for developing MS SQL Server Integration Services packages to extract data from the Sybase database and load it into MS SQL databases for reporting and analysis.

After having had my PC updated from Windows XP to Windows 7, the problem I am having is that when I try to create a Connection Manager to access the Sybase database, using BIDS/Visual Studio on my desktop, the OLE DB driver is not listed under "Provider:"; on the Windows 2008 R2 server where I also installed SQL Anywhere 9, and which also has BIDS/Visual Studio, the "Provider:" dropdown in the Connection Manager dialogue lists "Sybase Adaptive Server Anywhere OLE DB Provider 9.0".

In both cases (on my desktop, where it doesn't work, and on the server, where it does) I am right-clicking in the Connection Managers pane and selecting "New ADO.NET Connection".

Is anyone aware of any additional steps I need to take in order to make this work.  We have production packages pulling data out of Sybase into MS SQL, and I'd prefer not having to log on to the server in order to maintain these or to create new Sybase to SQL packages.

We have built several packages to copy convert data from an MySQL database to SQL Server.

Some of the tables have now been updated in the MYSQL database.

In our dataflow get data from ODBC source tasks We can change the SQL command text and preview and check the updated command text works.

the packages gets a (*) to say it has changed but updated command text is not saved.

what do I need to do.

thanks

Hi,

I am new to SSIS.I am using Sql server 2008.

For last few days it was worked fine without any issues.Since 2 days its getting failed.The error messages are below:

   Code: 0xC02020A1
   Source: DFT Create Output file FF_DST NPS File [109]
   Description: Data conversion failed. The data conversion for column "Segment\
J" returned status value 4 and status text "Text was truncated or one or more c\
haracters had no match in the target code page.".
End Error
Error: 2011-09-14 20:35:41.83
   Code: 0xC02020A0
   Source: DFT Create Output file FF_DST NPS File [109]
   Description: Cannot copy or convert flat file data for column "SegmentJ".
End Error
Error: 2011-09-14 20:35:41.84
   Code: 0xC0047022
   Source: DFT Create Output file SSIS.Pipeline
   Description: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput met\
hod on component "FF_DST NPS File" (109) failed with error code 0xC02020A0 whil\
e processing input "Flat File Destination Input" (110). The identified componen\
t returned an error from the ProcessInput method. The error is specific to the \
component, but the error is fatal and will cause the Data Flow task to stop run\
ning.  There may be error messages posted before this with more information abo\
ut the failure.
End Error
Error: 2011-09-14 20:35:42.36
   Code: 0xC02020C4
   Source: DFT Create Output file OLE_SRC NPS Transform [1]
   Description: The attempt to add a row to the Data Flow task buffer failed wi\
th error code 0xC0047020.
End Error
Error: 2011-09-14 20:35:42.36
   Code: 0xC0047038
   Source: DFT Create Output file SSIS.Pipeline
   Description: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput metho\
d on component "OLE_SRC NPS Transform" (1) returned error code 0xC02020C4.  The\
 component returned a failure code when the pipeline engine called PrimeOutput(\
). The meaning of the failure code is defined by the component, but the error i\
s fatal and the pipeline stopped executing.  There may be error messages posted\
 before this with more information about the failure.
End Error
Progress: 2011-09-14 20:35:42.36
   Source: DFT Create Output file
   Post Execute: 0% complete
End Progress
Progress: 2011-09-14 20:35:42.36

   Source: DFT Create Output file
   Post Execute: 33% complete
End Progress
Progress: 2011-09-14 20:35:42.41
   Source: DFT Create Output file
   Post Execute: 66% complete
End Progress
Progress: 2011-09-14 20:35:42.41
   Source: DFT Create Output file
   Post Execute: 100% complete
End Progress
Progress: 2011-09-14 20:35:42.41
   Source: DFT Create Output file
   Cleanup: 0% complete
End Progress
Progress: 2011-09-14 20:35:42.41
   Source: DFT Create Output file
   Cleanup: 33% complete
End Progress
Progress: 2011-09-14 20:35:42.41
   Source: DFT Create Output file
   Cleanup: 66% complete
End Progress
Progress: 2011-09-14 20:35:42.41
   Source: DFT Create Output file
   Cleanup: 100% complete
End Progress
Warning: 2011-09-14 20:35:42.41
   Code: 0x80019002
   Source: NPS_Export
   Description: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED.  The Executio\
n method succeeded, but the number of errors raised (5) reached the maximum all\
owed (1); resulting in failure. This occurs when the number of errors reaches t\
he number specified in MaximumErrorCount. Change the MaximumErrorCount or fix t\
he errors.
End Warning

Please any one suggest me how to resolve this issue.

Thanks in advance..

Regards,

Santosh Y

Hello All,

i am loading data from DB2 to Sql Server 2008 R2, using ssis, in the data flow task i have ADO.NET source (sql code), some data conversion frm unicode to non unicode components then  target is sql server oledb destination table.

when i try ti execute the package i am getting error as below, it is failing at initial ADO.net Source task itself

ERROR:

>>>>>>>>>>

[ADO NET Source [1531]] Error: System.Data.OleDb.OleDbException: [DB2/LINUXX8664] SQL0952N  Processing was cancelled due to an interrupt.  SQLSTATE=57014
   at System.Data.OleDb.OleDbDataReader.ProcessResults(OleDbHResult hr)
   at System.Data.OleDb.OleDbDataReader.GetRowHandles()
   at System.Data.OleDb.OleDbDataReader.ReadRowset()
   at System.Data.OleDb.OleDbDataReader.Read()
   at System.Data.OleDb.OleDbDataReader.HasRowsRead()
   at System.Data.OleDb.OleDbDataReader.NextResult()
   at System.Data.OleDb.OleDbCommand.ExecuteReaderInternal(CommandBehavior behavior, String method)
   at System.Data.OleDb.OleDbCommand.ExecuteReader(CommandBehavior behavior)
   at System.Data.OleDb.OleDbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.SqlServer.Dts.Pipeline.DataReaderSourceAdapter.PreExecute()
   at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPreExecute(IDTSManagedComponentWrapper100 wrapper)

>>>>>>>>>

[SSIS.Pipeline] Error: component "ADO NET Source" (1531) failed the pre-execute phase and returned error code 0x80040E4E.

Could you please guide me here, please .....

Thank you in advance

Asitti

I followed this article to set certain permissions on the SSIS Catalog for a certain Windows Group.

http://blogs.msdn.com/b/mattm/archive/2012/03/20/ssis-catalog-access-control-tips.aspx

So, let's say I have a Windows Group called [SomeDomain\DevelopersGroup]. I add this group to the server Login, map the Login to SSISDB as public. After doing that, I set project level permissions using the properties window for the project folders in the SSIS Catalog.

After doing all this, I log in using my Windows ID which is a part of the group [SomeDomain\DevelopersGroup]. But for some reason, the permissions I set does not seem to have been granted.

So just for kicks, I removed the group and added my individual Windows ID to the server login and followed the same steps I used above to set certain SSIS catalog permissions. Now, my login gets the expected permissions.

Anyone else experience this? I am certain that my Windows ID is in the group because I can control other permissions through the group. But for some reason, the SSIS catalog permissions aren't coming through for individual IDs within the group.