Quantcast
Viewing all 24688 articles
Browse latest View live

Migrate DTS from SQL Server 2000 to SQL server 2008 and SSIS.

Hi,

I will try to migrate our DST ( 19 DTS) to SSIS on SQL 2008, but I was wondering next questions:

Microsoft has best practices for this?

We can migrate with Business Intelligence Development Studio?

Which steps you recommended for make this migration?

You know tool for make this migration?

If you know the common issues on this migration?



Best Practice for Configuring the FTP Connection Manager

Hi,

I have a FTP connection manager that transfers files to a client's FTP site. The problem is that this works 95% of the time and every so often I get error message: Error Code 0xC001602A: The server name or address could not be resolved:  Code: 0xC002918F Unable to connect to FTP server using "FTP Connection Manager"When this happens my client is convinced that the issue isn't with their FTP site but rather SSIS and when we test connecting to the FTP site manually it works everytime. Below is how I have my FTP connection manager configured - any best practices I should be using?

Server Name: ftp.myservername.com

Server Port: 21

Credentials: (I'm using a UserName & Password)

Time-Out: 60 sec

Use Passive Mode: Unchecked

Retries: 5

Chuck Size (in kb):

Thanks for your help.


Francis, MCTS: BI 2008, MCITP: BI 2008 Stay Thirsty My Friends

Fuzzy Grouping Transformation - is it possible to specify the source/target data sets being compared.

I'm working on a project for a client that uses the Fuzzy Grouping Transformation component to identify potential duplicate records in the system. It appears that you can define a query to use as the source of records look through... but as far as I can tell, the FGT uses that query to then look through the rest of the database and I need to restrict that to look at just a subset of the data in the database... sometimes that subset will be the whole database, other times it won't be (more often than not it'll be a true subset) ... Does anyone have any experience using the FGT? Is there a way to limit what the logic looks at? or do I need to look at everything first, then remove from the results data that isn't in the subset?

Convert Activex Scripts to VB / C# Script tast for SQL2008

I am converting a sql 2005 server to 2008.  I have an old active x script which i need to convert to a script task for ssis...

I am not familar with VB/C# scripting so I do not know how to convert this for use in 2008.

When Run i receive this error " An error occurred while adding the managed SSIS type library to the script host. Verify that the DTS 2000 runtime is installed".  I believe we want to avoid invoking the legacy functionality so converting the scripts at this point would be better.

'**********************************************************************
'  Visual Basic ActiveX Script
'**********************************************************************

Function Main()
	Dim strTo
	Dim strCC
	Dim strSubject
	Dim strBody

	'Construct the subject and body and set the attachment path
	strSubject = "Validation #" + CStr(DTSGlobalVariables("VAL_ID").Value) + " (" + CStr(DTSGlobalVariables("ErrorCount").Value) + "): " + DTSGlobalVariables("VAL_NAME")
	strBody = "Description:<br />" + vbCRLF + Replace(DTSGlobalVariables("VAL_DSCR").Value, "''", "'") + vbCRLF + vbCRLF + "<br /><br />Suggestions:<br />" + vbCRLF + Replace(DTSGlobalVariables("VAL_WEB_NOTES").Value, "''", "'")
	strAttachmentPath = DTSGlobalVariables("FileAttachmentPath").Value

	'Construct the address lists depending on if there were errors
	If DTSGlobalVariables("ErrorCount").Value = 0 Then
		strTo = DTSGlobalVariables("EmailAddyNoErrorsTo").Value
		strCC = DTSGlobalVariables("EmailAddyNoErrorsCC").Value
	Else
		strTo = DTSGlobalVariables("EmailAddyErrorsTo").Value
		strCC = DTSGlobalVariables("EmailAddyErrorsCC").Value
	End If

	'If there's someone to send an email to, do so.
	If Len(strTo) > 0 Then
		Call SendSMTPEmail(strTo, strCC, strSubject, strBody, strAttachmentPath)
	End If

	Main = DTSTaskExecResult_Success
End Function


'***********************************************************************************************************************************************************
'This function sends the email
'***********************************************************************************************************************************************************
Function SendSMTPEmail(ToAddresses, CCAddresses, SubjectText, BodyText, AttachmentPath)


	Dim iMsg
	Dim iConf
	Dim Flds
	
	Const cdoSendUsingPort = 2
	
	Set iMsg = CreateObject("CDO.Message")
	Set iConf = CreateObject("CDO.Configuration")
	Set Flds = iConf.Fields
	With Flds
		.Item("http://schemas.microsoft.com/cdo/configuration/sendusing") = cdoSendUsingPort
		.Item("http://schemas.microsoft.com/cdo/configuration/smtpserver") = "smtp.mail.com"
		.Item("http://schemas.microsoft.com/cdo/configuration/smtpconnectiontimeout") = 10
		.Update
	End With
	With iMsg
		Set .Configuration = iConf
		.To = ToAddresses
		.CC = CCAddresses
		.From = "OPSValidator@somewhere.com"
		.Subject = SubjectText
'		.TextBody = BodyText
		.HTMLBody = BodyText
		.AddAttachment (AttachmentPath)
		.Send
	End With
	Set iMsg = Nothing
	Set iConf = Nothing
	Set Flds = Nothing

End Function


KDW


SSIS logging issue while migrating from 2008 to 2012

Hi All

I had 2008R2 SSIS packages and inthem i had some "Script task" and within script task i have some custome Logging message that i wanted to be captured within SSISloggins, something like ..... "

Dts.Log("My message" , 0, dataBytes) 

 so basically to see this message in SSIS loggings I have to set the ScriptTaskLogEntry, story short everything is working perfectly

BUT once i moved to SSIS 2012 the migration (upgate of the packsges to 2012) just disabled ALL of the SCRIPT TASK logging, now i have to enable them all one by one.

have anyone seen such a thing in SSIS upgrade?

the upgade is a "Package deployment model"


Sincerely Nik -- Please kindly mark the post(s) that answered your question and/or vote for the post(s).

Error on SSIS package when trying to import Data from SQL Server to MySQL

I looked at the few similar posts regarding these problems but i quite did not find the solutions yet.

I am trying to import some data from SQL server ( 2008 R2 - 64 bit )  to MY SQL. Installed the ODBC driver ( SQL connector)  MySQK ODBC 5.2w.

I am using ADO.NET connection string for both Source( SQL server)  and Destination( MySQL), however i get error on destination when i am trying to map to the MySQL table ( trying to insert into Mysql Table).

When i try to click to get table drop down list in destination column i get this error>

"Could not retrieve the table information for the connection manager 'Mysql_serverName'.

Attempted to read or write protected memory. This is often an indication that other memory is corrupt. (Microsoft Visual Studio)" .

And then i click on new and try to create the New table, and i do get the error during mapping.

"Error at Data Flow Task [ADO NET Destination [43]]: Failed to get properties of external columns. The table name you entered may not exist, or you do not have SELECT permission on the table object and an alternative attempt to get column properties through connection has failed. Detailed error messages are: 

ERROR [HY010] [MySQL][ODBC 5.2(w) Driver][mysqld-5.1.66]

"

I don't think it is permission issue, since if i use the same ado.net connection( as source ) and select form mysql tables, i can retrieve the data.

Also, the user account that is used in ODBC connection to connect to MYSQL has pretty much full rights on mysql db.

Appreciate if i get any help here or point me to the right direction.

Need a Urgent help for one expression based on below scenario

I have two files called
HSMMECO_GHS_SKV_RIP_20121030.txt
HSMMECO_GHS_SKVRAP_RIP_20121030.txt .I need to loop these files and load in to table using foreach loop .I am trying to get a expression in a Filespec property,which will turn these files to a common format as shown below .

HSMMECO_GHS_SKV*.txt

Please help me to get that expression.Thanks in advance!

Trying to run a SSIS package through a bat file in app server

I have the following command in a bat file


"C:\Program Files(X86)\Microsoft SQL Server\100\DTS\Binn\DTExec.exe" /f "E:\Scripts\SSISPackage.dtsx"  /Connection "E:\Scripts\Config.dtsConfig"

PAUSE

I get the error saying "The System cannot find the path Specified"

The SSIS package works fine in the BIDS. I have created a config file using SQL SERVER Authentication which has credentials of a service account and am using this config file in bat. How can I run this package. Is there an error with tha batch command or is it because of SQL Server Authentication. I can see the username in the config file but not the password.Is this the problem?If it is how can I use password in config file.


ssis support schema migration(SSIS data migration tool not a database migration,isn't it?)

Hi Team,

I am have multiple options(BCP,SSMA) to migrate data along with schema from Sybase to SQL server other than SSIS. 

Does SSIS support schema conversion, if not what are else option to use for the same?

Can I use SSIS for batch jobs(those run overnight auto scheduled and dependent on each other,means second job depend on outcome of first batch job,third depends on second, some other configurations also there)?

Your support is very valuable please guide here.

Thanks,


ckp


Connection manager "DBS": SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80040154.....Description: "Class not registered".

I have Master Package and a child package. I have package configuration in child package where i am getting connection configuration strings from master package. 2 connections and 2 variables in child package and have expression on both connections so that getting the configuraion string values from variables. If i disable the Package configuration and run child package having variables the config. string values it runs but when i enable the package configuration with no values in variables to get the connection strings from parent it fails with error :

Error: 0xC0202009 at RTS_ETL BE_2_DUNS_childPackage, Connection manager "DBS": SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040154.
An OLE DB record is available.  Source: "Microsoft OLE DB Service Components"  Hresult: 0x80040154  Description: "Class not registered".
Error: 0xC020801C at Load BE_2_DUNS, OLE DB Source [1]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "DBS" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.
Error: 0xC0047017 at Load BE_2_DUNS, DTS.Pipeline: component "OLE DB Source" (1) failed validation and returned error code 0xC020801C.
Error: 0xC004700C at Load BE_2_DUNS, DTS.Pipeline: One or more component failed validation.
Error: 0xC0024107 at Load BE_2_DUNS: There were errors during task validation.

Any Idea whats wrong?

I am using sql 2005. 

Read selected columns from SharePoint list using SSIS Sharepoint List adapter

By default, all the columns/fields in the SharePoint list am getting. I want to chose only few columns/fileds . Fied1, Field2, Field3 from SharePoint list. Should I build the CAML query for this? If so, how?

<Query> <Order By>

<FieldRef Name='Field1' />

<FieldRef Name='Field2' />

<FieldRef Name='Field3' />

</Order By> </Query>

When I put the above query againt to 'CamlQuery' in Advanced Editor for SharePoint List source, am getting this error - 'Error at Data Flow Task [SharePoint List Source]: The syntax for the CAML query provided is invalid XML.'



Package schedlingError.

hello Friends

I got this Error during scheduling.

Message:
Executed as user: GGN_DBCRM\SYSTEM. ...n 9.00.4035.00 for 64-bit  Copyright (C) Microsoft Corp 1984-2005. All rights reserved.    Started:  5:51:14 AM  Error: 2012-11-21 05:51:16.65     Code: 0xC0011007     Source: {4B567137-D1AE-45BD-B1F8-455054B0E93D}      Description: Unable to load the package as XML because of package does not have a valid XML format. A specific XML parser error will be posted.  End Error  Error: 2012-11-21 05:51:16.65     Code: 0xC0011002     Source: {4B567137-D1AE-45BD-B1F8-455054B0E93D}      Description: Failed to open package file "C:\Program Files\Microsoft SQL Server\100\DTS\Packages\Refresh_Vicidial_Cube.dtsx" due to error 0x80070003 "The system cannot find the path specified.".  This happens when loading a package and the file cannot be opened or loaded correctly into the XML document. This can be the result of either providing an incorrect file name was specified when calling LoadPackage or the XML file was specified and has ...  The package could not be f...  The step failed.

i used this location in file system

C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Packages\Refresh_Vicidial_Cube.dtsx


Kindly help friends

Where is SSIS in MS Visual Studio 2010?

I just started MS Visual Studio 2010 and I'm looking for SSIS.  I see this:

Image may be NSFW.
Clik here to view.

I haven't used SSIS for a while, and when I last used it, it was really just for fun, and pretty much a learning experience.  Now, I'm starting to get back into it, as a hobby, and I'm tryign to figure out how it works in VS 2012.  The last version I used was SSIS in SQL Server 2008 Developer (now I have SQL Server Express 2012).  The interface looks totally different, and I'm a bit lost right now.

Thanks everyone. 


Ryan Shuell

Calculate Days between same date field in multiple records, looping for each record

Be patient as I am a newbie to Sql Server (using 2008 R2) and SSIS.  I have looked at multiple solutions in this and many other forums before submitting the question.

I am looking at records to identify the number of days between two dates.  We review drug information.  A member uses drug A (Code identifies this called GPI) and has refills throughout time.  The goal is to calculate the days between Refill 1 and refill 2, then refill 2 to refill 3, etc.  When that member record set is complete, we move to the next member record set.

The basic data would be as follows.  Each record shown below would be a separate record in a single table :

MemberDrug Code      DateService         Days Between
1A3/1/20120
1A3/27/201227
1A4/21/201226
1A6/15/201256
1F2/25/20120
1F3/20/201225
1F4/17/201229
1F8/1/2012107
5B2/15/20120
5B3/10/201225
5B4/10/201232
5B6/28/201280
5B7/10/201213
5B8/20/201242

The days between is the value I am looking to calculate.  The First record for the grouping of Member and Drug Code will be zero ( 0 ) as there is no preceding date to calculate against.  The process would then loop through the records at the grouping (Member and Drug Code) until those records are calculated.  It would then move on to the next group of Member/Drug records.

Any assistance would be greatly appreciated.  Any clarification I can provide, I would be more than happpy too.  Thank you in advance!

Passing Filename Arguments in Execute Task Process

Hi All,

Having an issue trying to pass a filename as an argument to a batch file from a Execute Task Process.  The filename passes fine if the filename contains no spaces but as soon as a space is invloved it truncates the filename.

EG:

Filename1.txt would pass fine and be echoed out to a test file by my simple batch below:

echo %1 > file.txt

However, if my filename is like "Filename1 with spaces.txt" only Filename1 is getting output.

Any ideas how to cater for the spaces?

Many Thanks,

Slash.


Communication link failure when connecting to remote database

Hi,

 

I have an SSIS package which runs subsequent packages in a batch.  When I run the main package through command line or a SQL job and connect to a data warehouse that is on the same machine, it runs without a problem.  When I try and connect to a warehouse on a remote machine (ideal configuration), it fails with this error:

 

Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005. An OLE DB record is available.  Source: "Microsoft SQL Native Client"  Hresult: 0x80004005  Description: "Communication link failure". An OLE DB record is available.  Source: "Microsoft SQL Native Client"  Hresult: 0x80004005  Description: "Communication link failure". An OLE DB record is available.  Source: "Microsoft SQL Native Client"  Hresult: 0x80004005  Description: "TCP Provider: An existing connection was forcibly closed by the remote host. ".

 

This seems to happen on random subpackages and isn't always consistent. 

 

My Master.dts.Config file has this connection info:

 

<Configuration ConfiguredType="Property" Path="\Package.Connections[Batch].Properties[ConnectionString]" ValueType="String">
  <ConfiguredValue>Data Source=RemoteServerName;Initial Catalog=DataWarehouse;Provider=SQLNCLI.1;Integrated Security=SSPI;</ConfiguredValue>
 </Configuration>

 

Both machines have 64-bit operating system and 64-bit SQL software.

 

Any help would be great.

 

Thanks.

Credential can't see dtsx package in SSISDB

Hello,

I have the error message bellow when the SQL Agent JOB executes an SSIS package.

the step run under a proxy that holds a service account as credential.

Executed as user: XXXX\svc_internalbi. Microsoft (R) SQL Server Execute Package Utility  Version 11.0.2100.60 for 32-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  12:06:18  Failed to execute IS server package because of error 0x80131904. Server: XXXXXXX1, Package path: \SSISDB\INTERNALBI\SRMBD\SRMBD - load targets.dtsx, Environment reference Id: 1.  Description: Cannot access the package or the package does not exist. Verify that the package exists and that the user has permissions to it.  Source: .Net SqlClient Data Provider  Started:  12:06:18  Finished: 12:06:18  Elapsed:  0.063 seconds.  The package execution failed.  The step failed.

=> when the login (credential) is sysadmin : the job run successfuly

=> I found roles in SSISDB, when the login is ssis_admin : the job also run succesfuly

=> db_datareader & db_datewriter : it fails with the same error message

I already set permissions on folder / environnement & project of the SSIS catalog.

could you please advise of what permissions must be set for the login to be used as proxy account please ?

Thank you

Stéphane

move flat file when missing a column

Hey guys,

I'm kinda stuck with my project I'm working on.

I will be receiving multiple flat file CSVs a week and in the best case scenario all of them will have 4 columns so my package should run without any problems then.

But ofcourse it can happen that the feeder is missing a column, when this happens i want the Dataflow task to fail and move the file to another directory.

So I made a simple dataflow task where i Import from CSV => Database and in the Control i connected the Data flow task to a Move File task + i changed the green arrow between them to a red ( failure one) .

I thought this solution would work, so for testing I removed a column from my input CSV and ran the package. For some reason my data flow task succeeds but nothing gets imported in the database.

What am I doing wrong here ? Why is the Data flow task not failing and the Move file task kicking in ?

Kind regards

General setup to switch between DEV and PROD server

Hello,

I know this has been asked and answered before but I couldn't find any information that would make it clear for me.

I use the project deployment model to run a SSIS catalog project via an SQL Agent inside SQL Server 2012. This all works fine as long as I'm in the DEV area and don't want to switch to a different server instance.

My general server setup:
DEV: servername
PROD:sameservername\prodinstance

So for testing I run the package on the DEV server trying to import data to the PROD server instance (same database and table name). I have created two environment variables for the DEV and PROD environment inside the catalog to hold the names for server and database. But the import will run down the DEV road because I believe

But what do I need to modify in my package setup to actually get the right connection manager depending on the environment variable - where for example I only have the DEV connection manager as its "Connection" in a SQL Task?

Image may be NSFW.
Clik here to view.

I believe this is where I need to set a parameter or variable. When I right click on the SQL Task is "Parameterize" the option to look for?

What about the OLE DB-Target? How can I set the connection manager to change depending on the environment here?

I hope I could make my goal clear. Feel free to ask if I left out some essential information.

Thanks for your help.


Excel Connection Manager not working with the SQL Server Job

Hello everyone,

I am using excel 2007 in my package, I am not able to run it throgh the job. I am sure its a provider issue. The connection is :

Provider=Microsoft.ACE.OLEDB.12.0;Data Source=\\uxpf335\ps_sql_data$\EI SSIS Files\DEV\NTXD132\Adjustments\OngoingAdjustmentsLoad\ALF_Risys_Stats1.xlsx;Extended Properties="Excel 12.0;HDR=YES";

I have enabled 32 bit in job as well. using SSIS 2008

WIll appreciate your quick suggestions or work around.

Thanks

Sumit



Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>