Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

BIDS Data Mining Performance Issue

August 8, 2012, 12:41 pm
$
0
0

Hello everyone.  I'm having an interesting problem with Microsoft Business Intelligence Development Studio and the Data Mining Query Task. I have a package in which there are (among a few other things) two Data Mining Query Tasks, which take in some rows from an already existing database, perform the data mining query on them, and append them to the same database. Both databases are moderately small (on the order of 30,000 rows with about 15 columns).

This was all well and good on the development server, but I'm running into a weird issue as I try to shift everything to the production environment. After a specific and consistent number of rows in each database, the Data Mining Query Tasks hangs (the numbers are 2001 for the first task and 5001 for the second task). Any number of rows less than these limits and it takes a few seconds. Anything longer and the Task times out (after 2 hours).

Another thing to note is that when I pull information from the same production databases but insert them into a different table on the development server, everything goes fine.

I can only assume there is some setting in the production database that is messing something up, but I don't have a clue what it could be. Unforunately, I am only an intern and didn't set up the system, nor do I have complete access to everything, but I did some poking around and couldn't find any material differences in the settings.

Anyone have any advice or suggestions? Any help is greatly appreciated.

↧
Search

Errors when using Linked Server queries in SSIS

August 9, 2012, 12:04 pm
$
0
0
Hi All,

I am trying to use linked server queries in my SSIS packages and getting the following errors:

Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E14.
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80040E14  Description: "Cannot open the table "ar_customer" from OLE DB provider "MSDASQL" for linked server "mas90_link". Unknown provider error.".
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80040E14  Description: "The OLE DB provider "MSDASQL" for linked server "mas90_link" reported an error. The provider did not give any information about the error.".

All I am trying to do is select * from linkservername...ar_customer in OLEDB source and pushing the data to a new table in OLEDBDestination.

need your inputs on this. Thanks for the help.
↧
↧

SharePoint add-on

August 9, 2012, 12:33 pm
↧

Externalizing SharePoint add-on for ssis

August 9, 2012, 1:05 pm
$
0
0

Hi,

I want to externalise the SharePoint site URL and SiteList Name, which I am able to do using expressions in the data flow.

I am updating some of the Meta Fields on SharePoint Desitnation based on the Source SharePoint. So I am using following steps-  

  I upload a file to a  SharePoint document library using a File System Task and the UNC path:

On posting of the file, this automatically creates a record in the document library with a lot of missing fields

1) To fill in these fields, I use a Data Flow Task with a SharePoint List Source to pull the record that was just created.
 - To do a filtered pull, you need to specify the where clause in the CamlQuery custom property.  Here’s what it looks like for this project: 
2) <Query><Where><Eq><FieldRef Name='LinkFilename'/><Value Type='Text'>XYZ.zip</Value></Eq></Where></Query>
 - The fields that I pull are the ID (necessary for updating SP List records) and all of the other fields that I need to change.
 - Next, I use a Derived Column transformation to fill in the missing fields with the values that I need (I use variables or variable expressions so, I  can externalize all of this)
 - Finally, I use a SharePoint List Destination to do the update
3) I set the BatchType to “Modification” and pass through the ID (which is the PK on the SharePoint list) and the rest of the fields

But my problem is as I want to make this DYNAMIC (dynamic Site URL and corresponding column name). Please help me how to handle that in the Derived Columns  as there will be the varied columns names in different Site URL.

Thanks,

Madhur

madhur_ms

↧

Export Access Query to Excel Destination With a Pivot Table

August 9, 2012, 8:50 am
$
0
0

I currently have an Access Query that I would like to export to to Excel 2007 on one tab, then using that data I would like to copy it over to a prebuilt pivot table, that would update automatically upon opening the excel sheet. It was exporting using the qry view of the Access table to the excel document but it was not actually updating the data. I changed it to a SQL statement of the qry for the source to go to an excel destination with a data conversion in between, but I recieve the following errors, no matter how much I cange the source or destination:

Error: 0xC0202009 at Data Flow Task 1, Destination - zqryFinal [31]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
Error: 0xC0209029 at Data Flow Task 1, Destination - zqryFinal [31]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "input "Destination Input" (42)" failed because error code 0xC020907B occurred, and the error row disposition on "input "Destination Input" (42)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at Data Flow Task 1, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Destination - zqryFinal" (31) failed with error code 0xC0209029 while processing input "Destination Input" (42). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.
Information: 0x40043008 at Data Flow Task 1, SSIS.Pipeline: Post Execute phase is beginning.
Information: 0x4004300B at Data Flow Task 1, SSIS.Pipeline: "component "Destination - zqryFinal" (31)" wrote 0 rows.
Information: 0x40043009 at Data Flow Task 1, SSIS.Pipeline: Cleanup phase is beginning.
Task failed: Data Flow Task 1
Task failed: Execute Package Task
Warning: 0x80019002 at Package: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED.  The Execution method succeeded, but the number of errors raised (3) reached the maximum allowed (2); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
SSIS package "marketing_bonus_dealer_pull.dtsx" finished: Failure.

Any Suggestions?

↧
↧

What is the task priority in SSIS 2008 control flow?

August 9, 2012, 1:56 pm
$
0
0

Hi Team,

I am using SSIS 2008.   I am using 4 processor server.

I am having 12 tasks in my Control flow.  There is no Data Flow task.  All are Execute SQL tasks only.  None of the tasks is having dependency.   Tasks can be executed in any priority.

When I start executing the package, which task will be performed first?

Can I give priority like task 6 should be started first since it takes long time?

Thanks a lot in advance for all the help.

Lakshmi.

↧

Not able to send file Using FTP in SSIS 2005

June 16, 2010, 10:23 am
$
0
0

I am using SSIS 2005

I am trying to send file to ftp server using FTP task in SSIS but i am getting following error.

Error Message-:An error occurred in the requested FTP operation.

Detailed Description-:550 /FileName.txt: Access is denied.

RemotefilePath is /

I need a advice.

Thanks in advance.

↧

web services: vendor security; hidden for each service call

August 9, 2012, 1:37 pm
$
0
0

Techies--

I am converting a wcf client to an ssis package.  In order for any of the methods to be called at the remote vendor's site, security information is embedded (see source).  In my  old wcf client stub, I solve this when I create a new instanc of the service call by dubbing the client credentials into the session. The WSDL only shows the startdatetime, enddatetime -- but really needs the credentials too. I tried to set this up under the connection, but that didn't work. Has anyone solved for this in their travels?

        var api = new RemoteVendorService.RemoteVendorServiceClient();
            // prepare/assign return order list with an object pointer
            List<OrdersByStatus> allorders = new List<OrdersByStatus>();
            // prepare/assign channel list container for orders
            List<OrdersByStatus> ordersubset = new List<OrdersByStatus>();
            var allOrderNumbers = new List<string>();  //contains all possible orders, irrespective of status
            try
            {
                api.ClientCredentials.UserName.UserName = username;
                api.ClientCredentials.UserName.Password = password;
                
                Array allstatus = RemoteVendorService.OrderStatusEnum.GetValues(typeof(OrderStatusEnum));
                foreach (OrderStatusEnum status in allstatus)
                {
                    allOrderNumbers.AddRange(api.OrdersGetByStatus(status, startdatetime, enddatetime));
                }

↧
Search

How does SSIS 2008 Fuzzy Lookup determine similarity?

August 9, 2012, 2:02 pm
$
0
0

I'm trying to do some Fuzzy Lookups and I want to know how SSIS determines similarity.

I start with a string 'Bick'

In my reference table, I have an entry 'Dick'

Since I only have one entry in the table, I want to see how close it thinks Bick is to Dick

I lowered the minimum similarity level to 0 and I still have null matches.

Similarly, I tried it with 'Cong' and 'Chong'

and I can't get them to match.

It seems to work well when the differences are towards the end of the words but when the differences are at the beginning it just doesn't return anything.

↧
↧

Visual studio 2010 Integration Services Project can't deploy to SSISDB

May 23, 2012, 4:39 am
$
0
0

I have Visual studio 2010 Integration Services Project

After I build it, I try to deploy it to SQL Server 2012 and the new SSISDB but I get a very strange error message (and yes I’m sysadmin on the SQL Server and CLRIntegrationEnabled is True on the server and I can run the package from inside Visual studio). I can’t figure out what privilege that is missing.

declare
@p4 bigint
exec
[SSISDB].[catalog].[deploy_project]
@folder_name=N'TripManager',@project_name=N'TripManager',@project_stream=0x504B030414000000080027…A
 lot of numbers…HERE,@operation_id=@p4
output
select
@p4

Msg 6522,Level 16, State 1, Proceduredeploy_project_internal,Line 0

A.NET Framework error occurredduring execution of user-definedroutine or aggregate "deploy_project_internal":

System.ComponentModel.Win32Exception:A required privilege is notheld by the client

System.ComponentModel.Win32Exception:

  at Microsoft.SqlServer.IntegrationServices.Server.ISServerProcess.StartProcess(BooleanbSuspendThread)

  at Microsoft.SqlServer.IntegrationServices.Server.ServerApi.DeployProjectInternal(SqlInt64deployId, SqlInt64 versionId,SqlInt64 projectId,SqlString projectName)


↧

SSIS 2012 Deployment Error

June 25, 2012, 8:24 am
$
0
0

I am attempting to deploy a project to SQL 2012 and receive the security error below.  I have tried the steps listed in this post (http://social.msdn.microsoft.com/Forums/en-US/vstsdb/thread/bd6a985c-0efc-4541-8771-5201ca47f9c8) but it did not resolve the issue.  Any other ideas?  I am server admin and sysadmin on SQL.

-<SummaryReportItem><Message>A .NET Framework error occurred during execution of user-defined routine or aggregate "deploy_project_internal": System.ComponentModel.Win32Exception: A required privilege is not held by the client System.ComponentModel.Win32Exception: at Microsoft.SqlServer.IntegrationServices.Server.ISServerProcess.StartProcess(Boolean bSuspendThread) at Microsoft.SqlServer.IntegrationServices.Server.ServerApi.DeployProjectInternal(SqlInt64 deployId, SqlInt64 versionId, SqlInt64 projectId, SqlString projectName) .</Message><Property>Deploying project</Property><Status>Failure</Status><Value xmlns:a="http://www.w3.org/2001/XMLSchema" i:type="a:string">System.Data.SqlClient.SqlException (0x80131904): A .NET Framework error occurred during execution of user-defined routine or aggregate "deploy_project_internal": System.ComponentModel.Win32Exception: A required privilege is not held by the client System.ComponentModel.Win32Exception: at Microsoft.SqlServer.IntegrationServices.Server.ISServerProcess.StartProcess(Boolean bSuspendThread) at Microsoft.SqlServer.IntegrationServices.Server.ServerApi.DeployProjectInternal(SqlInt64 deployId, SqlInt64 versionId, SqlInt64 projectId, SqlString projectName) . at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection) at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection) at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning() at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj) at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString) at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async) at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result) at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(DbAsyncResult result, String methodName, Boolean sendToPipe) at System.Data.SqlClient.SqlCommand.ExecuteNonQuery() at Microsoft.SqlServer.IntegrationServices.Common.ObjectModel.SqlHelper.ExecuteSQLCommand(SqlStoreConnection storeConnection, CommandType cmdType, String cmdText, SqlParameter[] parameters, ExecuteType execType, Int32 commandTimeout) at Microsoft.SqlServer.Management.IntegrationServices.CatalogFolder.DeployProject(String projectName, Byte[] projectStream) at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeployExportProjectHelper.DeployProject(CatalogFolder folder, Project project) at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeploymentModel.Deploy(CatalogFolder folder, Project project) at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeploymentModel.DeployProject()</Value></SummaryReportItem>

↧

SSIS datatype datetime verification

August 7, 2012, 7:38 am
$
0
0

Hi,

In our ssis project we need to verify the data from input csv file as datetime else we need to set it invalid data.can anyone help me to do that?

Regards

Jon

↧

deploy pkg and Schedule job Error

August 13, 2012, 12:04 am
$
0
0

Hi All

freind i have an issue regarding deployment of SSIS pkg..

when i deploy pkg and Schedule job for this i get error in job ...

TITLE: SSIS Execution Properties
------------------------------

Failed to open package file "C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Packages\updateCentralMovement\syncCRPFromOutlet.dtsx" due to error 0x800C0006 "System error: -2146697210.".  This happens when loading a package and the file cannot be opened or loaded correctly into the XML document. This can be the result of either providing an incorrect file name was specified when calling LoadPackage or the XML file was specified and has an incorrect format.
 ({BDEF0705-305A-4722-AF62-DC841E92655B})

Please suggest Something for this issue...

↧
↧

SSIS tasks properties

August 5, 2012, 10:22 am
$
0
0

Hi,

          Can any one explain me with example for the following features in SSIS.

1)Direction in execute sql task's parameter mapping:What is the use of output,returnvalue?parameter value is only for passing a value to query rignt?

2)parameter size in Execute Sql task's parameter mapping.

3)Force Executionvalue.



↧

Porting data from One Server to Another Server

August 6, 2012, 12:06 am
$
0
0

Hiii

I am Using SSIS 2005, we are Porting data from One server to another server, say 'A' server of 'X' Database contains around 900Gb data of 85 columns, have to port into 'B' server of 'Y' Database, when i Run my Package for first time, it should insert all records(Because of 'New Records' and Destination table should be 'Empty' so), when i run for second Time(Old With New), it should insert only Newly Added Records, if any Modified Records are their In the old Records that should be Insert as a New records, not Updated.

HOW TO ACHIEVE THIS IN SSIS 2005, By Creating PACKAGES with very good performance, Can anyone Please Help Me.

↧
Search

HOW TO READ A ZIP FILE WITH THE SAME NAME FROM MULTIPLE FOLDERS AND UNZIP THEM

August 12, 2012, 1:54 am
$
0
0

Hi, Iam relatively new to bids.Following is the scenario where i need help.

c:\archive has 3 sub folders

c:\archive\1     c:\archive\2        c:\archive\3

1 ,2, and 3(each of them)contains 11  files.  which are  10 zipped rar files(once unzipped  they are .txt files) and a date.txt file

Lets say 10 rar files are like cust.rar,prod.rar,sales.rar...and so on. I only want to consider cust.rar

Cust.rar contains the customer details and date contains the date for which the customer details and

the remaining 9 zipped files correspond to;something like business date.


I have to traverse through each folder and read only cust.rar and date.txt

>then unzip cust.rar

>populate customer table using the information in cust.txt(once its unzipped)

Note: 1: The cust file name ie.cust.rar is same in each folder(1,2,3), same is with date.txt

          2: customer table contains a column called businessdate which should  be taken from date.txt(date.txt corresponds

              to the  business date for that particular cust record)

customer table

cust_id  |  cust_name | cust_address |......  |businessdate

Please let me know whether i've missed to provide any information. Hoping to find some help asap:)

Thanks...

↧

how to assign Varchar(max) to string variable by using Execute Sql Task in SSIS

August 6, 2012, 10:45 am
↧
↧

Data Migration from One Sql Server to Another Sql Server Using SSIS

August 2, 2012, 2:27 am
$
0
0

HI All

Problem

 I have two sql database 2008 with same schema on two different server say server 1 and server 2. I want to move some rows based on some condition from Table A,Table B and Table C of server 1 database to Server 2 Database in same table A,B and C.

Kindly suggest will i do it. It is very urgent

Thanks

Pankaj

↧

Difference between "Redirect rows to no match output" and "Ignore Failure" in Lookup

August 13, 2012, 1:47 am
$
0
0

Hi,

Can someone tell me the difference between "Redirect rows to no match output" and "Ignore Failure" in Lookup Transformation in SSIS? Could you give an example as well?

Thanks

↧

creat *.msi file and run manifest file to create ssis

August 13, 2012, 1:27 am
$
0
0

I have to create folder structure on remote machines for SSIS deployments

\\server\g$\SSIS_Package_Logs\project\Deployment_currentDate

\\server\g$\SSIS_Package_Logs\project\log_currentdate

\\server\g$\SSIS_Package_Logs\project\PackageDependency_currentDate

and need to cut paste enviromnet specfic fils in deployment folder and call SSIS package wizard

I want to do automation to create all folders in that server path above, but I have got a problem of access, even I am not getting command to call SSIS_wizard because windows is not sharing any API, so I can do partial automation to creat folders only

I have no idea about SSIS, what it consist mainly, How can I make *msi and call all deplopyment automatically from *.manifest file

can anyone please share code.........I am not getting this info anywere so I am asking about code

I also have no idea about how to write code in *.Manifest file or call it externally from any VB.net application

I need to do hundreds of deployments per week and fade up of doing it manually

--Himanshu Kulkarni



↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>