Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS Import Using MDX Error

$
0
0

Hello,

I'm trying to write MDX to import data from SSAS into SQL database.

Here's my simple MDX, however I'm getting SSIS Error:

Error Message

[OLE DB Source [23]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E05.
[SSIS.Pipeline] Error: OLE DB Source failed the pre-execute phase and returned error code 0x80040E05.

MDX:selectnonempty{[Measures].[TotalCount]}oncolumns, non empty{([Person].[Email].children)}onrows from [HC]

Also, I'm getting this warning below? 

[OLE DB Source [23]] Warning: The OLE DB Source.Outputs[OLE DB Source Output] references an external data type that cannot be mapped to a Data Flow task data type. The Data Flow task data type DT_WSTR will be used instead.

Do I need to assign nvarchar for both TotalCount & Email?

Any help is appreciated!

 


how ms sql server 2012 or ms sql server 2012 features handles the BIG DATA

$
0
0

Dear all,

i'm newbie at MS SQL Server use, and i wonder does anyone can tell me or maybe give me an article or maybe can show me a quick demo how to handle BIG DATA with MS SQL Server 2012 ?

i have scenario problem like this :

i have to do ETL process from Flat file with csv file type and insert it into DB and create Data Mart from that DB that i have been created. so far, i got the picture and imagine the SSIS package that i will use, but the main issue were the flat files data that i have to Extract and process have minimum size about 100 - 500 GB per-files or it can be split into several files but the size from all that several files were 500 GB. so i imagine, how to handle this files and how the best practice to handle this process using SSIS ? how i handle this process, can i configure the threads manually or by automatically this threads already handle by MS SQL Server 2012 (i read that MS SQL Server 2012 can handle until 1 Pentabyte data right?). or i split the flat files into several data and process it with several package, if yes its a good solution, does anyone can give me a short demo or tutorial how supposed i can do that ? and last issue was, how to handle the error, especially if on the middle of the extract process has error,and it takes a time if the process was started from the beginning once again after the process remark or flag the error flat files.

thank you for the answer and support.

regards,

Bambang

Error when executing a package

$
0
0

When i execute a package in VB.Net Windows Forms Application I receive an error "Error in Microsoft.Dts.SQlServer.Runtime.Package". The package is attempting to configure from XML File <XMLFileName>. Please note that the <XMLFileName> is valid.

The error occurs when LoadPackage line is invoked. I tried supressing the warning. I am not sure how to pass the config file when loading the package. 


Imports Microsoft.SqlServer.Dts.Runtime


Public MustInherit Class SSISExecutePackage

    Public Shared Sub ExecutePackage(ByVal configPath As String)
        Dim pkgLocation As String
        Dim pkg As New Microsoft.SqlServer.Dts.Runtime.Package
        Dim app As New Microsoft.SqlServer.Dts.Runtime.Application
        Dim eventListener As New EventListener()
        Dim pkgResults As Microsoft.SqlServer.Dts.Runtime.DTSExecResult
           pkgLocation = "TestArchive.dtsx"

        pkg.SuppressConfigurationWarnings = True
        Try
            
            pkg = app.LoadPackage(pkgLocation, eventListener)
        Catch ex As Exception
        End Try


        pkgResults = pkg.Execute(Nothing, Nothing, eventListener, Nothing, Nothing)
        MessageBox.Show(pkgResults.ToString())
    End Sub
End Class
Class EventListener
    Inherits Microsoft.SqlServer.Dts.Runtime.DefaultEvents

    Public Overrides Sub OnInformation(ByVal source As Microsoft.SqlServer.Dts.Runtime.DtsObject, _
         ByVal errorCode As Integer, ByVal subComponent As String, ByVal description As String, _
         ByVal helpFile As String, ByVal helpContext As Integer, _
         ByVal idofInterfaceWithError As String, ByRef fireAgain As Boolean)

        ' Add application–specific diagnostics here.
        MessageBox.Show(String.Format("Error in {0}/{1} : {2}", source, subComponent, description))


    End Sub
    Public Overrides Sub OnProgress(ByVal taskHost As Microsoft.SqlServer.Dts.Runtime.TaskHost, ByVal progressDescription As String, ByVal percentComplete As Integer, ByVal progressCountLow As Integer, ByVal progressCountHigh As Integer, ByVal subComponent As String, ByRef fireAgain As Boolean)

        MessageBox.Show(String.Format("Error in {0}/{1} : {2}", progressDescription, percentComplete, progressCountLow))
    End Sub


    Public Overrides Function OnError(ByVal source As Microsoft.SqlServer.Dts.Runtime.DtsObject, _
      ByVal errorCode As Integer, ByVal subComponent As String, ByVal description As String, _
      ByVal helpFile As String, ByVal helpContext As Integer, _
      ByVal idofInterfaceWithError As String) As Boolean

        ' Add application–specific diagnostics here.
        MessageBox.Show(String.Format("Error in {0}/{1} : {2}", source, subComponent, description))
        Return False

    End Function

End Class

regarding ssis

$
0
0

Hi,

How do we set a security to a package?

regarding ssis

$
0
0

Hi,

how do we configure the event handlers in ssis?

Please help me

Issue while trying to access list data in Sharepoint Server from SSIS sharepoint list source

$
0
0

I am using SQL Server 2012. I am facing Issue while trying to access Sharepoint list data from SSIS sharepoint list source.

Can any one help me out to get rid of this issue.My sharepoint data is located in Cloud

Thanks in Advance

I am getting following error

System.ServiceModel.Security.MessageSecurityException: The HTTP request is unauthorized with client authentication scheme 'Ntlm'. The authentication header received from the server was 'Negotiate,NTLM'. ---> System.Net.WebException: The remote server returned an error: (401) Unauthorized.

at System.Net.HttpWebRequest.GetResponse()

at System.ServiceModel.Channels.HttpChannelFactory.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout)

--- End of inner exception stack trace ---

SQL Server 2008 - SharePoint List Destination - Error "The time allotted to this operation may have been a portion of a longer timeout"

$
0
0

Hello,

I am doing an insert into a SharePoint list from a SSIS 2008 package and I am using the SharePoint List Destination add-on from CodePlex. Although all lines are inserted into the list in less than 1 minute I am still getting logged the 60 seconds error message"The time allotted to this operation may have been a portion of a longer timeout". 

I've seen lots of answers but none helps since the time needed for the operation is actually less than 60 seconds. I am also having SharePoint lists where I insert even more lines, the operation takes more than 60 seconds and yet the error message is not thrown.

Any idea about this would be kindly appreciated.

Thanks in advance,

Teddy


Able was I ere I saw Elba

Message :A significant part of sql server process memory has been paged out.

$
0
0

Hi,

        I have a SSIS package, which got failed with the message:"The step did not generate any output.  The return value was unknown.  The process exit code was -1073740940.  The step failed". Since the message was not clear for me, I have started checking the logs, so  , I could see the below message.

        " A significant part of sql server process memory has been paged out. This may result in a performance degradation. Duration: 6070 seconds. Working set (KB): 65960, committed (KB): 300048, memory utilization: 21%.". My system has 25 GB RAM, The following are the other attributes:

1) Page life expectancy is above 20000

2)Memory from sql server property :24574 MB

3)Min server memory :0 MB

4)Max server memory:2147483647 MB

Please let me know that can be the reason


Can't connect to AlwaysOn Availability Group in SSIS

$
0
0

I can't seem to make a connection to an AlwaysOn Availability Group Listener in SSIS when using ADO.NET. My SQL Server is a 3 node cross-subnet cluster. I have set the MultiSubnetFailover to true and increased the timeout to 60 seconds but the connection attempt is returning this error:


Test connection failed because of an error in initializing provider. Connection Timeout Expired.  The timeout period elapsed while attempting to consume the pre-login handshake acknowledgement.  This could be because the pre-login handshake failed or the server was unable to respond back in time.  The duration spent while attempting to connect to this server was - [Pre-Login] initialization=21143; handshake=0; 


I can connect from the same server using Management Studio. I am also able to connect with the OLE DB driver but I want to use ADO.NET to avail of the ApplicationIntent flag.

Integration Services class cannot be found After Deploying the Windows Application

$
0
0

Have an windows application Which is used for Generating The SSIS Package programmatically .

Now Iam installed My Application in One machine Which Not Contain SQLSERVER and Visual Studio .

When iam Generating The Package I Got Below Error 

in installer i Added All the DLL files Which we need to execute the package 

An Integration Services class cannot be found. Make sure that Integration Services is correctly installed on the computer that is running the application.  Also, make sure that the 64-bit version of Integration Services if you are running a 64-bit application. 

We Need To Install this Application Which Does Not Have SQLSERVER 

Can Any One Help me To Resolve This Error . 

Kind Regards 

Rambabu .Sapa

SSIS package fails to start application lock timeout in SSISDB.catalog.create_execution

$
0
0

Hi,

I've recently upgraded my SSIS packages from SQL2005 to SQL2012 and I'm using SQL Agent to execute the pacakges. The jobs are failing about 20% of the time with a timeout error. I ran a trace to see what was causing the problem and the error occurs in the SSISDB.catalog.create_execution procedure when it calls sp_getapplock.

EXEC @lock_result = sp_getapplock
@Resource = 'MS_ISServer_Create_Execution',
@LockTimeOut= 5000,
@LockMode = 'Exclusive'

The timeout occurs in sp_getapplock when it calls sys.xp_userlock, the error number is 27195.

exec @result = sys.xp_userlock 0, @dbid, @DbPrincipal, @Resource, @mode, @owner, @LockTimeout

I have 11 packages that are all executed every minute so I suspect that this is 'causing' the problem. I had no issues when I execute 11 packages concurrently in SQL2005 or SQL2008.

Has anyone run into this problem? Do you have any idea how I can prevent this error other than scheduling the packages to run less frequently?

Note to MS - This is a significant blockingissue preventingus from upgrading to SQL2012 - it should be able to handle executing 11 packages per minute!

I'm running SQL2012 SP1 - 11.0.3000.0 (x64)

Thanks,

Tim

SSIS Handle dynamic File columns

$
0
0

Hi buddies,

I need to create a SSIS Package. This package should handle dynamic columns from flat file.

I need to first validate whether number of columns in each rows matches a standard value(4 say). If it doesn't match, I will error out the file. The file can have 3 or 9 columns and both have to be handled.

I did handled this using script task considering all columns as one column and spilt function. I got a problem in this. I also have text qualifier with delimiter ("). My file can contain data as below cases.

a. "abc","bcd,"

b. abc,"bcd"

c. abc,bcd

I need to handle this scenario also. Any good approach? We can parse each line each character and put in an array. Any other better approach than this?

Thanks in advance,

Paddy


Unable to import from Excel on 64-bit Win 7 workstation to a 32-bit Windows 2003 Server running SQL Server 2008

$
0
0

Hi,

I recently moved from Windows XP to Windows 7 on my primary workstation, and since then I'm unable to import from Excel to SQL from any of my SSIS scripts when I run them Locally.  The one instance I'm running into now is importing from Excel 2010 on my system (64-bit Windows 7) to SQL Server 2008 running on 32-bit Windows Server 2003. 

Microsoft SQL Server 2008 (RTM) - 10.0.1600.22 (Intel X86)   Jul  9 2008 14:43:34   Copyright (c) 1988-2008 Microsoft Corporation  Standard Edition on Windows NT 5.2 <X86> (Build 3790: Service Pack 2)

I even tried creating the import through SSMS and saving it as an SSIS script to get the same results.  The only thing I can think of is the change of architecture on my workstation.  I'm running 64-bit Windows 7 and the server is 32-bit Windows Server 2003 and SQL Server 2008.  Below is the Validation text SSIS returns:

Validation has started
[SSIS.Pipeline] Information: Validation phase is beginning.
Progress: Validating - 0 percent complete
[Source - Sheet1$ [1]] Error: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "SourceConnectionExcel" failed with error code 0xC00F9304.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.
[SSIS.Pipeline] Error: component "Source - Sheet1$" (1) failed validation and returned error code 0xC020801C.
Progress: Validating - 33 percent complete
[SSIS.Pipeline] Error: One or more component failed validation.
Error: There were errors during task validation.
Validation is completed

Any suggestions on how to get around this?  I'm not seeing any errors in SQL Server itself, so I'm not sure what to try next.  There are no errors reported in SQL Server or Windows.

Also note, I set Delay Validation to True and still got the same error.  Also the file isn't open and I even created a new Spreadsheet and copied the text minus the formatting from the old to the new spreadsheet and I'm getting the same results.


Thanks --

Sam Alex

 

 

SSIS2012: RunId variable "Failed to lock" at runtime - BOMBS 0xC0010001

$
0
0

Searching the CODE for the entire stand-alone package revealed ZERO occurrences of the variable "RunID" cited in the following FAILURE message:

tsql BEGIN TRAN 3:Error: Failed to lock variable "RunId" for read access with error 0xC0010001 "The variable cannot be found. This occurs when an attempt is made to retrieve a variable from the Variables collection on a container during execution of the package, and the variable is not there. The variable name may have changed or the variable is not being created.".

I've found several posts citing "RunID", many of which are simply the name of a column returned from a user query, but there are some that contain the same message as above.  However, aside from one saying "did you change the package" that is marked as an answer (how?) there is no help for this problem.

Please help as this package runs every 15 minutes, is crucial to the business, and I cannot tell from this what to do or where the package logic was up to (a for-each loop on around 200 items).

Thanks in hopes...


SQL Task Successful but does not move to the next task even after evaluating expression.

$
0
0

Hello everyone:

I am trying to run a particular task only when there are available records in a table.


I have a Task containing a simple SQL Statement, like this:

SELECT COUNT(UserID) AS RecordCount
FROM  CX.Tracking
WHERE TrackingDate > DATEADD(MI, - 1, GETDATE())


I created a local variable with Scope of Project as follows and here is the rest of the setup:



The task runs fine but it does not got to the next task.

Can someone please tell me why or provide me some explanation to fix this?

Thank my friends.



INSERT failed because the following SET options have incorrect settings: 'ARITHABORT'

$
0
0

I have an SSIS package and scheduled it to run everyday thru SQL Server Agent Job.  Yesterday, we added indices to the tables which caused the job to fail.   The error message was "INSERT failed because the following SET options have incorrect settings: 'ARITHABORT'".

I need to add a statement, "SET ARITHABORT ON", so I added an execute SQL task.  However, it did not work.

I do not know where I can insert the above statement in the SSIS pacakge.  So I deleted the indices and ran the SSIS successfully today.

If you know exactly what to do with an SSIS package where to add "SET ARITHABORT ON", please let me know.

Data Conversion Error - How to Fix this?

$
0
0

Hi All,

I have a Excel source and a OLEDB destination. I am trying to upload data to a table. I get the following error.

[Excel Source [306]] Error: There was an error with output column "Open" (346) on output "Excel Source Output" (314). The column status returned was: "The value could not be converted because of a potential loss of data.".

When I check on the Excel source advance editor input and output properties section the open column has a double-precision float [DT_R8] for the external columns and output columns. 

Still I get the above error. Some sample data for open column is

20.38,blankcolumn,  6.6,6.5.

Any idea why this is happening?

Thanks

Lucki

Dynamic SQL to Excel

$
0
0

I have a dynamic SQL query that runs in a stored procedure. The resulting data has a variable number of columns. It could be 14 or it could be 50, or anything in between.

I need to get this data saved to excel. Is there a way to do this within SSIS? I've seen other posts referencing the use of Cozyroc SSIS+ but before I go that route, I thought I'd post a new thread.

Thanks


Lefka


Loading from CSV file to Sqlserver Table

$
0
0

Hi all,

Recently our source system has changed the file structure of CSV files . After the change we are now receiving the feed with huge size of a single CSV file of having 5 GB. We have a basic validations up on the data in feed for checking the data type of the columns and converting all columns from nonunicode to Unicode DataType . These tasks are shown in the below snapshot.

Pacakge tasks

Due to the transformations and because of reading the data from single CSV file the loading of data from that CSV file is taking nearly 4:30 hours  to get the data in to a SQL table . But this load time is very bad. So i want all your valuable suggestions on how to speedUp the loading process from the CSV files . 

1) Any configuration we need to do in SSIS side to sped up the process ? 

2) Will process would be faster if you divide the single large file into multiple files  and  load the data parallelly  to the Sql table .?

3) Will process be faster  if I , load the data directly from CSV file in to Sql table using BCP and doing all the tasks like data type checking , converting the datatypes in SqlServer  ?. I think this is one of the bad option to pick.

I am waiting for all your valuable suggestions and please suggest me if any other option is available .

How to Troubleshoot SSIS package in SQL Server Agent

$
0
0

I have a SSIS package running in SQL server agent that intermittently fails with the following laconic message:
Message
Executed as user: Fxxxx\srv_xxxx. The step failed.

If I restart the job no error occurs.

In order to troubleshoot I have

1. Enabled verbose job step logging to file on the job step to file.

2. Enabled execution tracing in SQL server Agent to the errorlog.

3. Enabled logging of error and failure in the package to sysssislog table.

4. Enabled logging to jobsteplog (EXEC msdb.dbo.sp_help_jobsteplog)

Nothing gets written there.

Does anybody have any tip how I can troubleshoot this?

/m

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>