Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Data Profile Viewer

June 24, 2008, 10:01 am
$
0
0

Two weeks ago our CIO laughed at the idea of purchasing SQL Server 2008 any time in the next 16 months. He was thinking budget, but my concern is, like many IT shops, we're still migrating from 2000 to 2005 (mostly waiting on vendor certification, infrastructure upgrade funding).

 

After installing 2008 RC0 and showing off the new Data Profiler Task, I've almost got the CIO hooked! But interest is fading fast since we can't figure out how to get Data Profile Viewer to function on his workstation without installing SQL Server 2008.

 

Since output is XML, there should be other ways to display it for those who don't have SQL Server 2008...  Meanwhile, I'm waiting for feedback from the setup/install forum as to if/how the viewer can be installed as a true standalone tool. No responses yet...

 

Note: I posted this in Manageability and Tools forum, but Buck Woody pointed me to SSIS forum. Don't know why I didn't try SSIS forum first...
↧
Search

The cryptic error - element cannot be found in a collection ?

February 24, 2014, 6:01 pm
$
0
0

I have encountered this error in the script task a few times. The causes are - Variable is present in code,  but not added to task list OR, you try to create a DataColumn with the wrong column name, OR the variable in the task list has been deleted. When you make such mistakes, you get the cryptic error - 

Error: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. 
---> Microsoft.SqlServer.Dts.Runtime.DtsRuntimeException: The element cannot be found in a collection. This error happens when you try to retrieve an element from a collection on a container during execution of the package and the element is not there.
 ---> System.Runtime.InteropServices.COMException (0xC0010009): The element cannot be found in a collection. This error happens when you try to retrieve an element from a collection on a container during execution of the package and the element is not there.

How do I guess the EXACT source of the problem from this cryptic error message ?

I am sure that I am a beginner compared to the developers who made SSIS. But, what amazes me is that they could not even show which element was missing ? As a result, the developer has to look at all the variables in his code and see if they are in the list. Is this error so cryptic in even SSIS 2012 ? This should not have been too hard for the highly paid programmers to figure out.



↧
↧

Passing multidimensional list values between script and foreach tasks (vb.net)

February 17, 2014, 11:05 am
$
0
0

I would like to capture a "Filename" and "Filetype" into a multidimensional list. I'm currently doing so in a foreach loop. I'd like to know 1 how can i verify the contents of the multidimensional list and 2 pass it between script tasks. I can currently do so with a single dimension array but the addition of another dimension has not worked. Code below.

Script Task 1 Code:

        Dim Dir As New IO.DirectoryInfo("H:\003 - Internal Reports\")
        Dim Dir1 As IO.FileInfo() = Dir.GetFiles()
        Dim File As IO.FileInfo
        Dim FileList As New List(Of String)
        Dim FileListVer As New List(Of String)
        Dim FileListSSIS As New List(Of List(Of String))
        Dim fmt As String = "00"
        Dim i As Integer
        Dim Today As Date = DateTime.Today
        Dim batchFile As String = "H:\003 - Internal Reports\textfile.txt"
        Dim sGUID As String
        For Each FileName In FileList
            Dim FileNameSearch As String
            i = 0
            For Each FileNameSearch In FileListVer
                If FileNameSearch Like FileName.Substring(0, FileName.Length - 4) & "*#.txt" And FileNameSearch.Length = FileName.Length + 12 Then
                    i = i + 1
                End If
            Next
            i = i + 1

            Dim NewFileName As String = FileName.Substring(0, FileName.Length - 4) & "_" & Today.ToString("yyyyMMdd") & "_" & i.ToString(fmt) & ".txt"
            Dim NewFilePath As String = "H:\003 - Internal Reports\"
            Dim objWriter As New System.IO.StreamWriter(batchFile, True)

            For Each File In Dir1
                If File.Name Like FileName Then
                    File.MoveTo(NewFilePath & NewFileName)
                    objWriter.WriteLine(NewFileName)

                    FileListSSIS.Add(New List(Of String))
                    FileListSSIS.Add(New List(Of String))
                    FileListSSIS(0).Add(NewFileName)
                    FileListSSIS(0).Add(FileName)
                    
                End If
            Next

            objWriter.Close()
        Next

        Dim FileNameNew As ArrayList = New ArrayList(FileListSSIS)
        Dts.Variables("FileArray").Value = FileNameNew

This goes into a Foreach Loop Task with the enumerator set to "Foreach FromVariable Enumerator". I also have 2 variable mappings set for the contents that im expecting from the multidimensional array, but this seems to be where it fails. Thanks in advance. 


↧

SSIS - Fuzzy Lookup fails with the following error on SQL 2008 R2/SSIS 2012

February 24, 2014, 8:45 pm
$
0
0

Hello all,

I m start new work on ssis.I face a problem but i m not sure what i need to do solve this problem. can u please help me to out of this .

I have 2 table on a database i need to compare there all data.I have 51 column in both table but i need to cheek compare 18 column to make report on it.I create package that time its not show any error but when i run the package then its show

(SSIS.Pipeline] Error: Fuzzy Lookup failed the pre-execute phase and returned error code 0x8007007A.)

I make another package but there i not face any problem that package on 8 column.

can anyone told me how i solve this error or is there any way to compare data on ssis.

Thanks for help

Muzahid

↧

IS possible to extract data from email body using ssis?

February 17, 2014, 3:04 pm
$
0
0

IS possible to extract data from email body using ssis?

the email come with a display table

CRISTINA&amp MICROSOFT Forum

↧
↧

invalid access to memory location

February 17, 2014, 4:27 pm
$
0
0

Hi,

I have an SSIS package which connects to Oracle DB. When i run this package from development server SQL SERVER AGENT, the package runs fine, but when i run the same package from Production Server, i get the following error.

"

. Microsoft (R) SQL Server Execute Package Utility  Version 10.50.4000.0 for 32-bit  Copyright (C) Microsoft Corporation 2010. All rights reserved.    Started:  4:01:17 PM  Error: 2014-02-16 16:01:18.25     Code: 0xC0202009    Source: Package12 Connection manager "X"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x800703E6.  An OLE DB record is available.  Source: "Microsoft OLE DB Service Components"  Hresult: 0x800703E6  Description: "Invalid access to memory location.".  End Error  Error: 2014-02-16 16:01:18.25     Code: 0xC020801C     Source: Data Flow Task OLE DB Source [1]    Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "X" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.  End Error  Error: 2014-02-16 16:01:18.25     Code: 0xC0047017     Source: Data Flow Task SSIS.Pipeline     Description: component "OLE DB Source" (1) failed validation and returned error code 0xC020801C.  End Error  Error: 2014-02-16 16:01:18.25     Code: 0xC004700C     Source: Data Flow Task SSIS.Pipeline     Description: One or more component failed validation.  End Error  Error: 2014-02-16 16:01:18.25     Code: 0xC0024107     Source: Data Flow Task      Description: There were errors during task validation.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  4:01:17 PM  Finished: 4:01:18 PM  Elapsed:  1.045 seconds.  The package execution failed.  The step failed.

"

We have tried to reboot the server after installing INSTANT CLIENT FOR ORACLE, but to no avail. Also i am running the package in 32-bit mode.

Could someone suggest what might be the issue?


↧

reading excel which contains the mapping columns of 2 different DBs & migrate it using SSIS

February 21, 2014, 2:02 am
$
0
0

hi, i m new into SSIS, we have a requirement, in which I need to migrated data from 20 different DB into single universal DB.
20 different DBs have different structure. So we have a excel containing the mapping columns for all these 20 DBs tables.
So can anyone help me out how to read excel, fetch the mapping columns and do the migration using SSIS.

Thanks in advance

↧

Integration Services - Header and Footer

July 2, 2007, 2:51 pm
$
0
0

I have been struggling to get this right in Integration Services, Would really appreciate the help.

 

Basically I have a file with fixed length columns that I would like to import into my database using Integration Services, the file looks something like this

 

AN_HeaderRecord0001Testfile.txt

MyName    MySurname      0127721506

MyName2  MySurname2     0127722322

FooterRec0000000004_02

 

What I need to find out is how do I import the data, the name and surname and telephone no, but skip the header and footer records. Also I need to be able to use the header and footer data for later use.

 

Any ideas ?
↧
Search

Trigger SSIS From C# Encounter Connection Problem.

February 24, 2014, 9:52 pm
$
0
0

Hi!I want to trigger SSIS from C# web applicatoin but encounter Connection problem. Is there anything missing in my configuration ? 

My environment is Visual Studio 2010.

C# Code Snippet

 protected void Button1_Click1(object sender, EventArgs e)
    {
        ..skip..
		var myApplication = new Microsoft.SqlServer.Dts.Runtime.Application();
        Package myPackage = myApplication.LoadPackage("E:\\WorkingArea\\TEST_NET_CALL\\Package.dtsx", null);
        DTSExecResult myResult = myPackage.Execute();
		..skip..
	}

SSIS : developed in 2012 version, 32bit, only with simple Data Flow Task, using Connection Manager. can correctly run in SSIS development stage.

Trigger error
Loading package from file system.Executing packageThe connection "{E9CF1B09-0E84-4FDB-B5CF-DDD2E0080E58}" is not found. 
This error is thrown by Connections collection when the specific connection element is not found.
Cannot find the connection manager with ID "{E9CF1B09-0E84-4FDB-B5CF-DDD2E0080E58}" in the connection manager collection due to error code 0xC0010009. 
That connection manager is needed by "OLE DB Destination.Connections[OleDbConnection]" in the connection manager collection of "OLE DB Destination". 
Verify that a connection manager in the connection manager collection, Connections, has been created with that ID.
OLE DB Destination failed validation and returned error code 0xC004800B. 
One or more component failed validation. 
There were errors during task validation. 
Package result: Failure

SSIS conmgr file contains

<?xml version="1.0"?><DTS:ConnectionManager xmlns:DTS="www.microsoft.com/SqlServer/Dts"
  DTS:ObjectName="NCTEST"
  DTS:DTSID="{E9CF1B09-0E84-4FDB-B5CF-DDD2E0080E58}"
  DTS:CreationName="OLEDB"><DTS:ObjectData><DTS:ConnectionManager
      DTS:ConnectionString="Data Source=DEVDB;User ID=nick_go;Initial Catalog=NCTEST;Provider=SQLNCLI11.1;Auto Translate=False;"><DTS:Password
        DTS:Name="Password"
        Sensitive="1">AQAAANCMnd8BFdERjHoAwE...(skip)</DTS:Password></DTS:ConnectionManager></DTS:ObjectData></DTS:ConnectionManager>


↧
↧

Automatic documentation of SSIS packages from SQL Server Data tools 2012 (VS2012)

February 20, 2014, 1:52 pm
$
0
0

HI

I need to document my SSIS packages and an Architect at the place I am working claims there is a way to do this natively in SQL Server Data Tools (Visual Studio) is he correct, and I just can't find it or is he deluded?

Andy help much appreciated

Regards

Andy

CRM 4, SQL Server and .Net developer using C#

↧

Process SSAS cube - Processing settings in ssis script task-AMO command

February 24, 2014, 11:35 pm
$
0
0

Hi,

I have the requirement to add the logic of SSAS cube processing setting in AMO commands(script task in ssis)while processing the cube.Code is built for processing the cube with options(full,data etc).

I am looking forward to get the script for implementing 2 of the processing setting.

1)Processing options

2)Dimension key errors

I have all the required configuration for above settings saved in a table.I just want to utilise them in script task while processing the cube.

↧

how to load two flat files data into single sqlserver table?

February 24, 2014, 11:25 pm
$
0
0

Hi All,

I have requirement like,I have two falt files which contains one column each.Now I have to load the files data into sqlserver table which should contains two columns.

Ex:FlatFile1-->SID

FaltFile2-->SName

Table-->SID  SName

Table should contain two columns as shown above without Null values.

Can some one help me on this ASAp,Since it was urgent task for me.

Regards,

Sudha

sudha

↧

SSIS-Execute Process task Error in 2012 version _File/Process "\\Servername\Foldername\batfile.bat" is not in path

February 20, 2014, 11:04 pm
$
0
0

Hi Sir,

I have develop the SSIS Package in 2012 version and i am calling the SSIS Package using Stored Procedure according to my requirement and that stored procedure will be using in my SSRS report Datasource.

once after the SSIS Pacakge has design and develop and deploy into the server as Project Deployment model..when i run the ssis Package ,calling through the SP it is working fine...

even when i design a SSRS report  using SSDT(sql server data tools),  in the SSRS reprot calling the above SP in Dataset.when i execute the SSRS report it is wroking fine...

once SSRS report has been deployed into the  remote Server.. when i Execute the SSRS report i am getting the below Error message:

SSIS-Execute Process task Error  _File/Process "\\Servername\Foldername\batfile.bat" is not in path

belo is the SP for calling the SSIS package.

DECLARE @EXECUTION_ID BIGINT,
        @PKG_RESULT INT
EXEC [SSISDB].[CATALOG].[CREATE_EXECUTION] @PACKAGE_NAME=N'abc.DTSX',
                                           @EXECUTION_ID=@EXECUTION_ID OUTPUT,
                                           @FOLDER_NAME=N'aa',
                                           @PROJECT_NAME=N'xxx',
                                           @USE32BITRUNTIME=FALSE,
                                           @REFERENCE_ID=29 --unique identifier for environment

EXEC [SSISDB].[CATALOG].[START_EXECUTION] @EXECUTION_ID

↧
↧

Linking QuickBooks to SSIS

February 25, 2014, 2:53 am
$
0
0

I managed to download the QuickBooks Data Provider and QuickBooks SSIS Component which allowed me to create an ADO NET Source linked to a OLE DB Destination in SSIS.

I am relatively new to SSIS so have a few questions at this stage:

- If I want to import a new table in the ADO NET Source I then seem to have to delete the existing OLE DB Destination. Is this correct or is there a workaround for example if say someone is importing multiple tables linked to multiple destinations (in my case SQL Server 2008 R2 Developer)?

- If data is updated in SQL Server can/should it be reciprocated/viewed in QuickBooks? I am not sure what the protocol is here in terms of what is right or wrong.

- Is there a free alternative to RssBus http://www.rssbus.com/ado/quickbooks/screenshots.aspx as I only have a trial version?

N.B. I followed these instructions but using ADO NET Source in SSIS as there is no DataReader Source in BIDS 2008 R2:http://www.rssbus.com/kb/articles/ado-ssistask.rst

Many Thanks for any advice.

↧

Support for xlsx File Format ?

February 25, 2014, 3:19 am
$
0
0
Also, having installed MS SQL Server 2008 / Visual Studio 2008 - when will there be support /is there support for Excel files with xlsx extenstions?
↧
Search

How to control which Configuration File a package Opens with in MS Visual Studio 2008 ?

February 25, 2014, 3:14 am
$
0
0

When running our jobs, I know which Configuration File is being used, as it's specified in the path.

But when opening SSIS Jobs in MS Visual Studio, lets say there is four different Config files.

How do you control which one is used when you are working with the job in Visual Studio?

For example in the above screen, you can 'Add' or 'Edit' or 'Remove' Configurations but you can seem to say
"Reload this package with x Configuration", or "Select this particular one at the moment" for instance?

↧

Execute SSIS Package from JOB which contains Execute Process Task calling a .bat file

February 25, 2014, 4:28 am
$
0
0

Hi All,

I have a EXCEL Macro needs to be called from SSIS. We could not use Script task because of some internal reason.

So we have taken an approach to call a .BAT file using Execute Process Task. This .BAT file will call a .VBS file which will execute the EXCEL Macro.

The SSIS Package is running good if I execute the package from BIDS.

But the real problem is with the scheduling this SSIS Package using SQL JOB.

If i execute this SSIS package from SQL Server Job, its executing the whole package successfully except the Execute Process Task.

So the overall issue is SQL Server Job is not executing properly if I call any .BAT file from the SSIS Package.

Please give me suggestion to get rid of the issue. Thanks in advance.

↧
↧

ETL Master SQL job got a “Login Time Out “ error again

December 27, 2013, 3:34 am
$
0
0

Below error coming randomly Sometimes it works perfectly fine and sometimes it goes down with following error message. The connectivity between two servers are seamless there is not a single drop of packet.

Please suggest what is wrong happening here. One server is on Windows 2003 x64 and another is on Windows 2008 R 2.

Executed as user: xyz\user1. Microsoft (R) SQL Server Execute Package Utility  Version 11.0.3393.0 for 64-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  12:00:07 AM  Error: 2013-12-27 01:01:57.58     Code: 0xC0202009     Source:DailySync_I Connection manager "OLE_SRC2_"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description:"Login timeout expired".  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "Unable to complete login process due to delay in login response".  An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "TCP Provider: Timeout error [258]. ".  End Error  Error: 2013-12-27 01:01:58.58     Code: 0xC020801C     Source: Load Lookup Tables OLE DB Source [699]     Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "OLE_SRC2_" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.  End Error  Error: 2013-12-27 01:01:59.67     Code: 0xC0047017     Source: Load Lookup Tables SSIS.Pipeline     Description: OLE DB Source failed validation and returned error code 0xC020801C.  End Error  Error: 2013-12-27 01:02:00.81     Code: 0xC004700C     Source: Load Lookup Tables SSIS.Pipeline     Description: One or more component failed validation.  End Error  Error: 2013-12-27 01:02:01.95     Code: 0xC0024107     Source: Load Lookup Tables      Description: There were errors during task validation.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  12:00:07 AM  Finished: 1:20:13 AM  Elapsed:  4805.61 seconds.  The package execution failed.

↧

Script component as flat file source with expression for connection manager

February 25, 2014, 4:44 am
$
0
0

Env - SQL Server 2012

Inside ForEachLoop container with Foreach File Enumerator, I am assigning FullyQualified file path to a variable.

In a dataflow that executes on every loop, has script task as Source to parse flat file.

Script component is accessing file via file connection manager which has a expression for ConnectionString as variable (that's FullyQualified path from ForEachLoop)

File connection manger - Delay Validation is set True

http://microsoft-ssis.blogspot.com/2011/02/script-component-as-source.html

Issue:

.dtsx package executes with no issue and extracts all files in ForEachLoop if initial variable value (default) is set with some valid path. First loop executes from variable default value and then continues with ForEachLoop's current file.

If variable value is empty, script component fails with "Empty path name is not legal"

But variable is assigned with correct fully qualified file path, validated by verifying in Locals by adding Breakpoint.

As per my understanding the issue, on first ForEachContainer loop file connection manager's connection string expression is not assigning value from variable (FullyQualified file path from ForEachLoop).

Any suggestions appreciated!

Hope I explained well. Please reply if more details needed.


↧

Execute Process Task :Executing DOS Command lines in Execute Process Task

February 25, 2014, 1:45 pm
$
0
0

Hi All,

I am trying to sftp files using Tectia Client from my local system. For that I have used the Execute Process Task in SSIS. First I open DOS command and try to instantiate the sftp3.exe.

Then I write down the below command

binary
open username@hostname
lcd C:\Test
cd <Destination Path name>

put test.txt

How to execute the command in execute process task ?

help is appreciated

Thanks

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>