Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

MSORA and MSTERA data sources missing in Visual Studio 2012 / SQL Server 2014

February 9, 2015, 10:22 am
$
0
0

Hi,

I'm building a brand new SQL Server 2014 environment to migrate existing production to. It's a fresh build with the detailed component versions shown at the end of this post. The problem that I am running into is that in an SSIS project, Visual Studio does not show the MSORA and MSTERA connection managers. Similarly, there is no sign of the Attuninty data sources.

I've tested the Oracle and Teradata clients and I'm pretty certain that they're installed correctly.  Going into the registry, I can see both the 64- and 32-bit entries for Oracle Home under HKLM\Software. For Attunity, I/m using the 3.0 adapters and I can see the expected 64- and 32-bit entries under HKLM\Software for software settings and registrations.    

I should mention that we are actively developing software on SQL Server 2008 and 2012 servers that use the Attunity Oracle and Teradata adapters for SSIS. No interoperability problems with those earlier versions.  I'm wondering if the issue might be with Visual Studio or SSIS.  Has anyone run into anything similar?

Build info:

OS Windows Server 2012 R2 Standard.  Includes KB2919355 - Windows Server 2012R2 Update

SQL Server 2014 - 12.0.2342.0 (X64) CU1

Oracle 11gR2 Clients - 64 & 32-bit

Teradata CLIv2 nt-x8664 14.10               
Teradata Data Connector nt-x8664 14.10      
Teradata GSS Client nt-x8664  14.10        
Teradata OLE DB Access Module nt-x8664 14.10    

Microsoft Visual Studio 2012 Shell (Integrated)
    Version 11.0.50727.1 RTMREL
    Microsoft .NET Framework
    Version 4.5.51641

    Installed Version: IDE Standard

    Microsoft Visual Studio Tools for Applications 2012   04932-004-0017006-02028
    Microsoft Visual Studio Tools for Applications 2012

    Visual Basic 2012   04932-004-0017006-02028
    Microsoft Visual Basic 2012

    Visual C# 2012   04932-004-0017006-02028
    Microsoft Visual C# 2012

    SQL Server Analysis Services   
    Microsoft SQL Server Analysis Services Designer
    Version 11.0.3436.0

    SQL Server Data Tools   11.1.41025.0
    Microsoft SQL Server Data Tools

    SQL Server Integration Services   
    Microsoft SQL Server Integration Services Designer
    Version 11.0.3436.0

    SQL Server Reporting Services   
    Microsoft SQL Server Reporting Services Designers
    Version 11.0.3436.0

↧
Search

String Problem in a Script

February 17, 2015, 1:45 pm
$
0
0

Hello!

I'm not sure if this is the right forum or not. The problem is happening in SSIS, a script task, but the issue seems to be with the C code in the script.

Here's whatI have;

I get daily reports in Excel. These reports are membership data and are imported into SQL tables. Part of the report is the date it was run. The date is extracted from the filename and included in the data under the column name, "Load_Date."

This SSIS package - with the script that is now causing problems - has been running fine for about a year. But, I'm trying to apply this same package to a new database and membership group. It's all mostly the same thing, except for the name of the Excel file.

The original file names were "Daily Membership YYYYMMDD.xls", where - obviously - YYYY is the year, MM the month and DD the day. Sometimes, if the vendor is slow, I'd get several days' worth of reports in one dump and there is also the weekend. So, I had a loop set up to use the date part of the file name, change it to a date and use that to run the loop from oldest Excel file to newest. I couldn't use the creation dates, because they may not have been processed at their end in the right order.

So, anyway, I used a template, "Daily Membership *.xls", to define which files to grab, and used a Substring routine to strip the date part from the name for conversion to a date. This worked fine and dandy until I tried to apply it to this new set of files.

The new files are named in a similar fashion, but with an important change. Rather than, "Daily Membership YYYYMMDD.xls", they are named, "Daily Membership YYYY.MM.DD.xlsx". Accordingly, I changed the template to, "Daily Membership *.xlsx". But, I'm getting an error;

Error: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.FormatException: String was not recognized as a valid DateTime.
   at System.DateTimeParse.ParseExact(String s, String format, DateTimeFormatInfo dtfi, DateTimeStyles style)

There are two possible explanations I'm thinking of. One, I can't change, the other involves some sort of string manipulation, I'm hoping.

The first possible explanation is that the original membership files were stored locally on my desktop box. So, the path was C:. However, these newer ones are stored on a network drive. I've tried the full path and the mapped drive letter, but get the same error. So, I wondered if, somehow, being on a network is maybe causing a problem.

The other explanation is the format of the filename. To get just the filename and not the extension, I use;

System.IO.Path.GetFileNameWithoutExtension(file)

I'm thinking, maybe the SSIS script is thinking that the extension of the file starts with the first period, and not what follows the last period. If that's the case, I'm hoping that there is a simple, "System.IO.Path.GetFileName" that I can use and simply add more substring manipulation to get the fields I want, but I don't know.

Anyway, after all this, here's the code from the script, modified to cull the date from the filename, but leave off the periods;

public void Main()
{
    // TODO: Add your code here
    string[] files = System.IO.Directory.GetFiles(@"N:\My Documents\Projects\Reports\To Be Processed\", "Daily Report *.xlsx");
    string oldestFileName = string.Empty;
    DateTime oldestDate = DateTime.MaxValue;
    foreach (string file in files)
    {
        string fileNameWithoutExtension = System.IO.Path.GetFileNameWithoutExtension(file);
        string datepart = fileNameWithoutExtension.Substring(fileNameWithoutExtension.Length - 10);
        string convdate = datepart.Substring(1, 4) + datepart.Substring(6, 2) + datepart.Substring(9, 2);
        DateTime dt = DateTime.ParseExact(convdate, "yyyyMMdd", System.Globalization.CultureInfo.InvariantCulture);
        if (dt < oldestDate)
        {
            oldestFileName = file;
            oldestDate = dt;
        }
    }

    Dts.Variables["User::RptFileName"].Value = oldestFileName;
    Dts.TaskResult = (int)ScriptResults.Success;
}

All I did was add the "string convdate =" part to concatenate the parts of the date into a string that would match the template in the ParseExact bit and change the length in the "string datepart =" from 8 to 10.

It looks to me like it should work, but it doesn't manage to get a date out of what it's creating. All I can think of is that the extra periods in the filename are screwing things up - or, that it's a network file, but I don't put much confidence in that.

Any thoughts?

↧
↧

Some users can't open DTS Packages

February 17, 2015, 6:48 am
$
0
0

Hi

I have installed SQL Server 2008R2 on Windows Server 2008R2.  When I installed SQL Server I installed the options that allow the designing/running of DTS Packages.  I am able to open/design/run these packages OK but some of my colleagues are not able to open the packages.

They are set up as domain/sys admins on the Windows/SQL server and log onto that server directly to manage the DTS packages.  When they attempt to open them they get the attached error message.

Do I need to install something under their user account in order for them to be able to open DTS Packages?

Many thanks

↧

Migrate/Upgrade [SSIS Configurations] table 2005 to SSISDB Catalog in 2012

February 17, 2015, 2:13 pm
$
0
0

Hi Everyone,

Our SSIS are still in 2005 and we are using the SSIS Configurations table to store our parameters. Our set-up is based from this link .

Now, we are moving to SSIS 2012 and wanted to maximize the SSISDB Catalog. 

I just want to know how can we migrate this existing SSIS Configurations  table to the new SSISDB Catalog to minimize the impact.

Also, if you guys could provide a detailed steps that would be awesome.

Many thanks.


↧

Parent and child Packages.

February 17, 2015, 9:16 pm
$
0
0

Hi Gurus,

I have 15 child packages calling from master package.

i created 3 sequence container and kept 5 child packages in each container. Packages are running fine when i ran the all packages individually and individual sequence container. But when i ran the whole master package getting error .

Could you please help me here by giving the best approach.

↧
↧

How to display null in excel destination by using SSIS?

June 10, 2012, 9:55 am
$
0
0

Hi Friends,

I have OLEDB as source and excel as destination.As per requirement when ever there is NULL in source the same has to be to displayed in excel destination.But  i am getting blank space instead of NULL.Can any one suggest me on this how to do?

Thanks,

Lakshmi

↧

using parameters in different connections

February 15, 2015, 8:09 pm
$
0
0
I'm struggling to accomplish a task , I have a package with two connections, one oledb (for a local sqlserver base) and a ado.net ( to a remote mysql base) , need to extract the data from mysql base and insert into sql server base .
the number of records is somewhere around 1 million records , then delete everything and bring it all is not a solution .
I've been researching and I think something like save the result of a query ( held in sql server base , for example a " select max (id ) from table ) and send as parameter (" select * from table where id > PARAMETER " ) would be a solution.
Someone can help me with material or an example?

thank you
↧

parallel processing of data from single source table to single Destination table

February 7, 2015, 10:40 pm
$
0
0

Hi,

I want to process multiple ID same time and insert and update in single destination table, but I get deadlock problem.

What is the best practices of parallel processing?

Regards,

Manish

↧
Search

delete sub folders

February 17, 2015, 9:41 pm
$
0
0

I have source folder with Name A, under A there is subfolder B and under subfolder B there is subfolder C and under subfolder C there is subfolder D and under SubFolders I have files 1.txt, 2.txt and 3.txt.

I need to delete SubFolders B and C then move to D directly

So Source is A--------->B----------->C------------->D------------------> 1.txt, 2.txt, 3.txt

Target should look like A--------------------->D------------->1.txt, 2.txt, 3.txt

how do we achieve this using SSIS.

THanks.

↧
↧

Finding out the dll reference behind an SSIS Toolbox Item in SSDT 2012

February 5, 2015, 12:37 pm
$
0
0

This might be a stupid question but I can't seem to figure out how to see what dll an SSIS toolbox item in SSDT 2012 is referencing. Is there someway to see this information? When I go to the Choose Toolbox Item Menu I don't see anything about SSIS so I'm assuming the option is strictly for the non-SSIS Toolbox. The reason i'm trying to figure this out is we have some add-ins on the computer I got for work and I want to know if these are new, native SSIS toolbox items or if they are by virtue of the add ins that were purchased.

Any assistance with this would be greatly appreciated.

↧

How to merge/replace data in a table when importing new data from csv

February 18, 2015, 7:43 am
$
0
0

I have a late breaking change request from a customer where I created a basic routine to import data from a csv file into a table.  They now want the ability to "update" data via the csv import.  Meaning if the first 2 columns in the record from the csv match a row in the table, delete that row in the table and replace with the row from the csv file.  It is literally a 3 column file/table. 


CREATE TABLE [dbo].[Profile_Actuals](
[Date] [datetime] NULL,
[Profile] [varchar](4) NULL,
[Value] [real] NULL
)
GO


↧

It is already opened exclusively by another user, or you need permission to view its data

February 18, 2015, 6:20 am
$
0
0

Hello Friend,

I have an ssis package that gets excel file from network shared path and load it to datamart.It was working fine,but now it does not work,and gives me below error.I am sure that nobody uses this file.but it says someone use it,and the user has Access the folder which the file is located.I am using VS2008 in order to run the package.

Thanks in advance.

TITLE: Package Validation Error
------------------------------

Package Validation Error

------------------------------
ADDITIONAL INFORMATION:

Error at XXXXXXX [Excel Source [1]]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "XXXXXXX" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

Error at XXXXXXX [SSIS.Pipeline]: component "Excel Source" (1) failed validation and returned error code 0xC020801C.

Error at XXXXXXX [SSIS.Pipeline]: One or more component failed validation.

Error at XXXXXXX: There were errors during task validation.

Error at YYYYYYYY [Connection manager "XXXXXXX"]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft JET Database Engine"  Hresult: 0x80004005  Description: "The Microsoft Jet database engine cannot open the file ''.  It is already opened exclusively by another user, or you need permission to view its data.".

 (Microsoft.DataTransformationServices.VsIntegration)

------------------------------
BUTTONS:

OK
------------------------------

↧

Attunity CDC for Oracle Service - Oracle 12c Support

February 18, 2015, 8:29 am
$
0
0

For the Attunity CDC for Oracle service that is bundled with SQL Server 2012 SP1, is there support for Oracle 12c?  Or, will there be updates in the near future to support Oracle 12c?  If not, are there other solutions for incremental changes between Oracle 12c and SQL Server?

↧
↧

how to provide project.params in ssis 2012?

February 18, 2015, 6:10 am
$
0
0
well i am studying ssis 2012 can i know what steps we have to take to create project parameters and to provide connection string,DB name in ssis project.
↧

When Deploying SSIS Packages to SQL Server using SSMS Import feature, is the package configuration file deployed at the same time?

February 18, 2015, 8:37 am
$
0
0

Hello, everyone,

I have an SSIS package with a XML package configuration file. I deployed it to the sql server using the import feature in SSMS (in Stored Packages, right click MSDB, select Import, select the package to deploy in file system). My question is 

Is the XML package configuration file also deployed? If so, which folder is it stored so that I can change the values in it? If not, is setting up the Configuration tab when scheduling a agent job the way to go manually bring the configuration file in?

Your help and information is much appreciated.

Regards


↧
Search

Varying Excel Column Headers

February 18, 2015, 1:52 pm
$
0
0

Greetings, again!

Seems our new vendor is not aware of the rule, "Keep yer column headers consistent!" They are sending daily membership tables to us, but have changed the column heading on one of the columns on a few of the submissions, causing my SSIS package to toss nasty ephitets my way.

So, I'm wondering; I have an Excel template file set up that is used to define the format of the imported worksheets. Is it possible to have a step to make SSIS ensure that the column headers match those in the template and, if not, change them such that they do before the processing step? I'm thinking some sort of script task to do this.

Thanx!

↧

Need to load the data from oledb source(sql server table to ) ODBC destination table. )

February 18, 2015, 1:38 pm
$
0
0

I have around 700,000 records that is needed to be moved from a table that exists in my sql server 2012 database table to the DB3 database table. I am using currently oledb source and ado.net as destination to do this transfer. But its taking more than 2 hrs, I need to get this done fast, there should be a way. but I am not able to get it done faster can any one help please....

Thank you 

↧
↧

Exec Pacakge when a file is added to a folder

February 18, 2015, 2:09 pm
$
0
0

Hi All,

I`m fairly new to SSIS and I`m still in learning phase so please bear with me. I have a package which takes in flat files from a source folder dumps it into a table and when records are inserted it moves the folder to a archive folder.

I have three Variables in my package, FilePath, SourceFolder and Archive folder.

I want to add the functionality of executing the package whenever a file is added to the source folder.. How can I make that happen please can someone help me out?

Thank you

FM

↧

SSIS Variable Expression not Picking Up the value dynamically set from a Foreach Loop container

February 18, 2015, 1:03 pm
$
0
0

Hello, everyone,

I have three variables in my SSIS package:

1) ReportLoc that holds a file path (c:\test, not changed)

2) ReportFileName that holds a file name that get assigned in a Foreach Loop container (file1, file2, etc.)

3) OutputFilePath that is the full file pathname, set in the expression: @[User::LocalPath] + "\\" +  @[User::ReportFileName]

All three variable have the package scope.

I expect OutputFilePath will be asigned values like c:\test\file1, c:\test\file2, etc.

However, it alwasy remains an empty string.

Anything I did wrong? Any help and information is greatly appreciated.

Regards 

↧

need SSIS event handler for long running event

February 18, 2015, 2:17 pm
$
0
0

Hi,

I have a long running table load task that I would like to monitor using an event handler. I have tried the progress and information events but neither generates a message during the actual table load. Is there a way to invoke an event during the SSIS data flow task when it 1%, 2% done?

thanks

oldmandba

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>