Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

replace '-' with Zero if whole cell got only '-' SSIS

$
0
0

Hi Friends,

I was extracting the CSV file into SQL table, one column got negative numbers, positive numbers and also got '-' which is basically nothing 

please have a look below picture...

My requirement is I need to replace '-' with '0'  I can use replace function like this replace(p1,'-',0) but this is going to change the  negative values as well which I don't want can anyone give me an idea please ?

Thanks in advance


How to handle data like this - cción in CSV flat file load

$
0
0

 cción

My SSIS package is failing to load data for the above text in the column .

My target is Varchar (255).

Do I need to change the datatype to nvarchar(255) ?




Warning 0x80049304 Data Flow Task 1: Could not open Global Shared Memory to communicate with Performance DLL

$
0
0

Hello Everyone,

Hope this post finds you well. The attached issue occurred during an import process. Here's the steps I took ingeneral.

DB1 - collation Latin1_General_CI_AS & DB2 - collation SQL_Latin1_General_CP1_CI_AS

1. Generated scripts from DB1 to create new database. selected FT Index and Triggers to script and chose not to script collation.

2. Created new DB named DB2 (collation SQL_Latin1_General_CP1_CI_AS).

3. Disabled foreign key constraints - set simple recovery across the board.

4. Right clicked on new db and chose import data (copy data from one or more tables and views).

5. Edit mappings: checked identity insert and drop and recreate tables.

6. Unchecked all DB views.

7. Launched process.

It reported that it ran successfully except for the attached error under Validating.

I noticed that the mdf and ndf (FText) files were significantly smaller than the original db. I did a data compare and lots of data did not come over. I did this same import in our development environment. Exact versions of SQL Server etc. The only difference between this environment and our development environment is that this one is physical and dev is virtual.

The closest article our there I've seen on the issue is the one I attached at the top. I am thinking there is a problem with the SSIS install on this server. I am going to try the same task on the second node to see if that error occurs.

https://www.reddit.com/r/SQL/comments/2x9hke/ms_sql_import_wizard_truncation_erorrs/

Warning 0x80049304 Data Flow Task 1: Could not open Global Shared Memory to communicate with Performance DLL


A SQL Server MVP or MSFT Eng should be replying soon as well. Hope this helps. Frank Garcia *** Please select "Vote As Helpful" if the information provided was helpful to you. If an answer to your issue solved the problem then please mark it as"Propose As Answer" located at the bottom. Thank you. ***

Can't edit Package Configurations in Visual Studio 2013

$
0
0

When I try to edit Package Configurations in VS 2013 the screen locks up on the Package Configuration Wizard screen and comes back with Not Responding.  The only way out is to close VS and start it back up.  I thought at first it was because we store the configuration by relative path but i put the absolute path in the xml and it does the same thing. I had no trouble editing configs in 2008 or 2012.  I installed the latest update (5) and that did not help.  I even uninstalled and re-installed VS but that didn't help either.

Has anyone else had this problem and can offer a solution?


Update 3 million row in Oracle

$
0
0
I need to update 3 million  rows in Oracle. Can you please advise best approach in updating . Performance does not have to be perfect but SSIS must update rows .  I am not oracle pro so any additional information in implementing a process would be appreciated. i heard you need to cover the update in transaction control but i am not sure about it.

Checkpoints for Sequence container

$
0
0

Hi Experts,

I have created a package which contains sequence container and in sequence container there are multiple independent DFDs. I wanted to run only failed DFDs in next run not all. Below are some setting which i have used in package

I have a sequence container and on this container I have set "FailPackageOnFailure=true".

For DFDs inside the sequence container  i have set "FailPackageOnFailure=False".

Currently if any DFD failed in first run then for rerun it executes all the DFD inside the Sequence container, but wanted to run only failed one in next run

Please guide

regards,
Sagar

query result is return 0 result set how execute next task in dataflow

$
0
0

hi everyone

in dataflow task source query return 0 result i used row count and put condition split  and if row count is 0 then add to destination as Waring message how i can achieve this? if result set  count 0 then then it is not adding the row in destination as per my condition

How to populate data into dimenstions and fact tables through ssis package.

$
0
0

Hi, I am The new For designing the ssis package,

I have One requirement,

I have 3 master tables .

I want design the SSIS Package for populating these.

How i can do?

Any One Help


Script Task unable to find variables

$
0
0

I have a script task on a 2014 SSIS package that needs to access and write to several Variables within the package.  The Variables are set at the Package level.  

When I run the package, the script task simply does not see them.  The Variable count from Dts.Variable.Count is 0.

If someone would point me in the right direction to fix this issue, it would be greatly appreciated.  


Robert Johnston

pass parameter date=currentdate in Sql agent job

$
0
0

hi everyone

i have ssis package that has parameter messagedate  as input.

i am making sql agent job in that i want  parameter MessageDate is autometilcally take getdate()

SSIS Job Importing records from a MariaDB

$
0
0

I have an SSIS job that is importing records from a Maria DB that is failing on one data flow task. I have the same exact setup on 5 other tables and the process works flawlessly but when I hit one specific table transaction I get the following problem signature:

"

Problem signature:
  Problem Event Name: APPCRASH
  Application Name: DtsDebugHost.exe
  Application Version: 2014.120.2000.8
  Application Timestamp: 5306c843
  Fault Module Name: StackHash_63ef
  Fault Module Version: 6.3.9600.18194
  Fault Module Timestamp: 569515fc
  Exception Code: c0000374
  Exception Offset: PCH_27_FROM_ntdll+0x0003C7EC
  OS Version: 6.3.9600.2.0.0.272.7
  Locale ID: 1033
  Additional Information 1: 63ef
  Additional Information 2: 63eff66405e82550f568af4bd33d1408
  Additional Information 3: 9098
  Additional Information 4: 9098f1a2de681bb6f5cc98f51d81c0c5"I made sure I was running the project in 34 bit.  This table is larger than the others and I can see the data in preview but it won't even try to transfer one record. Thanks in advance.


Matt

funny hex looking thing before and after every ragged right record written

$
0
0

Hi, I just exported a 2008 r2 pkg to my newer local where sql 2008 r2 and bids were just installed alongside sql 2014 and vs 2013. 

I ran a dft from that pkg in bids and noticed that in the output ragged right file, the characters_x003C_none_x003E_ are appended to the beginning and end of every record.  Interestingly, in bids I see the same characters shown as the text qualifier of the file connector but it is greyed out.

I checked the production output file and those characters aren't appended  to the front and end of every record.

This reminds me of a situation I saw once where a newer version of ssis recognized certain hex characters as the replacement of a single character (perhaps @ or " or ' or some other non numneric/non alphabetic character)

The ragged right connector shows locale English (United States), code page 1252 (ANSI - Latin I), format ragged right, header row delimiter {CR}{LF},header rows to skip 0, column names in the first data row unchecked, only one column called Column 0 whosedelimiter is {CR}{LF}, column type is delimited, input column width is 0,data precision is 0, data scale is 0, data type is string [DT_STR],output column width is 4000, text qualified is true.

Freeze when triggering SSIS package from C#

$
0
0

Attempting to trigger an SSIS package using C# in a Windows form using Visual Studio 2015.  Unsure why it is freezing or how to debug.  ImportFile.dtsx when run directly through Visual Studio starts with an OpenFileDialog for the user to select a file to process, however when running the package using the C# below, the whole thing freezes when I click the Audit button.  

Any suggestions?  

using System;
using System.Windows.Forms;
using SSIS = Microsoft.SqlServer.Dts.Runtime;

        private void btnAudit_Click(object sender, EventArgs e)
        {
            string pkgLocation;
            SSIS.Package pkg;
            SSIS.Application app;
            SSIS.DTSExecResult pkgResults;

            pkgLocation =
              @"C:\Documents\Projects\Import Test\ImportFile.dtsx";
            app = new SSIS.Application();
            pkg = app.LoadPackage(pkgLocation, null);
            pkgResults = pkg.Execute();
        }
Thanks in advance!

OLEDB Connection manager The AcquireConnection method call to the connection manager “” failed with error code 0xC0202009

$
0
0

Hi all,

i have SSIS package it work fine on our QA server but when i run it on production ,this error appear "OLEDB Connection manager The AcquireConnection method call to the connection manager “<Connection Manager Name>” failed with error code 0xC0202009"

can any one help me ,

i try to change the property of delay validation from false to true ,and change run64bitruntime to true , and change the protection level to EncryptAllWithUserKey but the error still exist.

can any one help me? 

SSIS expression works on all old build machines, but not on our new build machines

$
0
0

Hi,

Any idea why this expression would work on all of our old build machines, but not on our new build ones?

In a derived column transformation:

(DT_TEXT,1252)(SCD_SRC_AssuredName + "¬¬" + SCD_SRC_RowHashbytes + "¬¬" + (DT_WSTR,18)"SourceSystemID" + "¬¬" + (DT_WSTR,20)"SrcAssuredNumber")

Both of the SCD columns are also Unicode.

The error message is as follows:

Error: 0xC0047070 at DFT BordereauAssured 1:

Error: 0xC0049062 at DFT BordereauAssured 1, DERC SCD3 [111]: An error occurred while attempting to perform data conversion. The source type could not be converted to the destination type.

Error: 0xC0209029 at DFT BordereauAssured 1, DERC SCD3 [111]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "DERC SCD3" failed because error code 0xC0049062 occurred, and the error row disposition on "DERC SCD3.Outputs[Derived Column Output].Columns[AggregatedColumn]" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.

Error: 0xC0047022 at DFT BordereauAssured 1, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "DERC SCD3" (111) failed with error code 0xC0209029 while processing input "Derived Column Input" (112). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

Futher more, the below results in the same error:

(DT_TEXT,1252)(DT_NTEXT)(SCD_SRC_AssuredName + "¬¬" + SCD_SRC_RowHashbytes + "¬¬" + (DT_WSTR,18)"SourceSystemID" + "¬¬" + (DT_WSTR,20)"SrcAssuredNumber")

Thanks for your help in advance.


Failure Saving ssis package and unable to check in solution to TFS

$
0
0

Hi Experts,

we are using 2014 SSIS and Tfs as source controll,when i made package/edit the existing package i can able to save and check in file

to TFS

TITLE: Microsoft Visual Studio
------------------------------

Failure saving package.

------------------------------
ADDITIONAL INFORMATION:

Calling LoadStream at unexpected time (Microsoft.SqlServer.ManagedDTS)

------------------------------
BUTTONS:

OK
------------------------------

thanks in advance


ADKR

Excel Source Text Truncation of Columns Longer than 255 Characters

$
0
0

Symptoms

When you retrieve the external data from an Excel Workbook within an SSIS package, fields that have more than 255 characters will be truncated to 255 characters. In case of SSIS, the external columns of the Excel Source component will be limited to a maximum length of 255 characters if the first 8 rows of the Excel Workbook contain fields with a length less or equal than 255 characters.

Cause

Your data may be truncated to 255 characters if the first 8 rows in the Excel Workbook for the field(s) being truncated contain 255 or fewer characters. The Microsoft Excel ODBC driver will, by default, scan the first 8 rows of your data to determine the type of data in each column. If any of the rows after the first 8 rows of the Excel Workbook contain field(s) having lengths greater than 255 characters these will get truncated.



Figure 1


In the example represented in Figure 1 the Description field has 255 characters or fewer in the first 8 rows. As the Microsoft Excel ODBC driver, by default, scans only the first 8 rows of the Excel Workbook will define the metadata for the Description External Column to be of type DT_WSTR having a length of 255 characters. However in the 9<sup>th</sup> row the Description value has a length of 1000 characters and it will be truncated. The Excel Source component will not fail but it will truncate the value of the Description field in the 9<sup>th</sup> row to 255 characters.

Resolution

To change the number of rows that the Excel ODBC driver scans to determine what type of data you have in your table, change the setting of the TypeGuessRows DWORD value.
NOTE: The registry keys below were taken from 64-bit machine. If you have 32-bit Windows installed, remove "Wow6432Node" from the path.

  1. Run Registry Editor.
  2. In Registry Editor, navigate to the key: 
    HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Microsoft\Office\12.0\Access Connectivity Engine\Engines\Excel (if you have Microsoft Office 2007) 
    HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Microsoft\Office\14.0\Access Connectivity Engine\Engines\Excel (if you have Microsoft Office 2010) 
    HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Microsoft\Office\15.0\Access Connectivity Engine\Engines\Excel (if you have Microsoft Office 2013)
    HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Microsoft\Jet\4.0\Engines\Excel (if you have Microsoft Office 97-2003 or if you have xls files no matter the version of Microsoft Office installed)
  3. Double click TypeGuessRows.
  4. In the Edit DWORD Value dialog box, click Decimal in Base section.
  5. Enter the number of records that will be scanned for maximum field length. You can enter zero (0) to scan all records in Excel spreadsheet.
    NOTE: This is not recommended for large Excel spreadsheets.

Figure 2

SSIS Agent

$
0
0

Is it possible to schedule package using agent, where source and destination are in different domain?

If yes, What are the steps to be followed?


Praveen


SQL Server Agent not running.

$
0
0

Experts,

My SSIS package connects to two domains DomainA\user1_abc and DomainB\user1( Local Domain)

I will open ssis as runas /netonly /user:DomainA\user1_abc "\devenv.exe"

This package executes properly. I deployed the package to Integration Services Catalogs ( Server in DomainB) and when I execute the package from SSMS, the package executes properly.

SSMS also opens as runas /netonly /user:DomainA\user1_abc "\ssms.exe"

When I schedule this package via SQL Server Agent , the package is failing.

SQL Server agent is running as DomainB\user1( This is sysadmin account)

Error message I'm getting was PACKAGE1:Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "Login failed. The login is from an untrusted domain and cannot be used with Windows authentication."

Can you tell me how to run the package successfully?

Thanks in advance





Praveen


Set Run64BitRuntime debug options on development machine that only has 32 bit installed

$
0
0

Hello all,

When we create an SSIS project we can set the Run32BitRuntime option to True in Debugging properties so that when it is deployed to a 64 SSIS server it will use the 32-bit runtime. My problem is that my development machine only has 32 bit installation and the box is grey out with False as default. But if other developers in my team who have 64 bit SSIS installation open the project, it will say True on their machine. 

Is there a way I can make the change and save the property so that it will be really False, either on a 32 bit machine or 64 bit machine? 

Thank you in advance for your help,

Vietchau

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>