Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

SSIS Dataviewer in VS2019 is not working

October 25, 2019, 12:11 am
$
0
0

Hi all,

the Data Viewer in SSIS with Visial Studio 2019 is not working as used. You can see it, but the content of data viewer window is empty...

olaf870

↧
Search

Error: Import data from multiple Excel sheets to Table in sql.

October 25, 2019, 1:06 am
$
0
0

Hi Team,

I am using DataTool 2013 and Excel.xls.

The package is loading data from Multiple excel to Table as expected. But afer loading the end sheet (Sheet3) data its throwing error like...

[Excel Source [2]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E37.
[Excel Source [2]] Error: Opening a rowset for "Sheet3$_" failed. Check that the object exists in the database.
[SSIS.Pipeline] Error: Excel Source failed the pre-execute phase and returned error code 0xC02020E8.

Please help to solve the issue.

Thanks

Anil Acharya

↧
↧

No rows exposed in DataTable when parent package saves checkpoints!

October 24, 2019, 12:12 am
$
0
0

We are experiencing strange behaviour when reading a DataTable in an SSIS script task.

Scenario:

My package contains two tasks.

  • A simple Data Flow Task which reads records from a SQL Server 2016 table into a Recordset Destination.
  • The recordset object is processed in the Script Task using a DataTable object.

The recordset exposes no records when the package uses checkpoints, but all records appear when it doesn't!

Environment:

OS Name Microsoft Windows Server 2016 Standard
Version 10.0.14393 Build 14393

Microsoft Visual Studio 2015 Shell (Integrated)
Version 14.0.23107.0 D14REL
Microsoft .NET Framework
Version 4.7.02053

Installed Version: IDE Standard

Microsoft Visual Studio Tools for Applications 2015   00322-10000-00000-AA323
Microsoft Visual Studio Tools for Applications 2015

Visual Basic 2015   00322-10000-00000-AA323
Microsoft Visual Basic 2015

Visual C# 2015   00322-10000-00000-AA323
Microsoft Visual C# 2015

SQL Server Data Tools   14.0.61712.050
Microsoft SQL Server Data Tools

SQL Server Integration Services  
Microsoft SQL Server Integration Services Designer

↧

migrare carriage returns / new line from excel to SQL Table

October 25, 2019, 4:44 am
$
0
0

Hi All,

Is it possible migrate the excel data in ssis from Excel source  transformation to SQL Table ? 

Ex : I have lot of string columns in excel like following 

2010-0021544
2010-0074
2011-02342
2011-50500
2013-0501939
2015-0211930
2016-0201356

The entire string is in one cell I want to display in the table as it is. I sit possible in ssis ?

Please let me know thought or any link will help me on this .

Thanks

Sriraj 

↧

Error: Move multiple files then attach date with time to the file name

October 25, 2019, 8:41 am
$
0
0

Hello 

I have searched for few hours over internet of how to attach date and time to a file name after the processing and not much luck

In EXPRESSION BUILDER, I'm able to evaluate the syntax and it's all correct.

SSIS will throw an error at the time of running the package, and I can't see any reason why, if the syntax of the expression I'm using is incorrect then the 'Evaluate Expression' button would throw an error at that time of entering the expression?

Any help is greatly appreciated

@[User::ArchiveFolder]+"\\"+(DT_STR,30, 1252) GETDATE()+"_"+@[User::FileName]

Thanks

TT



↧
↧

Foreach Loop not working right, doesn't truncate table on 2nd record onwards

October 25, 2019, 10:02 am
$
0
0

Hi,

Anyone able to help.

Got an SSIS Package with a Foreach Loop Container using Collection Foreach ADO Emunator

The variable is User::Lookup_results - There are 4 results which names of 4x AD Groups)

In the For loop, I have 

a) Execute SQL Task which truncates Table X

b) Then after the SQL Task I have a Script Task with C# which grabs users from AD Group 1 and inserts them into Table X

What is happening is, after the Group 1 members have been written to Table X, Group 2 members are appended to the bottom of Table X, why?

After Group 1 is inserted, I want the loop to again delete Table X and then insert AD Group 2 members.

Any ideas?

Both the truncate task and script task are in the For loop

After looping AD Group 1, I would expect it to go back to a) then b)

↧

SSIS Precedence Constraint Not Behaving as Expected

October 25, 2019, 11:24 am
$
0
0

This should only hit if the variable = 'True'. In the screenshot below it clearly says 'False' but still hit. I have tried Changing the 'Logical AND' to 'Logical OR' as well have tried changing every other operation and combination with "Evaluation operation:"

https://imgur.com/VuSPgqn

↧

Visual Studio 2017 - SSIS Excel Source Data Flow APPCRASH on devenv.exe module mso40uiwin32client.dll

October 23, 2019, 9:59 am
$
0
0

I'm getting APPCRASH each time I edit the Excel Source Data Flow object.
I have an existing SSIS Package that I change the source of the file through a Variable so I pick the Excel sheet through"Name of the Excel sheet" then click on the "Columns" to verify the columns associated to this sheet.  I get the error either by clicking 'Ok' to exit the Excel Source Editor or by clicking the "Preview" button.

I have tried selecting different driver version of the Excel connection manager but with same error.

VS give the following error:

Problem signature:
  Problem Event Name:APPCRASH
  Application Name:devenv.exe
  Application Version:15.9.28307.586
  Application Timestamp:5c9e3ce1
  Fault Module Name:mso40uiwin32client.dll
  Fault Module Version:16.0.4519.1000
  Fault Module Timestamp:58bed810
  Exception Code:c0000005
  Exception Offset:00166226
  OS Version:6.3.9600.2.0.0.272.7
  Locale ID:1033
  Additional Information 1:5861
  Additional Information 2:5861822e1919d7c014bbb064c64908b2
  Additional Information 3:6fbe
  Additional Information 4:6fbe6bde2701766d81cbca0597a5fa35


... when you're a phan, be phanatix!

↧
Search

SSIS issue with Excel 2013 (64bit) & VS2019 & SQL Server 2017

October 25, 2019, 3:02 pm
$
0
0

Been stuck on this since last night; working through countless threads and making too many updates/changes.  Gotta punt.

Just discovered that I cannot connect to Excel as I set up a simple SSIS job to read from a table and write to a spreadsheet.  In the Excel Destination Editor, I got the infamous "no tables or views could be loaded" instead of the name of the Excel sheet. 

What I discovered was that I have a mismatch of 32/64-bit drivers between Visual Studio, SQL Server and Office.  Please correct me, if I got this wrong.

---------------------------------------

I am using:

MS Windows 10 64 Bit

MS Office 2013 64 Bit

SQL Server 2017 Developer Version

MS Visual Studio 2019

----------------------------------------

Upon reading the threads in this forum- which is not where I started -I updated the

Microsoft® OLE DB Driver 18 for SQL Server®

https://www.microsoft.com/en-us/download/details.aspx?id=56730

----------------------------------------

This was after I tried loading the 32-bit driver for 2007 and 2010, as I followed various threads before landing here.  That is where I learned about resetting theRun64BitRunTime flag to false in the configuration properties for the project.

But no matter what change(s) I make, I cannot configuration to connect correctly.

Interestingly, I have been able to do stuff like this at work, where we use VS2017 and Office365.  In addition, I have connected for this type of operation correctly using older versions; Office2013 & VS2013.  However, I upgraded my Visual Studio copy from 2013 Professional to the latest (2019) Community Edition, and lost my Excel connectivity.

----------------------------------------

What is the RCA (Root Cause Analysis) here?  Is it Visual Studio, Office or SQL Server?  I suspect this relates to the Office (64) versus Visual Studio (32) bit drivers.  I have not tried rolling back Office 2013 to 32 bit.  Will that fix the problems here?

Yeah, a lot of these threads are similar, but not always congruent.  In my case, I had a current Win10/64 with an older Office2013/64 install that I put a new development environment on.

Of course, I appreciate all, particularly those who can point me in the right direction towards getting my Excel/Office drivers talking to my latest/greatest MS Dev environment.



↧
↧

Package reference error

October 26, 2019, 6:58 am
$
0
0

We need some urgent help regarding a unusual error occurrence happening very frequently during our SSIS executions from SSIS catalog.  We have few projects were parent package calls many child packages. we get below error while package executions

 " Error 0x80131500 while executing package from project reference package abc.dtsx" The package failed to load due to error 0xC0011008 "Error loading from XML.

No further detailed error information can be specified for this problem because no Events object was passed where detailed error information can be stored.". 
This occurs when CPackage::LoadFromXML fails. "

I have read many blogs and forums on this issue and followed suggested instructions but none of them have worked. 

Database and SSIS servers are separate. we using SQL Agent to run the packages and packages are using PostGre SQL 9.0. 

Recently we have installed PostGre SQL 11 on the SSIS server. since we faced this problem very frequently so we stop the PostGre services and we are still getting this issue. 

We never faced this issue before but in recent days the occurrence has gone up.  We thought of PostGre SQL Oledb driver used by SSIS but still not sure.

When we restart the server then everything works fine for few days and the issue then again pops up after 3-4 days.

Any suggestions or help would be a great help for us.

Thanks

  
↧

SSIS - Error Code 0x80004005

January 27, 2016, 10:26 am
$
0
0

I have searched through many forums concerning this error:

Error at Load Data Table Position Requisition [Load Data Table SFactor_PositionReqisition [1]]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred.  Error code: 0x80004005.

An OLE DB Record is available.  Source: "Microsoft OLE DB Provider for Oracle" Hresult: 0x80004005 Description: "Unspecified error."

An OLE DB record is available.  Source:  "Microsoft OLE DB Provider for Oracle" Hresult: 0x80004005 Description: "Oracle error occurred, but error message coud not be retrieved from Oracle.".

An OlE DB record is available.  Source: "Microsfot OLE DB Provider for Oracle" Hresult: 0x80004005 Description: DataType is not supported.".

Error at Load Data Table Position Requisition [Load Data Table SFactor_PositionRequisition [1]]: Opening a rowset for "PHSF"."SFACTOR_POSITIONREQUISITION"" failed.  Check that the object exists in the database.

Additional information

|__> Exception from HRSULT: 0xC02020E8 (Microsoft.SqlServer.DTSPipelineWrap)

I am using SQL Server 2008 R2 (BIDS).

I think I get the issue as this only occurs on one of five table loads and this table is trying to take an NTEXT (Excel) data column and send it to a NCLOB Oracle (10g) data table.  This behavior was not experienced until I added the NCLOB column to the data table.  The data is required and setting the Oracle data column to VARCHAR2(2000) is not large enough to hold the data being imported. 

Is there a way to import the data to an NCLOB with this version of SSIS?  Maybe transform the data from NTEXT to TEXT to Varchar(Max)?  Any help and direction offered will be greatly appreciated.

Thank you.

MT

↧

Slowly changing dimension with two historical attributes

October 27, 2019, 5:31 am
$
0
0

Is it possible to implement SCD for many attributes for my FactEmployee at the same time ?

The attributes I am tracking : EmployeeStatus,EmployeeType,Manager (it can go up to 6 attributes)

↧

https://livemlbworldseries.com/

October 27, 2019, 6:02 am
$
0
0
https://livemlbworldseries.com/
https://livemlbworldseries.com/live/
https://livemlbworldseries.com/stream/
https://livemlbworldseries.com/2019-live/
https://livemlbworldseries.com/world-series/
↧
↧

SSIS: how capture failed DB connection error?

January 3, 2017, 2:41 pm
$
0
0

Occasionally a SSIS package fails to connect to a remote server because, we suspect, the remote server is experiencing high CPU (e.g. during backup process).  How can we recognize this type of failure from inside our SSIS package?

TIA,

edm2

P.S.  You may be able to ping the remote server at the time but that doesn't mean that an external app canaccess data in a database on that server.

↧

SQL server In place Upgrade from 2014 to 2017 ( RTM-CU17) - SQL Assertion error

October 22, 2019, 7:13 pm
$
0
0

SQL Server In place upgrade from 2014 to 2017 RTM -CU17 failing with Assertion error.

'IS_OFF (BUF_MINLOGGED, m_buf->bstat) || pageModifyType != PageModifyType_Contents || GetPagePtr ()->IsTextPage ()'.

1. Database and SSIS is upgraded to 2017 and redeployed after in place upgrade from 2014 to 2017

2. we have a master package which runs around 120 child packages and failing continuously on a particular ETL package.This SSIS job calls a Stored procedure which contains  merge statement ( around 80K records).

3.Same error when we run the individual package or running the Stored procedure on SSMS.

Following workaround are done but no luck

1. Drop and recreate SP

2.DBCC check on table

 

↧
Search

to generate a xml file from csv ussing c# in ssis script component

October 24, 2019, 10:40 pm
$
0
0
I have a csv file data of automobile insurance records which i need to convert into a xml file using ssis. 
Now , when I have unique insurance numbers in csv then i can generate the xml file in the required format but there are multiple occurrences of a insurance number.
**For ex. A family have got their automobiles insured having 4 drivers and 4 vehicles so there are 4 entries of that insurance number in csv file which should be 1 block in xml having insurance number occurring 1 time and all driver and vehicle entries 4 time under 1 insurance number tag.**


I have generated a xml file when there is no repetition of driver or vehicle or insurance number. I am very new to SSIS and never done coding in c# so if someone can help me with the code. How to loop over columns if they are repeating and make child nodes entry for it.


This is the code i have used in ssis script component to generate the structure of xml i require but it works only in case when there is no repitition.


string[] lines = File.ReadAllLines(@"H:\SSIS\Source\Intermediate.csv");




        XElement xml = new XElement("Submissions",
        from str in lines
        let columns = str.Split(',')


        select new XElement("SubmissionEntry",
         new XElement("SubmissionID", columns[0]),
         new XElement("PolicyNumber", columns[1]),
         new XElement("OfferingCodeIdentifier", columns[2]),
         new XElement("BaseState", columns[3]),
         new XElement("EffectiveDate", columns[4]),
         new XElement("PeriodStart", columns[5]),
         new XElement("RateASOfDate", columns[6]),
         new XElement("RenewalNumber", columns[7]),
         new XElement("RatingCapFactor", columns[8]),
         new XElement("ConversionFactor", columns[9]),
         new XElement("ClaimsFreeCount", columns[10]),
         new XElement("PaidInFull", columns[11]),
         new XElement("IsHomeOwner", columns[12]),
         new XElement("IsNewBusinessTransfer", columns[13]),
         new XElement("IsNamedNonOwnerPolicy ", columns[14]),
         new XElement("LVTTier", columns[15]),
         new XElement("PNIBirthDate", columns[16]),
         new XElement("PNIPostalCode", columns[17]),
         new XElement("CreditStatus", columns[18]),
         new XElement("EquivalentCreditScore ", columns[19]),
         new XElement("CreditScore", columns[20]),
         new XElement("DeliverySource", columns[21]),
         new XElement("ChannelGroup", columns[22]),
         new XElement("LineCoverages",
             new XElement("LineCovEntry",
                 new XElement("PatternCode", columns[23]),
                 new XElement("CoverageTerms",
                     new XElement("CovTermCodeIdentifier", columns[24]),
                     new XElement("CovTermValue", columns[25])))),
         new XElement("PolicyDrivers",
             new XElement("DriverEntry",
                 new XElement("DriverID", columns[26]),
                 new XElement("DriverType", columns[27]),
                 new XElement("Excluded", columns[28]),
                 new XElement("RelationToApplicant", columns[29]),
                 new XElement("DateOfBirth", columns[30]),
                 new XElement("Gender", columns[31]),
                 new XElement("MaritalStatus", columns[32]),
                 new XElement("AgeLicensed", columns[33]),
                 new XElement("LicenseStatus", columns[34]),
                 new XElement("LicenseCountry", columns[35]),
                 new XElement("UnverifiedDriver", columns[36]),
                 new XElement("EmploymentStatus", columns[37]),
                 new XElement("DriverImprovementCourse", columns[38]),
                 new XElement("DriverImprovementCourse", columns[39]),
                     new XElement("IncidentEntry",
                         new XElement("IncidentID", columns[40]),
                         new XElement("IncidentDate", columns[41]),
                         new XElement("ViolationCode", columns[42]),
                         new XElement("OverrideCategory", columns[43]),
                         new XElement("LossAmount", columns[44])))),
         new XElement("PersonalVehicles",
             new XElement("VehicleEntry",
                 new XElement("VehicleID", columns[45]),
                 new XElement("VehicleYear", columns[46]),
                 new XElement("GaragePostalCode", columns[47]),
                 new XElement("PrimaryUse", columns[48]),
                 new XElement("GaragedOutOfState3MonthsPerYear", columns[49]),
                 new XElement("SecurityTypeCode", columns[50])),
                 new XElement("RAPA",
                     new XElement("Rapa_Bi", columns[51]),
                     new XElement("Rapa_Coll", columns[52]),
                     new XElement("Rapa_Comp", columns[53]),
                     new XElement("Rapa_Med", columns[54]),
                     new XElement("Rapa_Pd", columns[55]),
                     new XElement("Rapa_Pip", columns[56])),
                     new XElement("VehicleCovEntry",
                         new XElement("PatternCode", columns[57]),
                         new XElement("CoverageTerm",
                             new XElement("CovTermCodeIdentifier", columns[58]),
                             new XElement("CovTermValue", columns[59]))))));








        xml.Save(@"H:\SSIS\Destination\demo xml.xml");
↧

SSIS Aggregate aggregates non-equal rows - Bug?

June 20, 2019, 2:51 am
$
0
0

Hi,

I have a weird case in SSIS with an aggregation. I have a column which I aggregate on (I have sorted the data), and the aggregator removes rows that are not equal. Here you probably say - you have a case-sensitive problem...Well I guess so, but I cannot fathom how.

The column that I aggregate on all comprise of the following pattern: <6 numbers>¤<4 numbers> (Ex. 152733¤8440). So, no characters, at all. I have over 7 mio. rows in my source, and of those I 'lose' around 2.300 unique combinations, that should not have been aggregated. 

The super-weird thing is that if I tell the aggregator to be case-sensitive, then it does not remove the rows. So - how can a number + ¤ + number be affected by case? The above example (152733¤8440) is one of the rows that's remove in a non-case sensitive setup. This makes no sense to me - and I have a very hard time coming up with a way to debug which other rows cause the actual 'wrong' aggregate. 

Does anyone have suggestion as to what might be 'hitting' me here? I can, as a workaround, continue with the case-sensitive comparison. I just don't understand what happens - and I don't like the solution, as my database is case insensitive - so that should be the correct comparison. (Note: The source has the column in question as an unique key, so the SQL server does not see the rows as equal). The datatype in SSIS is (DT_STR, 100, 1252) - it's varchar(100) in the source.

Thanks in advance

↧
↧

Execute SQL Task Editor

October 24, 2019, 10:28 am
$
0
0

It seems there is a big,big bug inside the newest version of SSIS:

When I try to create a "execute sql-task" in Visual Studio 2019, I get only very small dialogbox without any tabs, there I can enter a sql statement, but I can't choose an existing connection. The option "read sql statements from file" is not available too. Somebody knows, if there is any work aound or what is wrong?

best regards
Olaf

olaf870

↧

Replace ";" with ;

October 28, 2019, 4:38 am
$
0
0

Hello,

i have a question regarting the Replace function in SSIS. I want to replace ";" with ; within a text.

For example i have the text  '

Hello";"World'

in the column NAME. I want to change the text in 'Hello;World'. 

REPLACE(NAME,"";"",";") does not work. Do you know what my mistake is? Can you guys please help me?

Many Thanks

↧

Solution/Package GUI Performance Optimization

October 28, 2019, 9:04 am
$
0
0

I've built an SSIS package over the last year which has grown quite big over the last few iterations.  There are probably about 200 objects in various Sequences, Groups and Loops.   Visual Studio has been getting slower and slower to the point now where running the job takes 60-90 seconds to build it before it runs.

Has anyone got any pointers on optimising this?  I think the first point of call would be splitting it into separate packages and calling them from a parent package.  I've put this off so far as the deployment is managed by the client and the server and installation accounts are locked down quite a bit.

I'm using SSDT 2015 with Visual Studio 2015.

Any books/Youtube vidoes/websites, or general advice would be greatly appreciated. 

TIA :)

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>