Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Cannot load script for execution

July 9, 2020, 6:30 pm
$
0
0
Hello we are running SQL Server 2017 (RTM-CU20) Standard Edition (64-bit) on Windows Server 2016.
We installed  SSDT-Setup-ENU.exe  - VS  2017 14.0.16214.0 .  All,  but Script Task is working.
We have  Script Tasks are running fine in Visual Studio 2017, but when deployed to the catalog I get an error in all Script Tasks: Cannot load script for execution ( exactly as in http://microsoft-ssis.blogspot.com/2018/10/bug-script-task-cannot-load-script-for.html).
If I create an initial “Script Tasks” without any changes it is working.  However if I just open initial task and close it, we have an “Cannot load script for execution” issue.
I tried C:\Program Files (x86)\Microsoft Visual Studio\2017\SQL\Common7\IDE\CommonExtensions\Microsoft\SSIS\150\Binn\ISDeploymentWizard.exe as well as Management Studio deployment and has the same result.
 Any ideas?


↧
Search

cozyroc excel source configure

July 15, 2020, 7:30 pm
$
0
0

Hi,

My requirement is that the filename inside a folder constantly changes but part of the file stays same for excel file.

How do i configure cozyroc Excel source filename  pick the one file with the name that contains a string.

example- CountryMapping_v1.xlsx

Here 'countrymapping' string doesn't change,however the version may change.I am not sure how to configure this for the cozyroc excel source.

↧
↧

copy a file which is a variable from shared network drive to another template file

July 16, 2020, 4:50 am
$
0
0

Hi,

I would like to copy the file which resides in the network drive and its name changes frequently except some portion which stays same.I have been able to download the file matching this pattern into the shared drive.However,i am having no luck with how to load data from tat excel file sheets into sql table.

What i tried is to copy the dynamic source file that is downloaded in the drive to copy a template file.And use that template file to load the SQL tables from sheet i desire.I am unsuccessful here.Can you pls guide.

Example: ItemMaping_1.xlsx

Out of this string ,the ItemMapping is same everytime but the _1 changes.Also each time in the shared folder //abc/Item/" only a single file of that name comes in.

↧

How to access QuickBook data in SSIS

November 12, 2013, 8:31 am
$
0
0

Hi Experts

  How to connect and access data from quickbook in SSIS.Can you please guide me it will be very helpful for me ?

Thanks - SelvaKumarSubramaniam.Please MARK AS ANSWER, if my answer is useful to U.

↧

Logon denied error

July 16, 2020, 6:49 am
$
0
0

Hi All,R2

We have a packages that was running fine. Created using BIDS and the server is SQL Server 2008R2. Source is Oracle database and the Oracle connection manager is created with a username and password. Recently the DBA team changed the password. I changed the connection manager password tested and run the package successfully. Then saved the package and re-imported into MSDB overwriting the old package. 

Now the SQL Server Agent job is failing with the below error. Please need help.

1) The package runs fine in BIDS.

2) Package runs fine when run from the SSMS Integration services.

3) Fails when run as a SQL Server Agent job.

Executed as user: AD\SQLSERVICE. Microsoft (R) SQL Server Execute Package Utility Version 10.50.6560.0 for 64-bit  Copyright (C) Microsoft Corporation 2010. All rights reserved.   Started:  11:00:00 PM  Error: 2020-07-15 23:00:00.64    Code: 0xC0016016     Source:      Description: Failed to decrypt protected XML node "DTS:Password" with error 0x8009000B "Key not valid for use in specified state.". You may not be authorized to access this information. This error occurs when there is a cryptographic error. Verify that the correct key is available.  End Error Error: 2020-07-15 23:00:00.76     Code: 0xC001000E    Source:       Description: The connection "{A640392A-2CC9-421C-9AA5-B5E6C90F0064}" is not found. This error is thrown by Connections collection when the specific connection element is not found. End Error  Error: 2020-07-15 23:00:03.18    Code: 0xC0202009     Source: SF_ODP_APP Connection manager "SDEPB_PROD.odp_app"    Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005. An OLE DB record is available.  Source: "OraOLEDB" Hresult: 0x80004005  Description: "ORA-01005: null password given; logon denied". End Error  Error: 2020-07-15 23:00:03.18    Code: 0xC020801C     Source: MACCASEINFO MACINFOCASES [113]    Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "SDEPB_PROD.odp_app" failed with error code 0xC0202009. There may be error messages posted before this with more information on why the AcquireConnection method call failed. End Error  Error: 2020-07-15 23:00:03.18    Code: 0xC0047017     Source: MACCASEINFO SSIS.Pipeline    Description: component "MACINFOCASES" (113) failed validation and returned error code 0xC020801C. End Error  Error: 2020-07-15 23:00:03.18    Code: 0xC004700C     Source: MACCASEINFO SSIS.Pipeline    Description: One or more component failed validation.  End Error Error: 2020-07-15 23:00:03.18     Code: 0xC0024107    Source: MACCASEINFO      Description: There were errors during task validation. End Error  DTExec: The package execution returned DTSER_FAILURE (1). Started:  11:00:00 PM  Finished: 11:00:03 PM Elapsed:  2.636 seconds.  The package execution failed. The step failed.

↧
↧

SSIS Azure Data Lake Store File System Task Error : There is an internal error to refresh the Token. Service returned Error. Check Inner Exception for more details

July 16, 2020, 11:54 am
$
0
0

HI Team,

I have created a ADLS file system task in SSIS to upload a file in to the Azure Data Lake Gen1. I am able to successfully execute that package from Local machine using visual studio. And i am using client Id and secret to connect to ADLS. When i deploy it to the server which has Azure Feature pack installed, this task is running for a very ling time around 45mins and failing "SSIS Azure Data Lake Store File System Task Error : There is an internal error to refresh the Token. Service returned Error. Check Inner Exception for more details" with this error 

I have tried different protection levels and also tried User Identity Authentication but no luck 


Any one please suggest ? 

↧

ODBC MySQL Error: A buffer failed while allocating 10484928 bytes on SSIS

July 16, 2020, 12:01 pm
$
0
0

Hello, Hello we are running SQL Server 2017 (RTM-CU20) Standard Edition (64-bit) on Windows Server 2016.
We installed  SSDT-Setup-ENU.exe  - VS  2017 14.0.16214.0 , SSDT 15.1.62002.01090 , SSIS 15.0.2000.121

We are loading some data from MySQL Server by using ODBC driver (mysql-connector-odbc-5.3.4-win32).  We are restricted to use the only this driver.

We have about 200 ODBC DS Data Flows Tasks and almost all is working.

We have one Data Flows Task, which working fine while it is executing in VS ( The TargetServerVersion on VS 2017 is set to SQL Server 2017) , and in SSIS (where we set “32” bit checkbox on) it fails with the following messages (

I put them with by the order they received ):

  1. Load Stage:Error: A buffer failed while allocating 10484928 bytes.
  2. Load Stage:Error: The system reports 19 percent memory load. There are 137340829696 bytes of physical memory with 110368186368 bytes free. There are 2147352576 bytes of virtual memory with 88211456 bytes free. The paging file has 140562055168 bytes with 113176129536 bytes free.
  3. Load Stage:Error: Failed to add row to output buffer.

The task manger shows that we have 81% memory free and 95% CPU free as well on the Windows Server at the time of execution. 

Any ideas for troubleshooting and fixing?

↧

End date a previous record in a dimension table

March 20, 2017, 9:27 am
$
0
0

I have a requirement to populate a dimension table which has a start date, end date, and flag for the current record.  Here's the basic idea.

Table:

create table Person
(
PK int identity(1,1) not null primary key,
UserID varchar(20) not null,
FirstName varchar(35) not null, 
LastName varchar(35) not null,
StartDate datetime2(7) not null default sysdatetime(),
EndDate datetime2(7),
IsCurrent bit not null
)

When populating table Person if I find a different first/last name for the given UserID I want to set the end date of the record where IsCurrent = 1 to 0, set the EndDate of that record to the current record, and insert the new record with IsCurrent = 1 and a start date (done by DB default).

I can add new records no problem using a lookup.  My problem is with updating the previous records.  Can someone point me in the right direction?

Thanks!

EDIT the problem is pretty much identical to this post, but in SSIS rather than TSQL.




↧
Search

Scalable SSIS Solutions

July 16, 2020, 2:37 pm
$
0
0

Hi everyone,

I was wondering if there is a good training out there for building a scalable SSIS solutions

me

↧
↧

How to export data from SQL table to multiple excel using Execute SQL Task and ForEach Loop Container files in SSIS?

July 16, 2020, 7:09 pm
$
0
0

I created an SSIS package that extracts data from SQL Server Table and load it into multiple excel Files. I am having problem making this package dynamic and loading data into multiple excel files Based on State abbreviations. I Not using Conditional Split, I  am Execute Sql Task and Foreach Loop. I want to have for Each State abbreviations like 'US' or 'Uk' or 'EU' to export to Excel file with entire Record

I first created an execute SQL task that holds all the State Names with SQL code: SELECT State FROM Files and its result set will be stored in a variable StateNameObj. Then I created a Foreach Loop Container and added a Data Flow Task inside.

Foreach Loop Container setting: Foreach ADO Enumerator, ADO Object source variable - StateNameObj, Variable mapping - StateNameVariable and Index - 0. Under data flow task, I have added an OLE DB Source and Excel Destination pointed to file path: C:\Test\ABC.xlsx .

Also I have Created DestinationPath Variable

Here is the Connection Manager Property for Excel:

ExcelFilePath: P"Provider=Microsoft.ACE.OLEDB.12.0;Data Source=" + @[User::FolderDestination]+ "\\" + @[User::StateVariable] + ".xlsx"+";Extended Properties=\"Excel 12.0;HDR=YES;IMEX=1\";"

DelayValidation set to True

When i execute the Package this Error came up:


[Connection manager "Excel Connection Manager 1"] Error: The connection string components cannot contain unquoted semicolons. If the value must contain a semicolon, enclose the entire value in quotes. This error occurs when values in the connection string contain unquoted semicolons, such as the InitialCatalog property.

Error: The result of the expression ""Provider=Microsoft.ACE.OLEDB.12.0;Data Source=" + @[User::FolderDestination]+ "\\" + @[User::StateVariable] +".xlsx"+ ";Extended Properties=\"Excel 12.0;HDR=NO;IMEX=1\";"" on property "\Package.Connections[Excel Connection Manager 1].Properties[ExcelFilePath]" cannot be written to the property. The expression was evaluated, but cannot be set on the property.
[Connection manager "Excel Connection Manager 1"] Error: The connection string components cannot contain unquoted semicolons. If the value must contain a semicolon, enclose the entire value in quotes. This error occurs when values in the connection string contain unquoted semicolons, such as the InitialCatalog property.
Error: The result of the expression ""Provider=Microsoft.ACE.OLEDB.12.0;Data Source=" + @[User::FolderDestination]+ "\\" + @[User::StateVariable] +".xlsx"+ ";Extended Properties=\"Excel 12.0;HDR=NO;IMEX=1\";"" on property "\Package.Connections[Excel Connection Manager 1].Properties[ExcelFilePath]" cannot be written to the property. The expression was evaluated, but cannot be set on the property.


Please Help me Solve this Issue. Thank you

↧

excel date column loads into sql as integer

July 16, 2020, 8:56 pm
$
0
0

Hi,

I have excel file whose date column is although date format 'mm/dd/yyyy' but when this is loaded into SQL table of varchar column,it loads that dates are integer like "43894.1840277778"

I tried derived column with following:

  • convert it to WSTR in derived column
  • tried to convert to another string yyyy-mm-dd ,but fail

I wouldnt be able to change this on the excel as the file keeps changing.Pls guide

↧

Problem with migration to new server

July 17, 2020, 4:28 am
$
0
0

My Company has a old SSIS Package Solution (2005)  and we need transfer this on a new (SQL SERVER 2016 SP2).

I can open that project with Visual Studio 2017 I can make oneway-Upgrade and then I can convert that from package deployment model to Project Deployment Model (with than process I lost data source connections)  

After that i create a new catalog on Sql Integration Folder (Sql Data Engine). But when I try Import Packages that give me

ssis-deployment-error-6522  


↧

Connection Manager trust relationship SSL/TLS secure channel

July 17, 2020, 5:58 am
$
0
0

I have created an SSIS package that emails SSRS reports to an email distribution group.  In the package, I run the reports and save the pdf or excel files to an Azure storage account.  Then I attach the files to the email and send it out.  This was working until I switched the Report server to an Azure SQL Server.  Now I am getting this error message when I try to change the ReportServer connection manager to the new server:

TITLE: Microsoft Visual Studio
------------------------------
The underlying connection was closed: Could not establish trust relationship for the SSL/TLS secure channel.
------------------------------
BUTTONS:

OK
------------------------------

I can connect to the new Report Server in IE.  Why doesn't Visual Studio allow me to connect to it?  In the connection manager, I do not see any options to turn on or off the SSL/TLS security.

Fred

Fred

↧
↧

Unable to delete breakpoint in SSIS C# script

November 23, 2009, 7:36 am
$
0
0
I created SSIS script task using C#. I placed a breakpoint within a script while debugging. Now I cannot remove it - execution always stops at this breakpoint.

I tried everything - pressing "F9" while at the breakpoint, going to the list of breakpoints and disabling it (there was no "delete" option), saving project and restarting Visual Studio - nothing helps. Each time I start package via "Start Debugging" execution stops in the script.

Anyone has any suggestions?
↧

Teradata Attunity Connection issue: SqlState = HY000 Message = [Vk__

July 17, 2020, 4:34 pm
$
0
0

I am using VS2013 shell to develop SSIS package. When i try to connect to Teradata data base using Attunity, i get this message:

Error at Package [Connection manager "Teradata Connector 1"]: There was an error trying to establish an Open Database Connectivity (ODBC) connection with the database server. SqlState = HY000 Message = [Vk

Error at Data Flow Task [Teradata Source [1]]: The AcquireConnection method call to the connection manager Teradata Connector 1 failed with error code 0x80004005.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

------------------------------

ADDITIONAL INFORMATION:

Error HRESULT E_FAIL has been returned from a call to a COM component. (Microsoft.SqlServer.DTSPipelineWrap)

I have installed Attunity version 3.0. The connection works in another PC with same version of visual studio and attunity


↧
Search

ssis help

July 17, 2020, 9:19 pm
$
0
0

i have one doube in ssis
how to load double codes data from sql server to csv filesusing ssis pacakge .
source : emp table 

CREATE TABLE [dbo].[empcsvfile](
[eid] [varchar](50) NULL,
[empstring] [varchar](8000) NULL,
[details] [varchar](500) NULL
) 
GO
INSERT [dbo].[empcsvfile] ([eid], [empstring], [details]) VALUES (N'1', N'''1'',''yt'',''1te'',''1d''', N'{"test":"ed","eDate":"1990-01-16","isflag":null,"Type":"te","Number":null,"std":null,"mark":null,"Code":"22","cty":"r","state":"tn","country":"IN","isPermanent":null,"Lines":{"Street2":"street2","Street1":"street2","Taluka":"street2","District":"street2"},"Proof":null},{"Type":"PHONE","Date":"2017-05-28","Verified":null,"Type":"BSNSS","Code":null,"Code":null,"Number":"954457565","ette')
GO

destination : Test.csv file
eid |empstring |details



 I tried like below but in csv files its create extra columns
emp table have 3 coumns when i tried to load data into csv that fileds its create more than 3 fileds.


can you please me how to load empcsvfiles(sql server )  3 fileds data load into destination csv exact 3 fields in csv



↧

ETL design : What to consider for data cleansing.

July 17, 2020, 10:51 pm
$
0
0
For ETL design, what steps should i consider for data cleansing ? Thanks
↧
↧

Oracle Fusion Financials Online Training | Oracle Fusion Financials Training | Hyderabad

July 18, 2020, 5:11 am
$
0
0

Rainbow Training Institute having best instructors for Oracle Fusion Financials Online 

training and it is well known for providing all Kinds of oracle fusion technologies through 

online and it is stepping forward in providing best Oracle Cloud Financials Online Training in 

Hyderabad, Bangalore, Chennai, Noida, Delhi, USA, UK, UAE, Saudi, Europe, India, Canada. 

Complete Suite of oracle fusion financials training videos.

 https://www.rainbowtraininginstitute.com/oracle-fusion-functional-training/oracle-fusion-

financials-training/oracle-fusion-financials-training-in-hyderabad 

↧

Download multiple files from different URLs (.aspx) that generates an excel file

July 19, 2020, 12:36 am
$
0
0

Hi,

Could you please guide me with making a package that is able to (loop trough) multiple URLs (ending with .aspx), where each URL is generating an Excel file. One of the URLs is for example “https://www.otherwebsite.com/archive/date.aspx, if I open this link in my browser, it is generation and downloading an Excel file with the name date.xlsx. For looping through I want to use a variable for ‘date.aspx’. After downloading, the files should be saved in the folder c:\sql.

For accessing the website I need to provide my username and password.

I saw some solutions online, however these all are downloading the ‘date.aspx’ file, which I am not able to open or read. I have beginner’s knowledge of SSIS and SQL, most of the times I find a workaround online, however with this one I am really stuck.

Thank you very much for help and response!

Br.




↧

SSIS package runs successfully only when the source excel file is open.

June 24, 2020, 4:19 pm
$
0
0

I have a simple ssis package that has excel file as a source and ole db table as a destination, the package executes successfully as long as the excel file is open and whenever I close the excel file and execute the package it fails. After lot of google research, I changed the setting 'Run64BitRuntime' from True to false, still the package is failing when I execute after closing the excel file.

I tried changing the excel connection property 'RetainSameConnection' from False to true, still not working.

Any idea or input will be appreciated.

Please find the below error message I am getting.

TITLE: Microsoft Visual Studio
------------------------------

Exception from HRESULT: 0xC020801C
Error at Package [Connection manager "Excel Connection Manager"]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft JET Database Engine"  Hresult: 0x80004005  Description: "External table is not in the expected format.".

Error at Data Flow Task [Excel Source [8]]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

↧
Viewing all 24688 articles
Browse latest View live
Search