Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Clickable URL from Excel to SQL DB SSIS

$
0
0

I have an excel file with column "MoreInfo" and values of all the rows in this column is href to URL with text "More Info". 

But when I export the data of a column to DB column,it loads all rows as " More Info" not as the Link which I want to store in DB as text.

Kindly help me with the workaround.


Staging Tables

$
0
0

Hi There

we do get large files from vendor and needs to be loaded in to SQL server, The plan is to have raw data on to staging and convert the datatypes and load  to the final tables. Once the final tables are loaded we do not need the staging tables.

Is it a good practice to create objects (staging) and drop after the Final table was loaded. Can we use temporary tables here and can it accommodate millions of records in Temp tables

Please advice

Thanks 

Load Files to Different Tables according to the File Name in SSIS Package!!

$
0
0
I want to load files based on their names into tables with the same names.  The tables are already created.  I want to use an expression in the connection manager to allow me to insert based on the ForEach loop container.  As I loop through Each File there is a FileName Variable in the Variable Mappings storing the File's Name.  I am using a Conditional Split to dictate which table is loaded based on the FileName Variable (@FileName == "Example.txt") and I want it to insert into different OLEDB Destinations based on the outcome of the condional split.  The problem is that the condional split is not loading the destinations correctly.  They are loading them all into one destination.

Load Files to Different Tables according to the File Name in SSIS Package!!

$
0
0
I want to load files based on their names into tables with the same names.  The tables are already created.  I want to use an expression in the connection manager to allow me to insert based on the ForEach loop container.  As I loop through Each File there is a FileName Variable in the Variable Mappings storing the File's Name.  I am using a Conditional Split to dictate which table is loaded based on the FileName Variable (@FileName == "Example.txt") and I want it to insert into different OLEDB Destinations based on the outcome of the condional split.  The problem is that the condional split is not loading the destinations correctly.  They are loading them all into one destination.

Microsoft OLE DB provider suddenly insisting on finding a former SQL ( 10 year defunct!) server during Goldmine startup blocking Goldmine from starting

$
0
0

Have happily used Goldmine for the last 20 years. The first 10 years my various laptops would connect to a server when in the office. That server was eliminated 10 years ago! Todaystraight after a 'Malwarebites' update, when I tried to re-open Goldmine, the following popped up:

Goldmine Database Connection Problem

Description: [DBNETLIB][ConnectionOpen (Connect 0)

                   SQL Server does not exist or access denied

Native Code  17

Source          Microsoft OLE DB Provider for SQL Server

Trying to reconnect. Please Wait.

Two choices are given i.e Quit Goldmine    and Reconnect Now

The Quit choice makes the opening Goldmine disappear, the Reconnect choice keeps going around in circles

BOTH stop my Goldmine from opening. Have tried rebooting several times, and disconnecting from the internet, to no avail. How can I get my Goldmine to open without this text box popping up blocking it?

Cannot connect to SQL 2017 SSIS Remotely from Workstation

$
0
0

We have recently purchased SQL Server 2017 Standard. Installation is completed. We aren't unable to connect to SSIS remotely from a user workstation (Windows 10).

1. Setup:Windows Server 2019, SQL 2017 Standard, SSMS 17.9.1.
2. Locally on the server, we are able to connect to Database Engine, SSAS, SSIS, and SSRS.
3. However, we are unable to connect to SSIS; others connect just fine.
4. Attempts to resolve the error with no success:
    -We are using both SSMS 18.1 and SSMS 17.9.1 to test just to be sure. 
    -we have configured DCOM to allow remote access to specific users from security groups. 
    -we have added the server name to the MsDtsSrvr.ini.xml file. 

5. See below for the error details.

TITLE: Connect to Server
------------------------------

Cannot connect to SERVERNAME.

------------------------------
ADDITIONAL INFORMATION:

Failed to retrieve data for this request. (Microsoft.SqlServer.Management.Sdk.Sfc)

For help, click: http://go.microsoft.com/fwlink?ProdName=Microsoft%20SQL%20Server&LinkId=20476

------------------------------

Connecting to the Integration Services service on the computer "SERVERNAME" failed with the following error: "The specified service does not exist as an installed service.".

This error can occur when you try to connect to a SQL Server 2005 Integration Services service from the current version of the SQL Server tools. Instead, add folders to the service configuration file to let the local Integration Services service manage packages on the SQL Server 2005 instance.


For help, click: http://go.microsoft.com/fwlink/?LinkId=506689

------------------------------

Connecting to the Integration Services service on the computer "SERVERNAME" failed with the following error: "The specified service does not exist as an installed service.".

This error can occur when you try to connect to a SQL Server 2005 Integration Services service from the current version of the SQL Server tools. Instead, add folders to the service configuration file to let the local Integration Services service manage packages on the SQL Server 2005 instance.


------------------------------
BUTTONS:

OK
------------------------------

Oracle Database Migration from mySql

$
0
0

Hi sir, This sounds stupid but. is there a way that I can set Bigtree DB in the Oracle Database instead of mySql? Because our server is using Oracle DB as a standard. And is there a way that I can migrate from localhost db to Oracle without messing up my data and set up of Bigtree?

latest technology updates in electronics 

Is there a recommended way to migrate a 2012 SSISDB to a 2017 SQL server?

$
0
0

Hello,

I have an SSISDB catalog ( with a couple hundred packages), on a SQL Server 2012 that I want to migrate a newly built 2017 SQL Server (with SSIS, and a fresh and still empty SSISDB catalog).

Of course, I do not wish to redeploy the 200 packages t the new server.

Is there a sure way (steps ?) of doing this migration ?

So far the few migration trial I attempted (using Backup & Restore of both the SSISDB database and its Master Key) failed:

While SSISDB database is on CL 140, the Catalog Properties show a Schema Build of 11.0.7462.6 (of the source server)

The "Database Upgrade" wizard (invoked from Integration Services Catalogs by right clicking SSISDB) fail with the following error:

Microsoft SQL Server Management Studio -- The system cannot find the file specified (System), etc...

Executing

use SSISDB

exec catalog.check_schema_version @use32bitruntime = 0 --- or 1

shows the following error:

Msg 27222, Level 16, State 1, Line 7

The required components for the 64-bit edition of Integration Services cannot be found. Run SQL Setup to install the required components

Msg 6522, Level 16, State 1, Procedure internal.check_schema_version_internal, Line 0 [Batch Start Line 6]

A .NET Framework error occurred during execution of user-defined routine or aggregate "check_schema_version_internal"

[……]

and trying to run any of the packages failed with the above error

I ran SQL Setup  to repair the SQL install. that did not fix the problem

I un-installed SSMS then installed a new version (18.1), but that too did not fix the problem.

Any help resolving this issue is greatly appreciated.

Thanks


Visual Studio 2017(DDST) Parent Package calls child package Out Of Process, child package sets variable in child package results in error

$
0
0

error:

Error: 0xC00220EC at Execute Package Task: Error 0x80040154.

Failed to create an instance of empty child package. The Distributed Component Object Model (DCOM) configuration

or the installation of SQL Server Integration Services, may be corrupted on your machine.

Error: 0xC0022102 at Execute Package Task: Error 0x80040154 while executing package from project reference

package "Package2.dtsx". Class not registered.

Task failed: Execute Package Task

link to sample: https://send.firefox.com/download/7eaae6cff34ec912/#UFzSgFDisNII4On-T87Kfg

When executing packag1.dtsx (using the Data Tools for VS 2017) the above failure is generated. When reproducing this using Data Tools which was included with SQL Server 2012 the package works correctly. How can I resolve the error?

How to check sql connection in ssis package

$
0
0

Hi

I want checking  sql server connection before run query and execute task. how can i check it?

thanks

Is a CTE the way to go ?

$
0
0

I am trying to pull data from our address file which has ~400K records.

The below image shows part for one street in that table, MinSt/MaxSt are the address number.  The street in this example goes from one city to the other multiple times.

I can group the data as such but that is the Min and Max Street number for the WHOLE street (Grouped by City), this is not what I need:

The output I desire would be as such, so there would be a record for each instance as it goes in and out of a city.  This would be taking the data from the first image above and presenting it like so:

I have been trying to use a CTE

	CREATE TABLE #tmpTable
	(
		[StNumberMin] [int] NULL,
		[StNumberMax] [int] NULL,
		[PreMod] [nvarchar](20) NULL,
		[PreDir] [nvarchar](20) NULL,
		[PreType] [nvarchar](50) NULL,
		[Separator] [nvarchar](50) NULL,
		[Name] [nvarchar](75) NULL,
		[PostType] [nvarchar](50) NULL,
		[PostDir] [nvarchar](20) NULL,
		[PostMod] [nvarchar](20) NULL,
		[City] [nvarchar](50) NULL,
		[State] [nvarchar](2) NULL,
		[Zip] [nvarchar](5) NULL
	);

	WITH Addresses_ALL
	(
		[StNumberMin]
		,[StNumberMax]
		,[PreMod]
		,[PreDir]
		,[PreType]
		,[Separator]
		,[Name]
		,[PostType]
		,[PostDir]
		,[PostMod]
		,[City]
		,[Zip]
	)
	AS
	(
	SELECT 
		[StNumber]
		,[StNumber]
		,[PreMod]
		,[PreDir]
		,[PreType]
		,[Separator]
		,[Name]
		,[PostType]
		,[PostDir]
		,[PostMod]
		,[City]
		,[Zip]
	FROM [pubgis].[dbo].[TRANS_ADDRESSPOINTS]
	GROUP BY PreMod, PreDir, Pretype, Separator, Name, PostType, PostDir, PostMod, StNumber, [City], [Zip]

	)
	INSERT INTO #tmpTable
	(
		[StNumberMin]
		,[StNumberMax]
		,[PreDir]
		,[PreType]
		,[Name]
		,[PostType]
		,[PostDir]
		,[PostMod]
		,[City]
		,[Zip]
	)
	SELECT 
		MIN([StNumberMin])
		,MAX([StNumberMax])
		,[PreDir]
		,[PreType]
		,[Name]
		,[PostType]
		,[PostDir]
		,[PostMod]
		,[City]
		,[Zip]
	FROM Addresses_ALL
	GROUP BY PreDir, PreType, Name, PostType, PostMod, PostDir, City, Zip
	ORDER BY Name, PostType, City

	SELECT * FROM #tmpTable

	DROP TABLE #tmpTable

Would a CTE be the way to go with this ?  If not, what would the preferred method be ?

Thank you !

Unable to parse the CSV File

$
0
0

Hello,

I am trying to import the CSV file to SQL Server database. Below is how the preview looks like -

The column RPMCustom has CRLF demiliter but due to the quotes I think it gives me a one long string. When I try to import this as it is , it gives me an error-

[Flat File Source [31]] Error: The column delimiter for column "RPM_custom " was not found.

The second column should be able to return as multiple rows for same Computer name. For example , computer name b0600120085 should have multiple rows of RPMcustom.

Please help



Unicode Issues with Attunity Drivers for Oracle

$
0
0
Hi -

I am trying to do a data transfer from SQL Server to Oracle . In the data transfer task , I am using "OLE DB source " for SQL Server and using Attunity Oracle destination for Oracle database.
Here is the source table in SQL Server .

CREATE TABLE [dbo].[t_test](
    [FVersion] [nvarchar](25) NULL,
    [R_ID] [nvarchar](15) NULL,    
    [TEM] [nvarchar](10) NULL
    
)

Here is the destiantion table in Oracle .

CREATE TABLE t_test(
    FVersion nvarchar2(25) NULL,
    R_ID nvarchar2(15) NULL,    
    TEM nvarchar2(10) NULL
)


When I run the data transfer task , I am getting the following message . Please advise.



Error at Data Flow Task [OLE DB Source [1]]: Column "FVersion" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [OLE DB Source [1]]: Column "R_ID" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [OLE DB Source [1]]: Column "TEM" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [SSIS.Pipeline]: "component "OLE DB Source" (1)" failed validation and returned validation status "VS_ISBROKEN".

Error at Data Flow Task [SSIS.Pipeline]: One or more component failed validation.

Error at Data Flow Task: There were errors during task validation.

 (Microsoft.DataTransformationServices.VsIntegration)

------------------------------
Program Location:

   at Microsoft.DataTransformationServices.Project.DataTransformationsPackageDebugger.ValidateAndRunDebugger(Int32 flags, DataWarehouseProjectManager manager, IOutputWindow outputWindow, DataTransformationsProjectConfigurationOptions options)
   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchDtsPackage(Int32 launchOptions, ProjectItem startupProjItem, DataTransformationsProjectConfigurationOptions options)
   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchActivePackage(Int32 launchOptions)
   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchDtsPackage(Int32 launchOptions, DataTransformationsProjectConfigurationOptions options)
   at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.Launch(Int32 launchOptions, DataTransformationsProjectConfigurationOptions options)

Is there a recommended way to migrate a 2012 SSISDB to a 2017 SQL server?

$
0
0

Hello,

I have an SSISDB catalog ( with a couple hundred packages), on a SQL Server 2012 that I want to migrate a newly built 2017 SQL Server (with SSIS, and a fresh and still empty SSISDB catalog).

Of course, I do not wish to redeploy the 200 packages t the new server.

Is there a sure way (steps ?) of doing this migration ?

So far the few migration trial I attempted (using Backup & Restore of both the SSISDB database and its Master Key) failed:

While SSISDB database is on CL 140, the Catalog Properties show a Schema Build of 11.0.7462.6 (of the source server)

The "Database Upgrade" wizard (invoked from Integration Services Catalogs by right clicking SSISDB) fail with the following error:

Microsoft SQL Server Management Studio -- The system cannot find the file specified (System), etc...

Executing

use SSISDB

exec catalog.check_schema_version @use32bitruntime = 0 --- or 1

shows the following error:

Msg 27222, Level 16, State 1, Line 7

The required components for the 64-bit edition of Integration Services cannot be found. Run SQL Setup to install the required components

Msg 6522, Level 16, State 1, Procedure internal.check_schema_version_internal, Line 0 [Batch Start Line 6]

A .NET Framework error occurred during execution of user-defined routine or aggregate "check_schema_version_internal"

[……]

and trying to run any of the packages failed with the above error

I ran SQL Setup  to repair the SQL install. that did not fix the problem

I un-installed SSMS then installed a new version (18.1), but that too did not fix the problem.

Any help resolving this issue is greatly appreciated.

Thanks

SSIS timing execution packages

$
0
0

Hi guys,

I have a SSIS package, and have been deployed to SSMS, customers hope that through some simple methods to regularly perform these packages, such as time, every day or on the same day of each month the same time, we have been able to use the Agent Job to implement this functionality. As stupid as it sounds, but anyone can provide a more simple way? I would appreciate any useful information and steps.

JZ


Upgrading the SSIS from 2005 to higher versions

$
0
0

Hi All,

I need to upgrade SSIS 2005 version to higher to deploy to new server.

Came to know from forums that PackageFormatVersion is 2  stands for 2005 version 

<DTS:Property DTS:Name="PackageFormatVersion">2</DTS:Property>

I have SSDT tools 2010 installed on my machine .

I have below queries on the upgrade.

1, If I create a new solution in ssdt 2010 and add this 2005 package and save build is enough to upgrade.

2, in current environment where the package is running is   E:\package and config is also in the same folder. 

3, how do I point to new server config file if its is D: or F drive  

or

4,  will it automatically read the config file if I place it in the folder where .dtsx file is also placed

5, Currently its executing the below command is placed in .bat file and it is triggered via control-m scheduler

    dtexec /F "%folder%\Inventory\Products.dtsx" > "%folder%\Inventory\Products.log"
:ExitRoutine

 Can we explicitly mention the config file also here in the above command

Thanks in Advance.

Use CSOM to add values to Microsoft Project Server Lookup table

$
0
0

Hi everyone.  Hope this finds you well. Some background:  I have a requirement to integrate Microsoft Project Server (MPS) with a Project Management tool and send data from the PM tool to MPS.  The project data will be utilized as drop-down values in a Lookup Table.  From my understanding, writing data to MPS is done through the CSOM.  

Question:  

Can anyone provide guidance how to use the CSOM for Lookup table manipulation, i.e. inserting/deleting lookup values?  Do you have code that can be shared?

Thanks everyone.  Please let me know if there are questions.  Appreciate any assistance.

Hans 




SSIS solution deployment error

$
0
0

Hi,

While deploying my ssis Solution, I get the below error.

--------------------------------------------------------------------------------------------------

A .NET Framework error occurred during execution of user-defined routine or aggregate "deploy_project_internal": 
System.ComponentModel.Win32Exception: A required privilege is not held by the client
System.ComponentModel.Win32Exception: 
   at Microsoft.SqlServer.IntegrationServices.Server.ISServerProcess.StartProcess(Boolean bSuspendThread)
   at Microsoft.SqlServer.IntegrationServices.Server.ServerApi.DeployProjectInternal(SqlInt64 deployId, SqlInt64 versionId, SqlInt64 projectId, SqlString projectName)
. (Microsoft SQL Server, Error: 6522)

---------------------------------------------------------------------------------------------------


this issue occur very frequently (almost every week)  

The Only solution i see is Repair the SQL instance using SQL setup. 

Is there a permanent solution to this.

SSIS Package: Move files from One to another two folders.

$
0
0

Hi - Need your help in this. Below is the scenario : 

1. I have got of files with the format (Name_ID_PatientID_currenttimestamp.pdf), these files are generated daily. Highlighted yellow is the PatientID in the file. these files are in Folder A

2. I also save these filenames and Patient ID in a SQL table. 


3. Now, I want to Match with the Patient ID in SQL table with the Patient ID (Name_ID_PatientID_currenttimestamp.pdf) in Folder A and move these files to Folder B and Folder C. 

How do i do that ? Is it possible ? Thank you in advance

SSIS Package: Match by ID in table and move files from One to another two folders.

$
0
0

Hi - Need your help in this. Below is the scenario : 

1. I have got of files with the format (Name_ID_PatientID_currenttimestamp.pdf), these files are generated daily. Highlighted yellow is the PatientID in the file. these files are in Folder A

2. I also save these filenames and Patient ID in a SQL table. 


3. Now, I want to Match with the Patient ID in SQL table with the Patient ID (Name_ID_PatientID_currenttimestamp.pdf) in Folder A and move these files to Folder B and Folder C. 

How do i do that ? Is it possible ? Thank you in advance


Viewing all 24688 articles
Browse latest View live