Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SQL Server data tools in visual studio 2015

$
0
0

I'm trying to create an SSIS package to import xml data file into sql server table. I have sql server 2008 R2 and visual studio professional 2015 on Windows 10 machine. In VS Help About I can see SQL Server Data Tool 14.0.50730.0. I did an update via control panel just to be sure and the help list stayed the same. From loads of searching I'm guided to use New Project / Templates / Other Languages / Sql data tools - but this does not appear. Nearest I get is SQL Server/Sql Database project. SSDT does not appear in my start menu program list

How do I find and run sql server data tools so I can create a package?


Retrieving Data automatically from external Web in Excel

$
0
0

Hi,

I am using a link to retrieve data from the web, which is a table with 6 columns updated on a daily basis. I am further using this excel to load data using SSIS to my tables.

In order for the data in the excel to be updated daily, I need to manually open the excel and refresh the data. Is there any option to automatise this process of downloading data from the web server and update it in excel on a daily basis?

I saw an example on how to update the data when excel is open. But I would like to know the update process when the excel is closed which is suitable for the import process and for a long run the excel cannot remain open all the time.



Data Formats not static

$
0
0

I have a SQL backend database that is regularly updated using Excel Spreadsheets.

Once a month we download data from various sources, manipulate it a bit then load it into the SQL database using Integration Services...things usually work well, except sometimes Excel will change the data types from numeric or date to text.

Just today I exported the contents of a table to Excel using Tasks, made a change in only 1 column, then tried to load it back in and all of the data in all of the columns had changed to text.

How do I retain the formatting so I don't have to go through each column and change it to the correct format...sometimes that doesn't retain either.

Thank you in advance for any help you can give me.


Gee

How to start the Package from where it got failed in SSIS

$
0
0

Hi Friends,

Can any one please help me on the below scenario in SSIS,

How to start the Package from where it got failed in SSIS.

Thanks,

LuckyAbdul

Accessing a secure UNC path within SSIS File System Task

$
0
0
I have a simple SSIS package that I have converted from DTS.  It simply loads a flat file from a UNC share and imports the file into a table.  The problem is that in the DTS package, there is a .bat file that need to be deployed using the net use * command with credentials so that the path is authenticated to and then dropped at the end of the DTS package, this is unacceptable in SSIS at my project.  I am curious to know if there is a way to use file system task, copy file to pull the data locally to my database server so the import will work.  I am not able to authenticate at all without using the net use .bat method which is not acceptable in my situation.  I have tried executing as a proxy account that has access to the share but it keeps telling me that I don't have access to the share when in fact I can access the share via Windows Explorer.  Any ideas?

ORACDC302I: The Oracle CDC instance for service OracleCDCService and database db received a stop signal.

$
0
0

Hi

I run CDC mechanism two weeks ago and it worked fine up till yesterday.

Suddenly it stopped and after rerun I get information in log:

ORACDC302I: The Oracle CDC instance for service OracleCDCService and database db received a stop signal.

Below is whole log after run.

timestamp	type	node	status	sub_status	status_message	source	text_data
2015-12-07 08:31:38.6450000	INFO	bru-wpsa01	STOPPED	STOP	ORACDC301I:The Oracle CDC instance for service OracleCDCService1_TUPLOK_PROD and database DWH_TUPLOK stopped.	service	NULL
2015-12-07 08:31:38.6340000	TRACE	bru-wpsa01	RUNNING	IDLE	ORACDC000T:** Debug / Announce input parameters. **
 at: 'oracle_source_free(...)'	source	NULL
2015-12-07 08:31:38.6280000	TRACE	bru-wpsa01	RUNNING	IDLE	ORACDC000T:** Debug / Announce input parameters. **
 at: 'oracle_source_free(...)'	source	NULL
2015-12-07 08:31:38.4241000	TRACE	bru-wpsa01	RUNNING	IDLE	ORACDC000T:Thread(1) - Start log miner session	source	    begin
    SYS.DBMS_LOGMNR.START_LOGMNR(
        startScn => 13985380,
        endScn => 13985580
    );
    end;
2015-12-07 08:31:38.4231000	TRACE	bru-wpsa01	RUNNING	IDLE	ORACDC000T:Redo log: /u01/oradata/BRUS/redo01.log, Sequence: 1570	source	NULL
2015-12-07 08:31:38.4191000	TRACE	bru-wpsa01	RUNNING	IDLE	ORACDC000T:Adding redo logs to log miner session.	source	NULL
2015-12-07 08:31:38.3181000	TRACE	bru-wpsa01	RUNNING	IDLE	ORACDC000T:Retrieving current SCN	source	NULL
2015-12-07 08:31:38.2220000	INFO	bru-wpsa01	RUNNING	IDLE	ORACDC302I:The Oracle CDC instance for service OracleCDCService1_TUPLOK_PROD and database DWH_TUPLOK received a stop signal.	service	NULL
2015-12-07 08:31:38.2201000	TRACE	bru-wpsa01	RUNNING	IDLE	ORACDC000T:Oracle CDC Merger was allocated	source	NULL
2015-12-07 08:31:38.2181100	TRACE	bru-wpsa01	RUNNING	IDLE	ORACDC000T:Oracle CDC Capture start	source	NULL
2015-12-07 08:31:38.2180000	TRACE	bru-wpsa01	RUNNING	IDLE	ORACDC000T:Retrieving current SCN	source	NULL
2015-12-07 08:31:38.2170000	TRACE	bru-wpsa01	RUNNING	INIT	ORACDC000T:** Debug / Announce input parameters. **
 at: 'oracle_source_set_stream(...)'	source	NULL
2015-12-07 08:31:38.0940000	TRACE	bru-wpsa01	RUNNING	INIT	ORACDC000T:** Debug / Announce input parameters. **
Prepare
 at: 'oracle_source_prepare(...)'	source	NULL
2015-12-07 08:31:38.0930000	TRACE	bru-wpsa01	RUNNING	INIT	ORACDC000T:** Debug / Announce input parameters. **
Component Type:
Component Name:
 at: 'oracle_source_allocate(...)'	source	NULL
2015-12-07 08:31:35.7530000	TRACE	bru-wpsa01	RUNNING	INIT	ORACDC000T:** Debug / Announce input parameters. **
Prepare
 at: 'oracle_source_prepare(...)'	source	NULL
2015-12-07 08:31:35.7520000	TRACE	bru-wpsa01	RUNNING	INIT	ORACDC000T:** Debug / Announce input parameters. **
Component Type:
Component Name:
 at: 'oracle_source_allocate(...)'	source	NULL
2015-12-07 08:31:35.7240000	INFO	bru-wpsa01	RUNNING	INIT	ORACDC305I:The value of the option 'cdc_restart_limit' was changed to -1.	infrastructure	NULL
2015-12-07 08:31:35.7050100	INFO	bru-wpsa01	RUNNING	INIT	ORACDC300I:The Oracle CDC instance for service OracleCDCService1_TUPLOK_PROD and database DWH_TUPLOK started.	service	NULL

I tryed reset CDC service but the effect is the same. After next run I get the same information in log.

Ealier I have had such situation, I removed and installed again service CDC for Oracle by Attunity with different name, and this solved the problem. But now on the production environment I can't reinstall service by every two weeks.

Please give me any ideas becase I can't find any error, everything seems to be OK.


Regards 

RobAll

Problem running SFTP package through integration service catalog.

$
0
0

Hi all, 

I developed an SFTP package to download files from an SFTP server following the suggestions provided in here http://www.codeproject.com/Articles/845262/Using-WinSCP-and-SSIS-to-Download-files-from-SFTP.

I am able to run the package in dev machine through SSDT. But when I ran the package through integrated services catalog it fails and throws the error the process exit code was '1' while expected was '0'.

Please help me in solving this.

I executed this command on my dev machine gacutil.exe /i "C:\Program Files (x86)\WinSCP\WinSCPnet.dll". through command prompt before running this package.

How can I execute the command in the server using 'SSIS'. 

Or suggest me another method where I can download files from SFTP

Ganesh





How to get name of failed container in control flow

$
0
0

Hi

I have been trying to get a solution for last one week. I am pretty new to SSIS and am stuck in this issue.

1) My control flow runs OK. However, I have introduced a package level "OnError" event handler where I am using a Script task to get the name of container in Control Flow which failed and triggered this event handler. I am completely helpless on achieving this.

Or

2) Alternatively, I can also define a Script Task within the control flow and direct all other containers to flow to this if they error. But I dont know how to get the parent container name in this Script task.

Or

3) If nothing of the two works, then the only resort I have is to define a separate Script task for each container and hardcode the parent container name in it.

Could someone please help me in this.

Thanks in advance


manibest


package slow in child-parent design

$
0
0

Hello,

I have a simple package A that runs in 108 s

When i lunch a package B (Parent Package) that calls the package A whith an "Execute Package Task" (file system), the excution takes185s

logging shows that diagnostic take lot of time whith pre-excute requests

In visual studio debug, lunching the package A alone will make 2 validations ( Validation has started (2) ) : lunching the package B make3 validations

what do you think ? why the child-partent design take more time ?

Thanks for you help

How to execute external SSIS packages (installed in MSDB) and passing a parameter?

$
0
0

Hi

We are trying to upgrade an existing SSIS package that used to call another SSIS package via the file system.

Now we want to upgrade it so that it calls another SSIS package that is installed in sql server msdb.

Problem is we do not know how to pass a parameter, we used to do it like this:



I.W Coetzer

check outlook inbox folder

$
0
0

Hi,

How can ssis check for files received in the outlook inbox folder please?

thank you

How to start the Package from where it got failed in SSIS

$
0
0

Hi Friends,

I have 5 sequence containers, In 1 container we are using 10 Data Flow Tasks. How can i handle if any DFT failed it should start from the Data Flow only.

Note : I have used the DFT's to load the table in parallel not in sequential as it is independent .

Thanks in advance.

Thanks,

LuckyAbdul

SQL 2014 - VS2015 - Error 6522 - Deploy_Project_Internal - Cannot Deploy to SSIS Catalog

$
0
0

Hello and best wishes to All,

I am trying to Deploy a simple SSIS Package to an SSIS Catalog (SSISDB).  The following error has occurred within SSMS.

A .NET Framework error occurred during execution of user-defined routine or aggregate "deploy_project_internal":
System.ComponentModel.Win32Exception: A required privilege is not held by the client

I have tried so many things. 

  • Running SSMS as Admin
  • SSIS Domain Service Account in Local Admin
  • Dcomcnfg changes

Executing Process Monitor

Names Not Found ( Quite a Few)

HKCU\Software\Classes\Wow6432Node\CLSID\HexId

Help, how do I Deploy a SSIS Package to the SSIS Catalog?

Thank You Covi


Mark Covian

SSIS COM error object information is available. ADODB.Recordset 0x800A0BCD Either BOF or EOF is True, or the current record has been deleted. Requested operation requires a current record

$
0
0

Hi Guys,

When i use single object variable to pass it to two sequence container having 2 different  Foreach ADO Enumerator; seems like the scope of the variable is completed once sequence container 1 is done and second fails with below error

Foreach ADO Enumerator

Error: COM error object information is available.  Source: "ADODB.Recordset"  error code: 0x800A0BCD  Description: "Either BOF or EOF is True, or the current record has been deleted. Requested operation requires a current record.".

Does we have to set any property so that object variable scope persist until both loops are completed.

It works fine if i push the data to 2 different object variables.

Regards,

Navin


Navin.D http://dnavin.wordpress.com

SSIS package - tabletransfergenerator error

$
0
0

Hi all. would like get some expertise advice here. I have an SSIS packge that run on sql server 2005. and recently i migrate the package from 2005 to 2012. when run the package, it show the error as below, appreciate your advice 

error message: the task has failed to load. the contact information for this task is  "TableTransferGenerator Task"


Installing Integration Services in Existing Cluster

$
0
0

Dear Support

I need to install Integration Services in Existing sql 2012 Cluster. As per the below its possible

http://blogs.msdn.com/b/psssql/archive/2010/07/29/installing-sql-integration-services-after-sql-cluster-setup-has-completed.aspx

I need to know to answer for the below which is mentioned in the above link

"Don’t forget to alter you <ServerName>.\SQL2008</ServerName> property in the MsDtsSrvr.xml file to correctly point to your SQL virtual server name rather than the default “.\InstanceName” that is currently there."

Where I can find the file MSDtsSrvr.xml?

What I have to put in may case, my sql instance is Default "MSSQLSERVER" and my sql cluster name is "SQL".

Thanks in advance


Muhammad Faheem

Cannot insert Unicode into SQL Azure Database from Flat File Source

$
0
0

I have a project where I am using Python scripts to collect data from various API's (Google Analytics, Facebook, Instagram, etc). I write the collected data to a flat file, and then use SSIS to extract the data from a file, do some ETL work, and then insert into our Data Warehouse.

The issue I am having is with Unicode values, it looks like they might not be encoded/decoded correctly and a different character is being inserted into the database than what it really is. Here's the process involved:

I encode the data value and write to a file using the csv module:

import csv

with open('{0}{1}.txt'.format(file_path, file_name), 'ab+') as f:
    writer = csv.writer(f, delimiter='\t')
    try:
        writer.writerow(data['name'].encode('utf-8'))
    except Exception, ex:
        logging.exception(ex)

When I open the file in a text editor like Sublime Text, all of the unicode characters are being shown correctly.

Once all the data is done writing to a file, I start collecting it using SSIS. In SSIS, I have a Flat File Source Task that pulls in the data. I've defined the data type for the 'name' column in the connection manager as DT_WSTR(Length 4000). The code page for the flat file connection is 65001(UTF-8).

The destination database I am writing to is a SQL Azure Database with collation SQL_Latin1_General_CP1_CI_AS. The destination database column is defined as nvarchar(max). If I try to write to a regular SQL Server database with same collation, the result is the same.

What am I doing wrong here? There are lots of emoji type characters that I collect and don't care much about, what is important is accented and non-English characters. If I need to provide any more detail or anything else, please let me know.



Cannot run packages using Visual Studio 2012: Unable to start debugging.

$
0
0

We uninstalled SQL Server Data Tools for Business Intelligence for Visual Studio 2012, reinstalled the latest version,  repaired Visual studio installation, Visual Studio Update 5, none of them resolved this issue. We can run the same package from Visual Studio 2010 installed at the same machine but cannot run it from Visual Studio 2012 (we were able to, not sure what happened to it). Please advise

Thank you

TITLE: Microsoft Visual Studio
------------------------------

Unable to start debugging.
The debugger is not properly installed.
Run setup to install or repair the debugger.

------------------------------
ADDITIONAL INFORMATION:

Unable to start program 'DTS'.

The debugger is not properly installed.  Cannot debug the requested type of code.  Run setup to install or repair the debugger. (Microsoft Visual Studio Debugger)


Gokhan Varol



One SSIS package for multiple clients and one dtsconfig file manual edit for these clients

$
0
0

Hello,

I have a SSIS package file reads data from .csv files (multiple clients .csv locations) and writes to a database A (all clients writes to one table on this database).  I have one dtsconfig file for the package and I update/attach dtsconfig file for these multiple clients manually.

For eg I run package xyz for client A and database A table AB is updated in dtsconfig file for one client A

and run same package xyz for  Client B and database A table AB is updated in same dtsconfig for one client B manually.

Now if I want to schedule this job via sql agent how can I do that.

Can I add a step after package xyz run for client A and update dtsconfig file to set client B location in the sql agent step.

Thanks


SQL Killer

SSIS Packages Deploy and Execute with Windows Authentication or Sql Authentication

$
0
0

Hi

I have Created some SSIS packages , my first  question is to Deploy this package to Integration services catalogs   in SQL 2012  do I need windows authentication , Can I deploy this packages with SQL authentication.

My second question is How ever if I  deployed this packages to Integration services catalogs  Can I Execute this packages with Sql Authentication ? do I need Windows Authentication ?

Thank you 

Harsha 


Viewing all 24688 articles
Browse latest View live


Latest Images

<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>