hello,
May I know how can I connect SSIS 2005 to Progress database?
↧
SSIS to progrss DB connection
↧
Integrating WCF web services in script task
I have tried so many different ways to integrate my WFC web services into and SSIS script task, I have tried importing my DLL as well as adding a web service reference and I am not able to get it to work. dos some have a full working example they <g
class="gr_ gr_238 gr-alert gr_gramm Grammar multiReplace" data-gr-id="238" id="238">be</g> willing to share. I know my services are working since I created a quick windows form application and I was able to connect and
execute the web services. the part that I am most concerned about is how do I implement the configuration settings that I specify on my app.config (services.serviceMode><client> <binding> etc... ) I tried to implement a binding on my <g
class="gr_ gr_653 gr-alert gr_spell ContextualSpelling ins-del multiReplace" data-gr-id="653" id="653">ssis</g> script task but no luck. Thanks in advance.
↧
↧
Lookup takes forever in pre-execute state
I'm trying to load data incrementally where Lookup to used to compare if the record is present in destination or not. I have about 100000 rows coming from sources and lookup has destination table which has about 88 million records in it.
The problem I get here is I get the below information
[Incremental Load Check [59]] Information: The number of unique rows added to the cache is 88992271.
and it takes forever to start the execution phase.
I don't understand why it hangs there for so long and fyi: the column which is used to lookup doesn't have index.
Any help is appreciated, Thanks!
sree
↧
SSIS Data Transfer says nnnn rows copied, but count on table is less?
I've a SSIS 2008 parent/child package solution to manage data transfers between two different data sources, so we can copy multiple tables and capture how many rows were transferred and duration for each transfer. This solution was working
fine up until last week, when I made some changes to allow the package to perform a source count using standard SQL determined by an expression, or SQL provided from configuration tables, I also changed the package to Truncate or not the destination table,
again controlled by configuration settings in a table. The child packages which perform the data flows have not changed!
The day after the controlling package promotion to live, I saw the bizarre behaviour of the Package log stating all rows transferred, but the actual table counts were not what the log stated, see attached file. The package solution works ok on other servers and was ok in DEV, but there were less tables and rows transferred.Re-running the package gave the same errors, but on some of the same tables and some different ones.
As it is the child packages doing the transfers and nothing has changed in them, has anyone got any ideas how this could possibly happen? I cannot see how the log would be able to say all rows are transferred and yet not all of the rows are actually moved???
If you need anything further please let me know as this has me well and truly baffled...
Process output - where you can see counts and log
Table transfer controller (as txt not dtsx)
•An example of the data transfer child packages (as txt not dtsx)
When I set the ExecuteOutOfProcess = True the package worked fine, unfortunately, this is not a good solution as SSIS 2008 does not tidy up the Dtshost.exe processes it starts and I'd be left with a memory issue after a very short time, we transfer hundreds of tables each day. ( I could write a .net script in the controlling package to kill the child processes, but that would still have hundreds of processes running before I could end them, as we have three parallel streams to allow a bit better performance.
If anyone has any ideas please let me know.
regards,
Anthony
↧
How to update multiple single Excel cells using SSIS
I have created an SSIS package which processes daily financial information to a sql server database. These processes are to be outputted to excel spreadsheets to a readable report format for management to review. Some of these reports are laid out in a way that is not just tabular output but requires customized placement of data on an excel spreadsheet to specific cells. I am able to place an initial resultset of a query output from the database in a tabular excel template through SSIS but the issue is at the end of that placement in the spreadsheet I am required to place another output below that tabular output in a different format from the initial output which I have shown below. Attached I have an example of what one of the excel reports should look like.
↧
↧
selecting common column from multiple sheet and inserting in single Table
Dear All,
in below figure you can see that there are 4 diffrent excel source file
every excel sheet have emp,date,project and process common column
| EXCEL1 | EXCEL2 | EXCEL3 | EXCEL4 |
| emp | loc | CUST | NAT |
| date | emp | PROJECT | EMP |
| project | ggg | PROCESS | TARGT |
| process | project | DATE | DATE |
| abc | date | ASDD | PROCES |
| xyz | process | EMP | PROJECT |
| MMM |
|
I am looking instead of creating a source table for each excel sheet to select common column from all excel shhet and insert into common destiination table
Regards,
Vipin jha
Thankx & regards, Vipin jha MCP
↧
Script Component WebService Binary code for the script is not found
I am using SSIS 2012 to access a Public Web Service
http://marketinformation.natgrid.co.uk/MIPIws-public/public/publicwebservice.asmx
However, when adding reference to WebService (not Service Reference),
I receive the dreaded msg "Binary code for the script is not found"
I have spent an age ploughing through the forums.
Many replies seem to suggest not using Script Component to acces WebService.
Should I write a .NET app ?
Any thoughts how I should proceed would be most welcome.
thanks JohnJames
↧
Importing XLS Files in HTML Format using SSIS
I have a requirement to import two .xls files into SSIS. Here are my constraints:
1. These .xls files are actually HTML-formatted files. They are created via a "Save As" function from a web report. Save as .xls is the only option. This cannot be changed.
2. Once saved from the web report, the .xls file cannot be manually saved as another format, such as Excel 97-2003 or csv. This is a rule that also cannot be changed.
I have no experience with VBA or another other type of scripting. Can someone please help? I'm using SQL Server 2012, Windows Server 2008 R2.
Thank you!
↧
Expressions not working after exiting a Sequence Container
I have an SSIS package that is pretty simple.
An Execute SQL task returns one row with two values that are correctly stored into variables.
Based off those two variables, a sequence container is chosen to execute.
That sequence container then does magic. The last step of the container has an execute SQL task that runs and stores the result in a variable - let's call this[User::result] with type Int32.
Based off the value in [User::result] one of two final tasks run. A non zero value executes one task; a zero value executes another. Basically,SOMETHING runs after this.
Simple? I thought so... except Step 4 doesn't work. If I set a post-execute breakpoint on the sequence container, the variables are populated as expected, but nothing else runs. If I add another task to run (without a conditional expression) to run after the sequence container completes, the pre-execute breakpoint shows the data looking exactly as I expect.
This got me really stumped. So I built a simplified package. I can't directly link to it at this time, but you can see it here: imgur com / 6gta10s
Those script tasks are just MessageBox.Show calls and the expression, as you can see, doesn't use variables at all. Am I dealing with a bug or something really really stupid?
↧
↧
Sending More than one recepients in To and Cc using Script Task
Hi,
I able to send mail with HTML body format using script task, but i am not able to send more than one recipients with the below code. Kindly provide solution to achieve this task with the below code.
/*
Microsoft SQL Server Integration Services Script Task
Write scripts using Microsoft Visual C# 2008.
The ScriptMain is the entry point class of the script.
*/
using System;
using System.IO;
using System.Data;
using Microsoft.SqlServer.Dts.Runtime;
using System.Windows.Forms;
using System.Net.Mail;
using System.Net;
namespace ST_b28025465e064c28a92afa59da1b0075.csproj
{
[System.AddIn.AddIn("ScriptMain", Version = "1.0", Publisher = "", Description = "")]
public partial class ScriptMain : Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTARTScriptObjectModelBase
{
#region VSTA generated code
enum ScriptResults
{
Success = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Success,
Failure = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Failure
};
#endregion
/*
The execution engine calls this method when the task executes.
To access the object model, use the Dts property. Connections, variables, events,
and logging features are available as members of the Dts property as shown in the following examples.
To reference a variable, call Dts.Variables["MyCaseSensitiveVariableName"].Value;
To post a log entry, call Dts.Log("This is my log text", 999, null);
To fire an event, call Dts.Events.FireInformation(99, "test", "hit the help message", "", 0, true);
To use the connections collection use something like the following:
ConnectionManager cm = Dts.Connections.Add("OLEDB");
cm.ConnectionString = "Data Source=localhost;Initial Catalog=AdventureWorks;Provider=SQLNCLI10;Integrated Security=SSPI;Auto Translate=False;";
Before returning from this method, set the value of Dts.TaskResult to indicate success or failure.
To open Help, press F1.
*/
public void Main()
{
// TODO: Add your code here
string errorMsg = Dts.Variables["User::msg"].Value.ToString();
string EmailMsgBody = String.Format("<HTML><BODY><P>{0}<br></BODY></HTML>",
errorMsg);
bool ishtml = true;
string from = Dts.Variables["User::from"].Value.ToString();
//string to = "gurumoorthym@frost.com;gopalb@frost.com";
string to = Dts.Variables["User::to"].Value.ToString();
//Mail.To.Add(to);
string subject = Dts.Variables["User::subject"].Value.ToString();
string server = "servername";//Dts.Variables[?ServerAddress?].Value.ToString();
SendMailMessage(to, from, subject, EmailMsgBody, ishtml, server);
Dts.TaskResult = (int)ScriptResults.Success;
}
private void SendMailMessage(string SendTo, string From, string Subject, string Body, bool IsBodyHtml, string Server)
{
MailMessage htmlMessage;
SmtpClient mySmtpClient;
htmlMessage = new MailMessage(SendTo,From, Subject, Body);
htmlMessage.IsBodyHtml = true;
mySmtpClient = new SmtpClient(Server);
mySmtpClient.Credentials = CredentialCache.DefaultNetworkCredentials;
mySmtpClient.Send(htmlMessage);
}
}
}
↧
Can Sequence Container have multiple Checkpoints
Hi Experts,
I have a sequence container in my Package and this sequence has more than one control flow tasks.
Can I create the checkpoints such that only the failed component inside the sequence container runs again and not the other successful components/tasks in the sequence container?
Regards,
Shyam.
↧
Parallel processing in SSIS 2012, how can we avoid deadlock for log table.
Hi All,
Parallel processing in SSIS 2012, how can we avoid deadlock for log table.
for example- i load customer ,product , geography master in Parallel , when these task completed on same time and try to write log information in single table and chance of deadlock .
please help me in how to achieve in SQL server 2012.
Regards,
Manish
↧
script task error
Dear
I am using script task to get files from remote system.
I am using System.IO.Directory.GetFiles(folderlocation);
I am getting error "Logon failure: Unknown username or bad password"
I am able to succeed if the target folder has permission on my account but I can't use my credentials.
We have specific domain account which we need to use.
I am not sure how can I supply credentials(UserName, Password, Domain) and use GetFiles() without failure.
Could you please reply
Thanks in advance
↧
↧
Assign Variables to Multiple Table Resutls from Stored Procedure in C#
If I have a stored procedure that returns 15 tables, how do I distinguish the tables to assign variables to each table in c#?
↧
Can't install SSDT-BI on Windows 10
Hi,
I upgraded my notebook to Windows 10 and now I can't install SSDT-BI anymore.
This is the error that I'm getting, looking at the log file that is generated:
i000: MUX: Stop Block: CompatibilityMode : Windows Program Compatibility mode is on. Turn it off and then try Setup again.
Log file name is VSIntShell2013_Cpu32_1.log
The setup file is not on compatibility mode and I'm using the last version that was available.
filename: SSDTBI_x86_ENU.exe
It fails every time that I try to run the install, always on the VSIntShell203_Cpu32 step.
Can anybody help me, please?
Thanks
↧
Preparing to access the Catalog object takes a long time - INSERT INTO @t_catalogs VALUES("SSISDB"
Hello all,
We have a SSIS 2012 integration running for a few days now (18 packages running periodically). Initially it was fast but now is extremely slow. We are using a 8 days retention period and the jobs runs smoothly every day. We are running sql 2012 with SP2.
We have performed some traces and we detected that the following exec can take up to 9 minutes to complete.
Any thoughts?
Thanks for the help
exec sp_executesql N'
--Preparing to access the Catalog object
DECLARE @t_catalogs TABLE (
Name sysname COLLATE SQL_Latin1_General_CP1_CI_AS,
EncryptionAlgorithm nvarchar(256) COLLATE SQL_Latin1_General_CP1_CI_AS,
SchemaVersion int,
SchemaBuild nvarchar(256) COLLATE SQL_Latin1_General_CP1_CI_AS,
OperationLogRetentionTime int,
MaxProjectVersions int,
OperationCleanupEnabled bit,
VersionCleanupEnabled bit,
ServerLoggingLevel int,
OperationLogNumberOfRecords int,
VersionLogNumberOfRecords int)
IF DB_ID(''SSISDB'') IS NOT NULL
BEGIN
INSERT INTO @t_catalogs VALUES(
''SSISDB'',
(SELECT [property_value] FROM [SSISDB].[catalog].[catalog_properties] WHERE [property_name] = N''ENCRYPTION_ALGORITHM''),
(SELECT CAST([property_value] AS INT) FROM [SSISDB].[catalog].[catalog_properties] WHERE [property_name] = N''SCHEMA_VERSION''),
(SELECT [property_value] FROM [SSISDB].[catalog].[catalog_properties] WHERE [property_name] = N''SCHEMA_BUILD''),
(SELECT CAST([property_value] AS INT) FROM [SSISDB].[catalog].[catalog_properties] WHERE [property_name] = N''RETENTION_WINDOW''),
(SELECT CAST([property_value] AS INT) FROM [SSISDB].[catalog].[catalog_properties] WHERE [property_name] = N''MAX_PROJECT_VERSIONS''),
(SELECT CAST([property_value] AS BIT) FROM [SSISDB].[catalog].[catalog_properties] WHERE [property_name] = N''OPERATION_CLEANUP_ENABLED''),
(SELECT CAST([property_value] AS BIT) FROM [SSISDB].[catalog].[catalog_properties] WHERE [property_name] = N''VERSION_CLEANUP_ENABLED''),
(SELECT CAST([property_value] AS INT) FROM [SSISDB].[catalog].[catalog_properties] WHERE [property_name] = N''SERVER_LOGGING_LEVEL''),
(SELECT COUNT(operation_id) FROM [SSISDB].[catalog].[operations]),
(SELECT COUNT(object_id) FROM [SSISDB].[catalog].[object_versions])
)
END
SELECT
''IntegrationServices[@Name='' + quotename(CAST(SERVERPROPERTY(N''Servername'') AS sysname),'''''''') + '']'' + ''/Catalog[@Name='' + '''''''' + REPLACE((SELECT Name from @t_catalogs), '''''''', '''''''''''') + '''''''' + '']'' +
''/CatalogFolder[@Name='' + '''''''' + REPLACE(folders.[name], '''''''', '''''''''''') + '''''''' + '']'' AS [Urn],
folders.[folder_id] AS [FolderId],
folders.[name] AS [Name],
folders.[description] AS [Description],
folders.[created_by_sid] AS [CreatedBySid],
folders.[created_by_name] AS [CreatedByName],
CAST (folders.[created_time] AS datetime) AS [CreatedDate]
FROM
[SSISDB].[catalog].[folders] AS folders
WHERE
((SELECT Name from @t_catalogs)=@_msparam_0)and((CAST(SERVERPROPERTY(N''Servername'') AS sysname)=@_msparam_1))',N'@_msparam_0 nvarchar(4000),@_msparam_1 nvarchar(4000)',@_msparam_0=N'SSISDB',@_msparam_1=N'WIN2012R2\TST'
↧
Email PriorityValues in SSIS
Hi,
Send Mail has priority values as Normal, Low and High. How do I translate this to integer values? I am creating a custom Send Mail script and would like to assign the email priority.
Thanks!
↧
↧
Connect to INformix DB via SSIS
Hi,
I want to connect to an Informix Database via SSIS to read and store data. I did some search online and have downloaded Informix ODBC Drivers. I installed the drivers and am trying to configure a System DSN but have few doubts on what each field indicate. I am following the blog https://thedailydba.wordpress.com/2013/12/16/how-to-connect-to-informix-from-an-ssis-package/. I am not sure on what to enter in fields like IBM Informix Server, Service Name? Does anyone have experience in connecting to Informix DB via SSIS?
Thanks,
Gayatri
↧
SSIS Package Deployment (file to file)
We need to deploy our SSIS packages to file from our DEV machine to our PROD machine.
Information on this is very confusing.
Currently in DEV, we are executing the packages using a Windows Service program with a Package and passing the file path of the .dtsx.
D:\Dev\MySSISPackage.dtsx
To deploy to our PROD machine, do we simply copy the dtsx files to our chosen directory on the PROD machine?
D:\Prod\MySSISPackage.dtsx
And then update our Windows Service program with the new path before we deploy it?
↧
Cannot remote connect to 2012/2014 SSIS Server
The following error occurred when trying to connect to 2012/2014 SSIS Server using SSMS remotely. Local connection works fine.
Using the info from below link does not resolve the problem. Permissions are granted through DCOM. If this cannot be resolved, packages will have to stored on filesystem instead.
http://www.ssistalk.com/2012/03/21/connecting-to-a-pre-sql-2012-ssis-instance-with-sql-2012-ssms/
Connecting to the Integration Services service on the computer "" failed with the following error: "Class not registered". This error can occur when you try to connect to a SQL Server 2005 Integration Services service from the current version of the SQL Server tools. Instead, add folders to the service configuration file to let the local Integration Services service manage packages on the SQL Server 2005 instance.
↧