Want to be the Microsoft TechNet SQL Server Guru for February 2017?

February 2, 2017, 9:29 am

≫ Next: importing tsv 200 columns, 500,000 rows

≪ Previous: Importing XML to SQL via SSIS

February 2017 Guru, it’s time to share great skills as a TechNet Wiki article and WIN medal(s). Medals? Yes, you can share multiple articles in the same or different categories! Now, navigate to TechNet Guru Competition February 2017 to choose your categories and if it’s not listed add your content in Miscellaneous Category!

All you have to do is add an article to TechNet Wiki from the field of your interest. Something that fits into one of the categories listed on the submissions page. Copy in your own blog post, a forum solution, a white paper, or just something you had to solve for your own day’s work today.

A snippet you share can make you a February 2017 TechNet Wiki Guru in your favorite category and this is official Microsoft TechNet recognition!

HOW TO WIN

1) Please copy over your Microsoft technical solutions and revelations to TechNet Wiki.
2) Add a link to it on THIS WIKI COMPETITION PAGE (so we know you’ve contributed).
3) Every month, we will highlight your contributions, and select a "Guru of the Month" in each technology.

If you win, we will sing your praises in blogs and forums, similar to the weekly contributor awards. Once "on our radar" and making your mark, you will probably be interviewed for your greatness, and maybe eventually even invited into other inner TechNet/MSDN circles!

Winning this award in your favorite technology will help us learn the active members in each community.

Feel free to ask any questions below.

More about TechNet Guru Awards.

Thanks,

If my reply is helpful please mark as Answer or vote asHelpful.

My blog | Twitter | LinkedIn

This post is my own opinion and does not necessarily reflect the opinion or view of Microsoft, its employees, or other MVPs.

↧

importing tsv 200 columns, 500,000 rows

February 2, 2017, 9:38 am

≫ Next: Cannot execute ssis package from dtexec

≪ Previous: Want to be the Microsoft TechNet SQL Server Guru for February 2017?

Hi experts, I get the error.

Warning 0x80049304: Data Flow Task 1: Warning: Could not open global shared memory to communicate with performance DLL

- Copying to [dbo].[Oct_06] (Stopped)

Messages

Error 0xc02020a1: Data Flow Task 1: Data conversion failed. The data conversion for column "Column 29" returned status value 2 and status text "The value could not be converted because of a potential loss of data.".

Error 0xc0209029: Data Flow Task 1: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "Source - 01-townnn_2016-10-06_tsv.Outputs[Flat File Source Output].Columns[Column 29]" failed because error code 0xC0209084 occurred, and the error row disposition on "Source - 01-townnn_2016-10-06_tsv.Outputs[Flat File Source Output].Columns[Column 29]" specifies failure on error. An error occurred on the specified object of the specified component. There may be error messages posted before this with more information about the failure.

(SQL Server Import and Export Wizard)

Error 0xc0202092: Data Flow Task 1: An error occurred while processing file "C:\Users\admin \Documents\01-townnn_2016-10-06.tsv" on data row 1908.

(SQL Server Import and Export Wizard)

The problem is that I am inserting 200 columns, 500,000 rows…

I cannot go row by row or column by column; I rely on it to get the data types automatically…. I increased the number of rows for the sample to 100,000 and even with that got it wrong. (I tried with 500,000 but goes to ‘not responding’)

↧

Cannot execute ssis package from dtexec

February 2, 2017, 10:37 am

≫ Next: SSIS Odata Source Connection Error

≪ Previous: importing tsv 200 columns, 500,000 rows

I get this error when I try to run the SSIS package from command line

Error:

Could not load package "\Package1" because of error 0xC001000A.

Description: The specified package could not be loaded from the SQL Server database.

FYI : here is the command

dtexec

/sql\Package1/server sree/conf"C:\data\Test\conf\Package1config.dtsConfig" /L"DTS.LogProviderSQLServer;sree.test"

Thanks,

sree

↧

SSIS Odata Source Connection Error

February 1, 2017, 5:15 am

≫ Next: DTS Script Runtime Error in SSIS

≪ Previous: Cannot execute ssis package from dtexec

Hi,

I'm trying to connect to an Odata source that uses Basic Authentication, when I setup the Odata Connection I get the error "The remote server returned an error: (401) Unauthorized. (System)" which suggest it can't authenticate. I have successfully connected to using Excel PowerQuery and SoapUI and get the same error if I don't enter the password.

Does anyone know how to force Basic Authentication or what else could be wrong?

Thanks,

Rich

↧

DTS Script Runtime Error in SSIS

January 27, 2017, 1:04 pm

≫ Next: SSIS Package not running under proxy

≪ Previous: SSIS Odata Source Connection Error

I am running a package in SSIS in VS 2013 BIDS. There is a script that is part of a Trigger API task in the SSIS project. When the task is run the following error is shown:

at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at System.RuntimeType.InvokeMember(String name, BindingFlags bindingFlags, Binder binder, Object target, Object[] providedArgs, ParameterModifier[] modifiers, CultureInfo culture, String[] namedParams)
   at Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTATaskScriptingEngine.ExecuteScript()

The C# script is:

       public void Main()
        {
            var webGet = new HtmlWeb();
            var document = webGet.Load(Dts.Variables["User::processUrl"].Value.ToString());
            var status = document.DocumentNode.SelectSingleNode("//div[@class='alert alert-success alert-dismissible']");
           // MessageBox.Show(status.InnerText.ToString(), "Error Title", MessageBoxButtons.OK, MessageBoxIcon.Exclamation);

            if (status.InnerText.Trim().Contains( Convert.ToString("Query ran successfully.")) )
            {
                Dts.TaskResult = (int)ScriptResults.Success;
            }
            else
            {
                Dts.TaskResult = (int)ScriptResults.Failure;
            }
        }

The Namespaces used are (.NET 4.5 references)

using System;
using System.Data;
using Microsoft.SqlServer.Dts.Runtime;
using System.Windows.Forms;
using System.IO;
using System.Net;
using HtmlAgilityPack;
using System.Linq;

The error message fires on the line:

var webGet = new HtmlWeb();

I am trying to decipher the error message to use in troubleshoot the script. Any help would be appreciated.

↧

SSIS Package not running under proxy

September 5, 2007, 12:39 pm

≫ Next: DFT - The buffer manager detected that the system was low on virtual memory

≪ Previous: DTS Script Runtime Error in SSIS

I have a SSIS package that reads from a remote directory on another server that is on the same domain. When I run the package under my domain user, it runs fine, however when I try to start the SQL job which has the package as the first step, the job fails. I created a proxy account with domain user credentials, set it to be active under "SSIS Package Execution" and set the SSIS package to run as the proxy account, but I get the following error message:

"Unable to start execution of step 1 (reason: Could not get proxy data for proxy_id = 2). The step failed."

I'm not sure what to do at this point, so any help would be appreciated.

↧

DFT - The buffer manager detected that the system was low on virtual memory

January 18, 2017, 5:38 am

≫ Next: How to fill columns for translated values

≪ Previous: SSIS Package not running under proxy

Hi All,

I am running a package which has 5 DFT's running in parallel. OLEDB source has a SQL command and it is loading data to SQL.

I see that the data load gets stuck or becomes slow for some DFT. Below is the Informational message I get in Progress Tab

[SSIS.Pipeline] Information: The buffer manager detected that the system was low on virtual memory,
but was unable to swap out any buffers. 14 buffers were considered and 14 were locked.
not enough memory is available to the pipeline because not enough is installed,
other processes are using it, or too many buffers are locked.

Question: Where can we track the virtual memory and what's the workaround to increase it?

Cheers
Vaibhav
MCSA (SQL Server 2012)

↧

How to fill columns for translated values

February 3, 2017, 2:01 am

≫ Next: How to convert 2 digit Year value to 4 digit with correct century in sql..

≪ Previous: DFT - The buffer manager detected that the system was low on virtual memory

Hi,

I have the following problem:

I am designing a Dimensional Model, that must be used in multiple languages.

So for instance I have a Subscriber dimension with, amongst others, the following columns:

StatusEnglish
StatusDutch
StatusFrench

In my source database the Status descriptions are contained in a table with the following columns:

Code: 'Status'
Culture: 1 = Dutch, 2 = English, 3 = French
Value: 0, 1, 2, 3, 4, etc for the various statuses.
Description: 'Actief' or 'Active' or 'Activ', depending on the culture.

Now I want to use SSIS to copy the proper translated values into the Status columns.

I could do this directly in T-SQL, but because the Subscriber table has a lot of columns to translate, this would mean many JOINs.
Should I use a Lookup Transformation? If yes, how? That would mean a lot of Lookup Transformations and what if later a language is added?

What's the proper way to handle this?

Regards, Patrick

↧

How to convert 2 digit Year value to 4 digit with correct century in sql..

February 3, 2017, 2:08 am

≫ Next: How to deploy Whole project once to the new environment?

≪ Previous: How to fill columns for translated values

Actually I am getting value as '18-sep-47'...I want to load into my table as 'Sep 18 1947'..But when i was converting the value to datetime..Its getting updated as 'Sep 18 2047'...Any Suggestions..TIA

↧

How to deploy Whole project once to the new environment?

February 3, 2017, 3:33 am

≫ Next: SSIS C sharp script to navigate to a webpage

≪ Previous: How to convert 2 digit Year value to 4 digit with correct century in sql..

Hi there,

I have some packages in SSDT and I need to deploy to the new testing server. I want to create a single config file for the entire project. What is the best way to do? What are the things need to copy manually to the destination server? Please help. I am using SQL server 2016 (VSO 2015) in the source server.

Thanks,

↧

SSIS C sharp script to navigate to a webpage

February 3, 2017, 3:51 am

≫ Next: Need to Drop Database ? ... by Passing database name in variable dynamically

≪ Previous: How to deploy Whole project once to the new environment?

Hi,

I am working on a requirement to create a task in SSIS ( which can login to website,navigate to another page which will trigger a file download .

Any suggestions etc?

I am not a C sharp developer so will be great if I can get any pointers for that

Many thanks

↧

Need to Drop Database ? ... by Passing database name in variable dynamically

February 3, 2017, 4:00 am

≫ Next: C# error in in script task

≪ Previous: SSIS C sharp script to navigate to a webpage

Hi,

Am using Execute SQL task to drop a database dynamically, but ended with error... Pls help on this,

error is:

[Execute SQL Task] Error: Executing the query "DROP DATABASE ?" failed with the following error: "Incorrect syntax near '@P1'.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.

Help me to fix this...Tks.

↧

C# error in in script task

February 3, 2017, 5:28 am

≫ Next: SSIS Script Task using Interop Excel error : Scripts contained in the package have compilation errors.

≪ Previous: Need to Drop Database ? ... by Passing database name in variable dynamically

I lost my touch in SSIS. I use an execute task with a simple query select count(column) from table. Result single row, I set up the variable:

this is my scrip in C#:

		public void Main()
		{
			// TODO: Add your code here

            //Dts.Variables["User:Variable"].Value=Convert.ToString(Dts.Variables["User:Variable1"].Value;
            String MyVar = Dts.Variables["User:Variable1"].Value.ToString();
            MessageBox.Show ("MyVar");

			Dts.TaskResult = (int)ScriptResults.Success;
		}

but I retrieve the error above.

↧

SSIS Script Task using Interop Excel error : Scripts contained in the package have compilation errors.

February 3, 2017, 6:38 am

≫ Next: BIML - replace default behavior of ConstraintMode="Linear"

≪ Previous: C# error in in script task

Hi,

I'm using Visual Studio 15 with SQL Server Data Tools.

I want to extract values from an excel file with a Script Task using Excel Interop.

In order to do so, I added a reference to Microsoft.Office.Interop.Excel in my Script Task underlying C# project and I added the following code to the Main.

(Reference from GAC : C:\Windows\assembly\GAC_MSIL\Microsoft.Office.Interop.Excel\15.0.0.0__71e9bce111e9429c\Microsoft.Office.Interop.Excel.dll ... version v2.0.50727)

public void Main()
{
string filename = @"C:\temp\test.xlsx";

Microsoft.Office.Interop.Excel.Application excelApplicaiton = new Microsoft.Office.Interop.Excel.Application();
Microsoft.Office.Interop.Excel.Workbook excelWorkbook =
excelApplicaiton.Workbooks.Open(Filename: filename);
Microsoft.Office.Interop.Excel.Worksheet excelWorksheet = excelWorkbook.ActiveSheet; // line causing the error

Dts.TaskResult = (int)ScriptResults.Success;
}

For an unknown reason, the last line causes the script to fail compiling when closing the Script Task solution and pressing "OK" in the Script Task Editor Window. The code compiles perfectly in a regular C# project (outside a SSIS/Script Task)

Any help would be appreciated.

Thanks, Simon

↧

BIML - replace default behavior of ConstraintMode="Linear"

February 3, 2017, 7:20 am

≫ Next: Theoretical question on Script Task

≪ Previous: SSIS Script Task using Interop Excel error : Scripts contained in the package have compilation errors.

If you use ConstraintMode="Linear" within the Package tag in BIML, the default precedence constraint between tasks is OnSuccess (green arrow).

Is there a way to overwrite this default behaviour to OnCompletion (blue arrow) so that tasks will execute even when the previous task has failed?

Thanks

Geert

Geert Vanhove DCOD ------ http://geertvanhove.wordpress.com/ ----------- Please click the Mark as Answer or Vote As Helpful if a post solves your problem or is helpful!

↧

Theoretical question on Script Task

February 3, 2017, 7:37 am

≫ Next: Package Failed to Import Into MSDB: CPackage::LoadFromXML fails

≪ Previous: BIML - replace default behavior of ConstraintMode="Linear"

Hi guys, in which case you use the Task Script in SSIS. If you want do transformation with the data we have all the Build in tools. Could you please give me an hint about?

Thanks

↧

Package Failed to Import Into MSDB: CPackage::LoadFromXML fails

February 3, 2017, 8:50 am

≫ Next: SSIS access to Azure Key Vault

≪ Previous: Theoretical question on Script Task

I have a new SQL Server/SSIS setup. SQL Server is 2012 and Visual Studio is 2013. I want to import two packages to run in a SQL Server Agent job. When I try to import the packages into MSDB I get this message:

Here is what I have tried:

There is a third party package in the SSIS projects. It is HtmlAgilityPack. It is installed in the System32 and SysWow64 folders and was registered.

I tried changing the Run64BitRuntime to False in the package Properties box but it won't take.

I set the Protection level in Import Package to "Rely on server storage and roles for access control".

None of that worked. The packages run fine in Visual Studio so I know they work. Any ideas?

This is the version of SQL Server we are using:

We are using this for Visual Studio:

Microsoft SQL Server Reporting Services Designers
Version 12.0.2430.0

↧

SSIS access to Azure Key Vault

May 23, 2016, 9:36 am

≫ Next: How copy folder contents to another directory?

≪ Previous: Package Failed to Import Into MSDB: CPackage::LoadFromXML fails

I have an Azure SQL database with a table that has one field encrypted using Always Encrypted. The column master key is store in Azure Key Vault. Now I would like my on-premise SSIS application to be able to decrypt that column when retrieving data from Azure SQL database. Can SSIS be configured to talk to Azure Key Vault for the master key? If not, is there a way my SSIS application can decrypt the value?

↧

How copy folder contents to another directory?

February 3, 2017, 10:25 am

≫ Next: Exception from HRESULT: 0xC0010009

≪ Previous: SSIS access to Azure Key Vault

A daily import process generates a single folder

c:\Import\MyFolder<datetimestamp>

whose contents I want to copy to c:\Import. I can't decide what task (or script) is the right approach especially as the folder name changes daily. Any ideas appreciated.

TIA,

edm2

↧