Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Brighten up everyone's day! Become a shining September SSIS Guru!

$
0
0

As we in the Northern hemisphere watch the leaves turn brown, and the days grow shorter once more, we mourn the onset of darkness and cold. Winter is coming, and it may be a long one! (heard that somewhere before...)

SO my mighty guru word warriors, light up our hearts and minds with words of wisdom!

Send white hot ideas, spark off imaginations, light the way to a better future!

Let your intellectual outpourings enlighten your readers and lighten their burden, and quench their thirst for knowledge!

Beat back the darkness with laser sharp wit and broad spectrum facts.

Light a fire in our imaginations!

Become a beacon for awesomeness!

Shine so brightly as to become stars, and you shall be worshiped by us, as we bask in your technical glory!

 

Your time has come!

That time is NOW!

 

All you have to do is add an article to TechNet Wiki from your own specialist field. Something that fits into one of the categories listed on the submissions page. Copy in your own blog posts, a forum solution, a white paper, or just something you had to solve for your own day's work today.

Drop us some nifty knowledge, or superb snippets, and become MICROSOFT TECHNOLOGY GURU OF THE MONTH!

This is an official Microsoft TechNet recognition, where people such as yourselves can truly get noticed!

HOW TO WIN

1) Please copy over your Microsoft technical solutions and revelations toTechNet Wiki.

2) Add a link to it on THIS WIKI COMPETITION PAGE (so we know you've contributed)

3) Every month, we will highlight your contributions, and select a "Guru of the Month" in each technology.

If you win, we will sing your praises in blogs and forums, similar to the weekly contributor awards. Once "on our radar" and making your mark, you will probably be interviewed for your greatness, and maybe eventually even invited into other inner TechNet/MSDN circles!

Winning this award in your favoured technology will help us learn the active members in each community.

Feel free to ask any questions below.

More about TechNet Guru Awards

Thanks in advance!
Pete Laker


#PEJL

Got any nice code? If you invest time in coding an elegant, novel or impressive answer on MSDN forums, why not copy it over to the one and onlyTechNet Wiki, for future generations to benefit from! You'll never get archived again!

If you are a member of any user groups, please make sure you list them in the Microsoft User Groups Portal. Microsoft are trying to help promote your groups, and collating them here is the first step.


Configure SMTP

$
0
0
How do you configure the Mail page in the Send Mail Task. Ideally I need the email ids to be stored in an xml config file along with the connection manager.

Anonymous

How can I read a file with ASCII Special Character into a SQL table using SSIS 2008?

$
0
0

I've tried everything to read this file and am getting no where.   Help how can I read this file and load a SQL table?

RS - AscII - 30  (Record Separator)

GS - AscII - 29 (Group Separator)

Thank you for your assistance - Covi


Mark Covian

NTEXT cannot convert

$
0
0

I get excel files deposited in a drop box on a daily basis. I have a 'Filewatcher' SSIS package that scans for new excel files and processes them as they appear.

I have one field, "Comments", that constantly gives me a headache. Comments is a NTEXT data type field. When my SSIS package processes a record where the comments field is > 255 characters, from time to time I get an error saying 'cannot convert long text data type'. This only happens some of the times, other times when its a record with >255 characters it processes just fine.  When the comments field is less than 255 and I correct the mapping in my oledb excel source, the data type is a standard W_STR 255 character data type which will not process anything > 255 characters. Not sure what I can do here. I thought having a field that is NTEXT would allow me to process records who have a comments field > or < 255 characters. Any tips or advice would be greatly appreciated.

regarding ssis - split data over multiple tables

$
0
0

Hi,

  i have a file with 10000 records , i have to load these data into tables, tables are created dynamically, each table has to load only 1000 records

please help me


SSIS problem - Script Component - The value is too large to fit in the column data area of the buffer

$
0
0
I am trying to run a task in a package, however there is a problem come out, see any one meet this before ?

Scenario: Insert update delete into a 3 billion target from a 2 billion source

$
0
0

Both target(3 billion rows) and source (2 billion rows) are SQL server tables partitioned by "Year-month". Now I want Insert update delete from source to target. This is just a scenario that I was thinking about. I was thinking about the best approach for the load.

With my little knowledge I would write a stored procedure with Merge statement but given the large amount of data will that be the best solution? 

Please advise. Thanks in advance for your help.


svk

Perform a Lookup on Dynamic CRM based Entities/Tables in SSIS

$
0
0

Hi, 

We use COZYROC Dynamic CRM source and destination adapters in Data flow task to perform reads, Inserts, Updates into CRM entities in SSIS.

But could anyone point me in the right direction, how do I look up CRM based tables etc for GUIDs  , can I use a normal Lookup transformation to do this? 

Or do we have to use a web service based approach to Look up CRM Lookup tables?

Thanks.


SSIS, COM and unit-tests

$
0
0

Hi all.

I work on SSIS package and I want it to be run from my programs and from my tests also.

What I have done.

I made Class Library project with the only method as:

using Microsoft.SqlServer.Dts.Runtime.Wrapper;

public class Class1
{
	public void Do()
	{
		string ispacFileName = @"c:\projs2\etl.ispac";
		string configFileName = @"c:\projs2\etl.dtsConfig";
		string packageName = "Etl.dtsx";

		Application app = new Application();
		DTSExecResult result = DTSExecResult.DTSER_FAILURE;

		IDTSProject100 project = app.OpenProject(ispacFileName, null);
		try
		{
			IDTSPackage100 package = project.GetPackageByName(packageName);
			package.ImportConfigurationFile(configFileName);

			result = package.Execute();
		}
		finally
		{
			app.CloseProject(project);
		}
	}
}

Then I created Console Application as:

private static void Main(string[] args)
{
	ClassLibrary1.Class1 c = new ClassLibrary1.Class1();
	c.Do();
}

Wonderful until now. Everything is ok and works perfectly.

Now I want to create a unit-test.
I added Unit Test Project, added a reference to my ClassLibrary1 in it, so the unit-test looks as follows:

[TestClass]
public class UnitTest1
{
	[TestMethod]
	public void TestMethod1()
	{
		ClassLibrary1.Class1 c = new ClassLibrary1.Class1();
		c.Do();
	}
}

I started the test and on the line

	package.ImportConfigurationFile(configFileName);

I got the message:

Result Message: 
Test method UnitTestProject1.UnitTest1.TestMethod1 threw exception:
System.Runtime.InteropServices.COMException: The server threw an exception. (Exception from HRESULT: 0x80010105 (RPC_E_SERVERFAULT))

What is it? Why? I tried to set 4, 4.5, 4.5.1 frameworks as the target - all is the same.

And yes, I know about dtexec.exe. If I use the exe instead of COM, the unit-test success. But I need to run my unit-tests on our build machine. And I cannot start any exe under the account the build machine starts. So I have to use COM way.

Why in Console Application everything is fine but the unit-test fails?
What I did wrong? I have absolutely no idea...

Fact Table loading in parallel

$
0
0

Hi

I have 3 fact tables which loads daily 300,000 records and runs in sequence . now i want to run these 3 fact tables load in parallel .

if i run these 3 fact table load in parallel will there be any performance impact on running quries ?

regards

Srinivas

Error in running Package

$
0
0

Hi all,

I executed a package using the 'Slowly changing dimension' and received an error saying : The package file is missing from the project directory. Move the package to the same directory as the project file.

Please how should I do this?

Thank you


Platt

Upgrade SQL server database from 2008R2 to 2014 standard version and get error with SSIS package

$
0
0

Hi all,

I have got an error when I upgrade from Sql server 2008R2 to 2014Standard version as below:

In current, I have a .NET application(32bit) which is executing 2008R2 SSIS packages and the application are running on win server 2008r2 (64bit). These packages were built in BIDS 2008. After that, I upgraded my database server from SQL2008R2 to SQL2014 Standard (running on Win server 2012R2) and deployed .NET app to new environment.
I'm encountering the issues with calling package from .NET application(32bit). The message error is ERROR: Could not load file or assembly "Microsoft.SqlServer.Dts.DTSRuntimeWrap.dll, Version=10.0.0.0, Culture=neutral, Public Key=...". In .net application, I already included some DLL (version 10.0.0.0) of SSIS.

I don't want to upgrade my .net application and SISS packages because I have around 50 environments (50 servers) and just one of them need to upgrade to SQL server 2014. We are planing to upgrade all but not now. Having two source codes for two environment will take me alot of time for QC and risk also. Therefore, I prefer a way to change something on new server - Sql server 2014 that help to run on my old code.

Really appreciate some helps.

Thanks,

Downgrade of SSIS packages from 2012 to 2008

$
0
0
Team,
We have put all our efforts to develop SSIS 2012 solution and now customer requirement changes and they wants to implement ETL in SQL 2008R2.

Is there anyway by which we can convert existing SQL 2012 packages to SQL 2008R2 , to meet the deliverables. please advice.

Why SSIS is designed to run outside of SQL Server memory space.

$
0
0

I just want to understand if there is any specific reason that SSIS runs outside of SQL Server memory space where SSIS uses memory allocated to OS or other virtual memory space ?

Thank you

SSIS package to load data into Production SQL serevr. Now I got a requirement to add two extra columns.

$
0
0
I've SSIS package to load data into Production SQL serevr. Now I got a requirement to add two extra columns. How should I proceed without impacting production data?

SSIS: Count number of columns

$
0
0

Hi,

I am processing flat files and I want to make sure that my files will contain the number of columns I expect, because a user might some day input a file with a new column format. If the file does not contain the correct number of columns, process must stop. I am planning to input the expected of columns in a User Variable.

But how do I test for the number of columns in the file, and do I stop the execution?

Be precise please (do I work in the control flow? in the Data flow?).

Thanks in advance.

Paul




package not respecting indirect xml configuration

$
0
0
My package is not respecting the indirect xml configuration. I have an xml config file whose path is configured through environment variables. But the package is not looking for the connection string from the config file.

Anonymous

DtsDebugHost crashes after upgrade to SQL 2012 SP2

$
0
0

We have an SSIS package developed in VS 2010 (10.0.40219.1 SP1) running against SQL Server 2012.

Since we've upgraded to SQL Server 2012 SP2 (11.0.5058) one of the previously working packages is failing.

When running in SQL Agent, we get the following error:

The step did not generate any output.  The package execution failed.  The step failed.

When running in BIDS (VS 2010), we get the following crash:

---------------------------
Microsoft Visual C++ Runtime Library
---------------------------
Runtime Error!
Program: C:\Progr...
R6025
- pure virtual function call

In the Event Log, the following appears:

Faulting application name: DtsDebugHost.exe, version: 2011.110.5058.0, time stamp: 0x537422a5
Faulting module name: MSVCR100.dll, version: 10.0.40219.325, time stamp: 0x4df2bcac
Exception code: 0x40000015
Fault offset: 0x00000000000761c9
Faulting process id: 0x10da0
Faulting application start time: 0x01cfcbb6ddbc218e
Faulting application path: C:\Program Files\Microsoft SQL Server\110\DTS\binn\DtsDebugHost.exe
Faulting module path: C:\Windows\system32\MSVCR100.dll
Report Id: 28659fee-37aa-11e4-8361-50e549e06c22

How to log output of PRINT to TEXT file in SSIS

$
0
0

Hi,

I have a TSQL stored proc like

create proc test
as
PRINT 'Running proc test'

I am running this proc from SSIS and want to save the output of PRINT in some text file.

How can I do it?

Thanks


SSIS 2012 Error - The SQL Server specified in Integration Services service configuration is not present or is not available..

$
0
0

hi Guys,

 working on below error if anyone has work around. 

It is on SQL Server 2012 cluster. 

The SQL Server specified in Integration Services service configuration is not present or is not available. This might occur when there is no default instance of SQL Server on the computer. For more information, see the topic "Configuring the Integration Services Service" in SQL Server 2012 Books Online.


Please Mark As Answer if it is helpful. \\Aim To Inspire Rather to Teach

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>