Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

CDC Issue in SSIS Package

0
0

Hi All,

We have created SSIS package using CDC(2012). But performance is very slow. How can we improve performance in the below senario's

Scenario A:

Source DB & CDC in SSIS in the same server:

When we run  the CDC package in this scenario. We are able to extract 500K records in 50seconds. 

Scenario B:

Source DB is in physical server 1 and CDC with SSIS in physical server 2:

When we run the CDC package in the scenario, 10,000 record extraction takes 15min. We have Primary Key in the table from where we extracting the records.

Please reply us how to solve the delay in data extraction using CDC in the Scenario B. We are using 2012.

Kindly provide us multiple options.

Thanks in Advance...


SSIS: Change Code page 1252 ANSI to UTF-8 65001

0
0

Hi All;

I have created SSIS Package to import data from OLE DB to a flat file. The code page in the flat file connection manager was set to default1252 ANSI - Latin I. Now I have been asked to output the flat file inUTF-8 format. I have changed the code page to 65001 UTF-8 but the package will not run. I got the following message:

the code page on input column COLUMN_NAME (184)is 1252 and is required
to be 65001

I have searched around and i have read that i need to change the column data type fromVARCHAR to NVARCHAR!! Is this the solution?

 

Is there is any other option? Thanks.


Does the Online Transfer Database task actually not work?

0
0

Hi, I've been wrestling for a few weeks now, trying to create an OnlineTransfer Database task inside an SSIS package.

My findings are as follows:

Firstly, I got a lot of these errors: "[User] is not a valid login or you do not have permission" This seems to be because it won't work if there are any SQL logins (note Logins, not users) in the source server/database that don't already exist in the destination server. I tried a transfer logins task beforehand but it didn't seem to transfer the SQL logins.

I was manually able to get over this error by creating all the SQL logins manually on the destination server. Once all the logins were in place, I then got this error:

Error: The Execute method on the task returned error code 0x80131500 (ERROR : errorCode=0 description=Invalid column name 'Space'. helpFile= helpContext=0 idofInterfaceWithError={C81DFC5A-3B22-4DA3-BD3B-10BF861A7F9C}). The Execute method must succeed, and indicate the result using an "out" parameter.

Am I just wasting my time? Does this not actually work? Or am I doing it wrong? The source database has a few Primary/foreign key constraints but I don't see anything in the documentation (from a book I'm reading) or from books online that suggests that you can't do an online copy from a database with PK/FK constraints.

Any advice you can offer would be greatly appreciated. Maybe the offline method works better, but I can't do anOffline copy because the source is a live database that needs to be online 24/7.

Setting a variable based on a date

0
0

I am looking for a  wizard with date logic in SSIS and I just can’t find the right syntax.

I’m trying to use a variable called winter_flag that is set tp Y if the date is > 1015 of this year and 0108 of next year.

Can somebody give me the expression to present the date code?

Advice for the simplest tutorial in ASP.NET

0
0

Hi guys, might you advice me a good tutorial for ASP.NET. Just basic, total beginner...I used to handle ASP but I noticed that ASP.NET is totally different.

I am looking for something very easy to understand, I'm studying a lot of different stuff and I don't know if I can manage another big book at the moment...

Thanks a lot

Use Package Parameters in Package Deployment Model

0
0

Can you use Package Parameters when you use the PackageDeployment Model? The Parameter tab is visible in SSDT and in SSDT they seem to work, but can you use them outside SSDT? In a SQL Agent Job or on the command prompt?

And if not... why is the tab visible? ;-)

The PrimeOutput method on component "OLE DB Source" (13) returned error code 0xC0202009

0
0

I am pulling data from Access 2000 to a sql server 2005 database. But I am getting the below error

An OLE DB error has occurred. Error code: 0x80004005.

The PrimeOutput method on component "OLE DB Source" (1) returned error code 0xC0202009.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

I tried;

1. reducing the number of columns. but of no use.

2.  when i load only 1000 records from the source then it is working fine. When i load more than 1000 records, error keeps on coming.

Please suggest me on this error

Validation Error - An error occured executing the provided SQL Command

0
0

Hi All,

I am new to using SQL Server in general (2008 R2) and am trying to change the source location for multiple packages in order to obtain our data from a more reliable environment.

I have created a copy of the target database where the data will be loaded, amended the source and target connection managers and ran through the packages to ensure they work, which many do.

We are changing the source from a local server to a cloud based server and when running a package that literally truncates target table, selects * from source, and inserts data to target I get a validation error "An error occurred executing the provided SQL Command "Select *...." The connection has been disabled" and "component ADO NET Source failed validation and returned validation status "VS_ISBROKEN"".

The table structure from the 2 sources is the same and I have even recreated the data flow tasks to ensure the metadata has updated. When selecting 100 rows or even 5,000,000 rows from source the package runs fine but will fail as above when selecting &* (around 9.5 million rows).

I'm not sure if this is due to the new data source being web based or if it could be some erroneous data in the table that isn't being selected when limiting to 5 milling rows etc.

I have spend hours trying to figure out what the issue could be (doesn't help being new to SQL Server) so any guidance would be hugely appreciated!!!

Thanks,

Louis.

 




Urldecode

0
0

G'day all, I'm receiving a column from a database that is an encoded URL request string. We've been using a SQL Server function to decode this URL but recently the string coming in has 4000+ parameters which is taking a while to parse through the function so I'm looking to see how a SSIS script component can handle the equivalent. However, when I try to include the System.Web namespace (using C#), it doesn't give me the option to choose subpackages (either Server or HttpUtility, not sure which will be the appropriate package), any idea how I get this package available? Do I have to have a HTTP connection manager to make these available or have I missed something?

TIA

How to generate SSIS packages using BIML

0
0

Hello friends,

i am writing BIML Code using C# for creating SSIS packages dynamically but my requirement is create ssis package with multiple data flow tasks.

Can any body have BIML(c#) Code to create SSIS packages with multiple data flow tasks dynamically  please send me.

Reagards

Anji

SSIS Server Crashes

0
0

Hi All,

We have 2 physical servers (Server-1 and Server-2). In Both the physical servers SSIS is installed.

If server 1 where SSIS is installed crashes , Can i pick up from server 2 where ssis is also installed ?

Is there any common place/repository where we can deploy the packages so that if SSIS crashes ,
So that it can pick from secondary SSIS.

Thanks in Advance

Execute task not allowed if you save the package in a folder not Visual Studio

0
0

Guys, may I ask why when I build a package and leave the package in a Visual Studio subfolder I can use, using the right click, Execute Task. Let's say the package Abba.dtsx I can modify and deploy Abba.dtsx as more as I want but...

if I move the package Abba.dstx in another folder, a network folder for example, I can run with a double click of course but I can't deploy from BIDS. Pratically, BIDS--> file--> open Abba.dtsx I can modify the file but I cannot use the function Execute Task.

Data Load into PDW using SSIS

0
0

Hi everyone,

I am trying to load data into a PDW database using SSIS. My source database is on SQL 2012 and PDW destination DB is on Visual Studio 2013. When I try to load the data into PDW, I get the following error:

Exception from HRESULT: 0xC0202040
Error at Data Flow Task [OLE DB Destination [112]]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E37.
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80040E37  Description: "Stored procedure sp_bcp_dbcmptlevel does not exist or is not supported.".

Error at Data Flow Task [OLE DB Destination [112]]: Failed to open a fastload rowset for "[dbo].[DimCurrency]". Check that the object exists in the database.

The object exists in the PDW database and I can see it. 

The providers that I'm using are given below:

SQL Server: Native OLE DB\SQL Server Native Client 11.0

PDW Destination: SQL Server Native Client 11.0

Please advice.


In SSIS How to use Derived column task in between flat file source and flat file destination ?

0
0

Hi,

  I have tried to push datas from flatfile source(.txt) to flatfile destination(also .txt file).. Inbetween i just wanted to use derived column task.. But it throws the below errors when i am executing it..

Errors:

[Flat File Source [28]] Error: Cannot open the datafile "C:\Users\user1\Documents\File_name.txt".

[SSIS.Pipeline] Error: Flat File Source failed the pre-execute phase and returned error code 0xC020200E.

-

Vino

Getting Error while overiting the excel sheet

0
0

Hello,

My requirement is to overwrite the excel sheet instead of appending the next records. What I do to achieve this is drop sheet first then create sheet again. While doing this in execute sql task I am getting errors.

[Execute SQL Task] Error: Executing the query "CREATE TABLE `testtt` ( `case` VARCHAR(10), `case1` VARCHAR(50) ) " failed with the following error: "Cannot modify the design of table 'testtt'. It is in a read-only database.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly. 

Same error for drop too. This is working fine when I do locally but when deploy it on server I get this type of errors. I assume this might be issue with accesses.

Please suggest me.


Ramu Gade


Load header columns into Flat File

0
0

Hi I am new to SSIS and my requirement is to load data from table to flatfile which I did. However I need to show the header in the target flat file.

Eg: My source table query is

select eno, ename from emp;

10, Tony

11, Wood

OUTPUT:

eno,ename

10,Tony

11,Wood

I think I need to check the box 'Columns names in the first data row' But I am loosing the variable mapping if I did.

Please help me.

SSISDB Verbose Logging Level and Unexpected Terminiation

0
0

If we set the SSISDB Logging Level to Verbose, will we get more details on Unexpected Termination events?

With basic logging level, the reports for Unexpected Termination do not provide any useful information to what happened.

--- Ryan


Ryan P. Casey • <a href="http://www.R-P-C-Group.com">www.R-P-C-Group.com</a>

Can you minimize logging in a SSIS data flow when the database is in a SQL Server 2012 Always On Group?

0
0

We have a file that we are loading 1st into a staging database then into a production database that contains over 5 million rows. Both databases belong to a SQL Server 2012 AG. We would like to minimize the logging in the staging database but t the same time keep the staging database in the AG. I know about fast load and setting the buffer settings in SSIS but I've read that this doesn't work on replicated tables and I am assuming that speaks to the AG.

Are there any articles or someone's personal experiences with this type of scenario that could point us in the right direction and offset some of the initial data load into staging by minimizing logging?

Thanks,

Sue


Sue

Execute SQL Query from Excel using SSIS

0
0

I am trying to execute sql query which has written in excel sheet via SSIS. For e.g I have Excel sheet which has more than 20 SQL select statements. I want to run these SQL query using SSIS and load the output of these query to another excel file. for e.g. I have

S.NoQuery

1Select * from stud

2Select * from emp

3Select * from prod

Need Info on MSBI Books and Training Materials

0
0

Hi,

I am new to the field of BI. I have a high level knowledge on the different components of SSIS/SSAS/SSRS. I do not have indepth working knowledge on these platforms. Would like to know what books would best help me to get a clear and complete understanding of MSBI 2012 tools / solutions to real time problems and how to approach them etc.

Viewing all 24688 articles
Browse latest View live




Latest Images