Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

ssis unicode flatfile source - how to convert "Flat File Source Error Output Column" from DT_TEXT to DT_NTEXT ?

November 3, 2011, 5:25 am
$
0
0

My flatFile contains some Chinese characters; so inorder to load the data, i have checked the unicode checkbox in the flatfile connection manager. However it shows an error in the flatfile source since then. 

here is the error:

" Error at DFT Load table Table1 [Flat File Source [1]]: The data type for "output column "Flat File Source Error Output Column" (55)" is DT_TEXT, which is not supported with Unicode files. Use DT_NTEXT instead and convert the data to DT_TEXT using the data conversion component.

Error at DFT Load table Table1 [SSIS.Pipeline]: "component "Flat File Source" (1)" failed validation and returned validation status "VS_ISCORRUPT".

Error at DFT Load table Table1 [SSIS.Pipeline]: One or more component failed validation.

Error at DFT Load table Table1 : There were errors during task validation. (Microsoft.DataTransformationServices.VsIntegration) "

My real problem is how do i change the datatype of "Flat File Source Error Output Column" in the advanced editor? whenever i try to do so it show a message 'Property value not valid'

any help much appreciated... 

↧
Search

Dynamically set variable to pass to foreach loop and exec web service inputs

March 24, 2015, 12:48 pm
$
0
0
Hi, I'm a little lost (and new) on where to begin with this. Using SSIS 2008 r2 I've been able to create a small package to connect to a currency converter web service and select the hardcoded supplied by a web service. However, doing it this way I would have to create multiple mini sequence containers and select the currency to and from country codes. I would like to create a user::to and user::from variable and then run a sql task to set the variables. 
Ie, select distinct( [to_countryCD], [from_CountryCD] ) from tbl_CountryCd
and then run my sequence as a forloop dynamically passing the 'to' and 'from' country codes. Any idea's would really be appreciated.
↧
↧

SSIS Dynamic Input Parameters

March 24, 2015, 6:43 am
$
0
0

Good day,

I have a simple package that makes use of a stored procedure.  The stored procedure makes use of a start and end date parameter. I would like, when I execute the package, the first thing is an input box(es) to accept these parameters, then pass them onto the proc, and the package executes.

May I kindly get assistance with this. I have so far created a script task to prompt the user for these parameters, but I'm getting stuck somewhere.

Please assist.


Many thanks

Regards

Zimiso


↧

changing SSIS package owner

March 24, 2015, 9:10 am
$
0
0

I'm ready to deploy my packages, do I have change the owner from developer to sa or dba? If yes can someone guide me how to do that and are there any other things I have to take care of like Protection level (which is presently set to EncryptSensitiveWithUserKey )?

sree

↧

NUMBER OF RECORDS COUNT

March 25, 2015, 1:27 am
$
0
0

I have 10 files in a  folder  all file i loaded in destination table .......but my requirement is i have to maintain file name  and  number of records loaded from source to destination in that loop .....

final output should be 10 file names and every file no of records .........butwith out script task

↧
↧

Transfer SQL Server Objects Task

March 24, 2015, 11:42 pm
$
0
0

Hi

I am working on a SSIS task of copying the data from one DB to another and I have created a package using SSIS Transfer SQL Server Objects task and I selected around 30 tables as part of the task 

It is working fine but as per requirement , I need to have a count of rows inserted or some more statistics

Plz suggest how to get that as this task loads data as a single task and I cannot think of any solution

Thanks

NZ-D

↧

Oracle.Oledb provider returning improper out-put

March 25, 2015, 6:01 am
$
0
0
Dear All,

Need your help in below issue.

I have SSIS package which pull data from Oracle to SQL Server.
Currently I have used Oracle.Oledb provider for the same, but it is giving me improper result.

I check on oracle end count for that table was 26000 and when I run the same query through SSIS it shows 0 rows.
The preview of the query is showing 0 as output.

but when I tried the same using Microsoft OLEDB provider for Oracle it giving me proper out-put
↧

FlatFile import with multiple formats to single table

March 19, 2015, 2:13 pm
$
0
0
I need to import a Flatfile which can have varying number of columns eg row1 7 x cols, row2 15 x columns, row3 12 x columns.
The file needs to be added to a single table.
Any thoughts on best way to approach this. 
↧
Search

Error 6522 - deploy_project_internal

March 18, 2015, 6:04 am
$
0
0

Hi,

I have installed SSIS on a server and when I deploy a package, I have this error:

Error Number: 6522
Severity: 16
State: 1
Procedure: deploy_project_internal

I read this blog and have changed permissions but I have ever again the error message:

http://blog.oraylis.de/2013/09/fixing-sql-2012-ssis-deployment-error-6522-a-required-privilege-is-not-held-by-the-client/

Version of SQL: 11.0.3460

SQL Server Engine has a Domain account but SSIS is running with "NT Service\MsDtsServer110".

I suspect that I need to use a domain account for SSIS.

Have you suggestions to analyse or resolve this problem?

Thanks in advanced for your help

Regards,

STH

Best regards, Mit freundlichen Grüssen, Avec mes meilleures salutations, Stéphane Haby

↧
↧

How to import all Excel in Folder to database by SSIS?

November 8, 2013, 5:28 am
$
0
0

I have SQL Server 2012 and I would like to import Excel files data to Database.
I have several files that end-users copy to folder.
I never know files names or number of files in folder, but I know that structucture of data is same in every single file.

How to create logic with SSIS that imports all files one by one?

Kenny_I

↧

Step by Step Instructions of loading Excel into SSIS via OLE Data Source Microsoft.ACE instead of Excel connection manager

March 25, 2015, 1:03 am
$
0
0

Hi,

I have a very large Excel workbook which I need to load into SSIS. Using the default Excel connection manager SSIS seems to load the entire work sheet into memory before performing any operation even after setting IMEX=1 within the connection string.

Can anyone provide me with step by step instructions on how to use  OLE Data Source Microsoft.ACE please?

I've found the link; - https://www.connectionstrings.com/ace-oledb-12-0/

Which looks very useful.

Since I currently have Excel 2010 as my data source I tried; - 

Data Source=C:\PoC\POC_Data_Source\my.xlsx;Provider=Microsoft.ACE.OLEDB.12.0;Extended Properties="Excel 12.0 Xml;HDR=YES ;IMEX=1";
The connection test successfully. However SSIS still seems to be loading the entire work sheet into memory before starting the data load.

Kind Regards,

Kieran.

Kieran Patrick Wood http://www.innovativebusinessintelligence.com http://uk.linkedin.com/in/kieranpatrickwood http://kieranwood.wordpress.com/



↧

EXPRESSION SYNTAX REQUIRED FOR DERIVED COLUMN

March 25, 2015, 6:38 am
$
0
0

Hi

I've had a look around and can't find the correct syntax for an Expression in a Derived Column task.

Below is the logic in TSQL. Please could someone help me convert it?

CASE

WHEN FIELD1='A'AND FIELD2ISNULLTHEN'A'

WHEN FIELD1='B'AND FIELD2ISNULLTHEN'B'

WHEN FIELD1='A'AND FIELD2='C'THEN'C_A'

WHEN FIELD1='B'AND FIELD2='C'THEN'C_B'

WHEN FIELD1='A'AND FIELD2='D'THEN'D_A'

WHEN FIELD1='B'AND FIELD2='D'THEN'D_B'

ELSE'0'END

Thanks in advance

Lucy

↧

Package runs successfully but data didnt load completely

March 25, 2015, 7:47 am
$
0
0

Hi guys,

I am loading data from SQL 2000 to SQL 2012 using SSIS. I noticed that SSIS package completed successfully but not all the data from the source was queried/loaded.

What could be the possible cause of this.

me

↧
↧

Joining multiple tables in ssis

March 25, 2015, 8:58 am
$
0
0

I have to join multiple tables like 10 of them and load the data into destination. I get like 66 million records after joining, I have tried two ways to joining and load the data. First way, I used SQL command in ole db source and wrote the query there but this is taking forever to start, second way is used sort and merge join transformation and also used Issorted property where ever I can but as it requires multiple sort transformation it is time consuming.

Is there any other way I can load those 66 million records in less time??

Thanks,

sree

↧

Execute powershell script from ssis?

July 1, 2010, 7:06 am
$
0
0

Hi,

I was trying to use the execute process task to kick off a powershell script.  However, nothing happens when I run in debug (the component turns yellow and stays yellow).  Any idea if what I am trying to do is possible and the proper way to configure it?

btw, I am using powershell for the remoting capabilites.  I need to execute a bat file on a remote server which runs a process in a legacy program. 

Update:  When I name the ps1 script file in the executable window, it opens it in notepad.  This would be like the default if you double clicked the file.

Mark

↧
Search

Fail to start project

July 10, 2014, 8:37 am
$
0
0

Hi, everyone

When I click start to run the project, there is a error message: 

Failed to start project

------------------------------
ADDITIONAL INFORMATION:

Method not found: 'Boolean Microsoft.SqlServer.Dts.Design.VisualStudio2012Utils.IsVisualStudio2012ProInstalled()'. (Microsoft.DataTransformationServices.VsIntegration)

I installed vs2012 iso and integrated, my version is 11.0.5058.0.

Any help appreciate.

↧

OleDB Destination Values in one row not in many

March 25, 2015, 10:03 am
$
0
0

Hi Everybody,

i am not sure about the Topic. Perhaps you have another idea.

I have 5 OleDB Sources with different Selection Criterias

I have a table it looks so:

ID, Value, Value 2, Value 3, Value 4, Value 5

In the end i have an Union All Transformation and an oleDB Destination.

When i make a run, the insert writes the data into the table.
But not in the format which i want to have.

The result is the folowing:

ID, Value, Value 2, Value 3, Value 4, Value 5

1     2

2                  5

3                                7

But i want to have the result in one row:

ID, Value, Value 2, Value 3, Value 4, Value 5

1       2           5            7

Could you help me in this case.
I am new in SSIS and i don't understand why SSIS Inserts the value as it does.

Best regards,
Sebastian

↧
↧

Optimizing the SCD component - Indexes on Surrogate and Business Keys

March 25, 2015, 10:50 am
$
0
0

Hi guys,

I have a question.

I am trying to optimize the SCD component of SSIS, working on the database design and ssis load methods.

I changed the destination to Fast Load and then I was playing in indexes. I noticed that because I had surrogate keys as primary keys keys my clustered index was there. Because SSIS SCD works around the Business Keys, that Index was useless for that, so I created a non clustered index on the business key, without including any extra data column.

Results were the following (keep in mind I always truncated the tables to check each case):

0- Only fast load - 17minutes with 81000 rows

1 - 81000 rows were running in 17 minutes with fast load and turn into 57 seconds with CLustered Index on Primary Key and Non Clustered Index on Business Key.

2 - Then I deleted both indexes and created a clustered index on the Business Key. Load time droped to33 seconds.

3 - Then I created a nonclustered index on the surrogate key, so i have both indexes again from example 1 but on the reverse order. Time increased to37 seconds but still good compared to no optimization.

So I wanted to ask what do you think would be the best approach to use, based on the surrogate keys usage (they are only used to relate fact tables) and their index type (clustered or non clustered).

Best regards.

↧

SQL Server 2012 Data Tools: Integration Services: SMO task fails using Visual Studio 2012 Ultimate installed

March 25, 2015, 7:44 am
$
0
0 
I have both SQL Server 2012 Developer and Visual Studio 2012 Ultimate installed.  I also installed the Sql Server Data Tools - BI package.  I started a new project to transfer databases from an old machine to a new one.  I selected the Transfer Database task.  I set up the connections to the old and new servers, specified the databases and file locations.  However, when attempting to run the package, it fails with the error:

Method not found: 'Boolean Microsoft.SqlServer.DTS.Design.VisualStudio2012Utils.IsVisualStudio2012ProInstalled()'.

Seeing this, I added a C# project with a reference to the Microsoft.SqlServer.DTS.Design namespace.  Exploring this namespace, I found that there *is* a method called IsVisualStudio2012UltimateInstalled() but not the method referred to in the error message.

Since Visual Studio Ultimate is a superset of Visual Studio Professional, either the namespace should include the method reported missing or the Transfer Database task of Integration Services should accept IsVisualStudio2012UltimateInstalled() as a proxy for the missing method.
↧

Is there a way to change fixed width Flat file connection manager to delimited without losing all the column names ?

March 25, 2015, 11:32 am
$
0
0
Is there a way to change fixed width Flat file connection manager to delimited without losing all the column names ?
↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>