Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

SSIS creates empty flat fie, how to avoid that?

April 2, 2014, 12:38 pm
$
0
0

I have a simple SSIS data export package - Data Flow task which takes data from db table and puts it in a flat file.

SQL Agent is used to run this SSIS data export package every 2 minutes.

Sometimes table is empty, does not have new rows that's why

1 - empty file is being created

2 - SQL Agent gave an error:  The step did not generate any output.  The return value was unknown.  The process exit code was -1073741819.  The step failed.,00:00:02,0,0,,,,0

I placed a "Execute SQL Task" step to count rows in the source table anddisable Data Flow taskif user::count==0  - this still creates an empty file.

Is there a proven workaround to use count variable and actually disable Data Flow task and avoid creating empty flat file???

Are there any specific rules in setting up "result name" in "SQL Task" "result set" where you map Result Name and Variable Name?

Should it be column name, like "count" for select count(abc) ascount from TABLE

Thank you in advance!


↧
Search

transfer temp table data to excel

April 2, 2014, 9:45 am
$
0
0

there are temporary tables in db. (Sales) . it contains huge data with some columns in being Chinese character .

can in transfer data from temp table to excel through ssis..

example  :

select * from #sales

o/p : should be moved to excel .

↧
↧

Installing the SSIS Connectors v2.0 for Oracle by Attunity - SSIS 2012

March 25, 2014, 11:12 am
$
0
0

Hi,

on a SQL Server 2012 I'd like to add the SSIS Connectors vers. 2.0 for Oracle.

To accomplish this task I've tried this white paper:

http://technet.microsoft.com/en-us/library/ee470675(v=sql.100).aspx

but it is referred to SQL Server 2008.

In order to execute the exact sequence of operations about Oracle components installation, can I install before the Oracle 32 bit client and then the Oracle 64 bit client?

I'd like to read the reply posted from an experienced person about the SSIS Connector installation task.

Thanks

↧

Using Change Data Capture in SSIS - how to handle schema changes

April 2, 2014, 2:09 pm
$
0
0

I was asked to consider change data capture for a database recently.  I can see that from the database perspective, its quite nice.  When I considered how I'd do this in SSIS, it seemed pretty obvious that I might have a problem, but I wanted to confirm here.

The database in question changes the schema about once per month in production.  We have a lot of controls in our environment, so everytime a tables schema is changed, I'd have to do a formal change request to deal with a change to my code base, in this case my SSIS package; it can be a lot of work.   If I wanted to track the data changes for inserts, update and deletes using an SSIS package to send the data changes to the destination tables, would I have to change my SSIS package with every schema change, or is there a way to keep the exact same SSIS package with CDC without having to change it every month?

Thanks,

Keith

↧

SSIS Guru needed! Apply within...

April 2, 2014, 2:17 pm
$
0
0

April fools out of the way, now let's find an April genius!

The name "April" is derived from the Latin verb "aperire", meaning "to open" in reference to being the season when trees & flowers start to "open".

And I have to say, judging from the quality of contributions in recent months, I can't wait to OPEN and read this month's community gold!

Things are hotting up in TechNet, and the Wiki has become a shining example of what the community has to offer.

If you can find the time to enrich us with your latest revelations, or some fascinating facts, then not only will you build up a profile and name for yourself within the gaze of Microsoft's very own glitterati, but you will be adding pages to the most respected source for Microsoft knowledge base articles. This could not only boost your career, but would benefit generations to come!

So don't be an April fool. Please realise the potential of this platform, realise where we are going, and join us in growing this community, learning more about you, and opening the minds of others!

All you have to do is add an article to TechNet Wiki from your own specialist field. Something that fits into one of the categories listed on the submissions page. Copy in your own blog posts, a forum solution, a white paper, or just something you had to solve for your own day's work today.

Drop us some nifty knowledge, or superb snippets, and become MICROSOFT TECHNOLOGY GURU OF THE MONTH!

This is an official Microsoft TechNet recognition, where people such as yourselves can truly get noticed!

HOW TO WIN

1) Please copy over your Microsoft technical solutions and revelations toTechNet Wiki.

2) Add a link to it on THIS WIKI COMPETITION PAGE (so we know you've contributed)

3) Every month, we will highlight your contributions, and select a "Guru of the Month" in each technology.

If you win, we will sing your praises in blogs and forums, similar to the weekly contributor awards. Once "on our radar" and making your mark, you will probably be interviewed for your greatness, and maybe eventually even invited into other inner TechNet/MSDN circles!

Winning this award in your favoured technology will help us learn the active members in each community.

Feel free to ask any questions below.

More about TechNet Guru Awards

Thanks in advance!
Pete Laker

#PEJL

Got any nice code? If you invest time in coding an elegant, novel or impressive answer on MSDN forums, why not copy it over to the one and onlyTechNet Wiki, for future generations to benefit from! You'll never get archived again!

If you are a member of any user groups, please make sure you list them in the Microsoft User Groups Portal. Microsoft are trying to help promote your groups, and collating them here is the first step.

↧
↧

Setting expression value for a variable

April 2, 2014, 2:57 pm
$
0
0

How can I set the following value of a variable :

Also, how can I set the below command as a variable value using expression.

BULK INSERT + @[User:Table]
   FROM @[User:Path]
   WITH
      (
         FIELDTERMINATOR =' |',
         ROWTERMINATOR =' |\n'
      )

I am getting some errors .

I tried "BULK INSERT" + @[User:Table] +
"FROM" + @[User:Path]
 + " WITH
      (
         FIELDTERMINATOR =" + "' |'" + ",
         ROWTERMINATOR ="+ "' |\n'" +
      ")"

It is not working.

↧

Excel 2010 file connection error in SSIS

April 2, 2014, 4:14 pm
$
0
0

I am using Excel 2010 file (.xlsx) 64-bit and want to enumerate through different sheets in it. So, I have created a connection manager as shown here: http://imgur.com/2wuJI2W

But when I try to test connection, i am getting an error 'Test connection failed because of an error in initializing provider. Could not find installable ISAM'

Server is 64bit, BIDS is 64bit, Excel is 64bit

I tried with Run64BitRuntime=False and with un64BitRuntime=True..both didnt help.

Can anyone please help me here..

Thanks a lot in advance!!

↧

For Each file , load into the table where table name is determined by the filename

April 2, 2014, 2:55 pm
$
0
0

I have a folder containing like 100 files and I need to load each file into a different table.

Each file has a different structure.

Eg : file named as A.txt goes into table A, filenamed as B goes into table B and so on.

How can I achieve this using SSIS? I tried dynamic connection string but it works if all the files have same structure.

↧
Search

Data deletion and space Issue

April 2, 2014, 8:25 am
$
0
0

Hello Experts,

i have got a database with 3 Tera Bytes of size,

i have already deleted about 1.5 TB of data from its one of the table 

But i do not see the size difference in MDF file atall, it is almost the same size,

Please ADvise

k

↧
↧

Executing a SQL 2012 SSIS project with DTExec using Protection Level "EncryptAllWithPassword"

April 2, 2014, 2:28 pm
$
0
0

I'm trying to execute a very basic SQL 2012 Project that only has 1 single package that contains a simply email task.

The project will run fine from command line using basic syntax.

dtexec /project  "F:\SSIS\Projects\project1\bin\Project 1 Configuration\project1.ispac" /package "Main.dtsx"

Once I add the protection level of EncryptAllWithPassword to the project and the package things suddenly stop working. New command line syntax is.

dtexec /project  "F:\SSIS\Projects\project1\bin\Project 1 Configuration\project1.ispac" /package "Main.dtsx" /P "Password"

I get the following output.

Microsoft (R) SQL Server Execute Package Utility
Version 11.0.2100.60 for 64-bit
Copyright (C) Microsoft Corporation. All rights reserved.

Started:  5:14:49 PM
Could not load project "F:\SSIS\Projects\project1\bin\Project 1 Configuration\project1.ispac" because of error 0x80131500.
Description: The encrypted data in project manifest failed to load. The project
manifest is corrupted or if the project is password protected, the specified password is incorrect.
Source: Microsoft.SqlServer.ManagedDTS
Started:  5:14:49 PM
Finished: 5:14:49 PM
Elapsed:  0.078 seconds

I'm confident my passwords are entered correctly in the two spots. Is there something I'm missing in my command line to use protection levels correctly. I have also built the project and deployed to SSISDB.

Thank you


↧

Need help solving script component failure (SSIS Visual Studio tools 2.0 using VB 2008)

April 3, 2014, 8:25 am
$
0
0

Hello,

I am new to SSIS but believe I have fought my way through this one where I almost have it.

I copied am existing successful package that uses a loop (and VB code) for ETL of a file. The difference is that I have a new Excel file with different content (I carefully modified the VB code to match the current file). When I run the package I am down to just a couple of errors now under the “progress  tab”. I am hoping you can point me in the correct direction to resolve this.

First I get a Script Component Runtime Error as I run (debug) this package:

  at Microsoft.SqlServer.Dts.Pipeline.ScriptComponent.get_ReadWriteVariables()

  at SC_712a9d2c4d4a4a48a2c07c5f14c80b1a.vbproj.Variables.get_sFacility()

  at SC_712a9d2c4d4a4a48a2c07c5f14c80b1a.vbproj.ScriptMain.Input0_ProcessInputRow(Input0Buffer Row)

  at SC_712a9d2c4d4a4a48a2c07c5f14c80b1a.vbproj.UserComponent.Input0_ProcessInput(Input0Buffer Buffer)

  at SC_712a9d2c4d4a4a48a2c07c5f14c80b1a.vbproj.UserComponent.ProcessInput(Int32 InputID, PipelineBuffer Buffer)

  at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.ProcessInput(Int32 inputID, PipelineBuffer buffer)

The Data Flow “Progress tab reveals 2 messages

[Create ED1_2 Feeder File [1760]] Error: Microsoft.SqlServer.Dts.Pipeline.ReadWriteVariablesNotAvailableException: The collection of variables locked for read and write access is not available outside of PostExecute.

   at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.HandleUserException(Exception e)

   at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.ProcessInput(Int32 inputID, PipelineBuffer buffer)

   at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostProcessInput(IDTSManagedComponentWrapper100 wrapper, Int32 inputID, IDTSBuffer100 pDTSBuffer, IntPtr bufferWirePacket)

AND #2:

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "Create ED1_2 Feeder File" (1760) failed with error code 0x80131600 while processing input "Input 0" (1762). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the failure.

Any suggestions?  I know the code I copied from the source package works perfectly there, but my copy (and then modified) version of the VB code fails in my new package.

THANKS!!!!!

↧

CDC Splitter Output mismatches with Data Type of Destination Table

October 2, 2013, 1:23 pm
$
0
0

When I use CDC to load data to  destination table ,getting error ‘ can not convert between Unicode and non-Unicode string data types’. The output from CDC Splitter has data type ‘DT_WSTR’ and my destination table has data type ‘DT_STR’.  Destination database collation is  SQL_Latin1_General_CP1_CI_AS

1) I was able to load data using  a Data Conversion task converting to 'DT_STR’  before loading to destination table. Is there a way I can load data without using a Data Conversion Task? . I do not prefer to change my database collation or destination table schema.

2) For a string column out put of CDC Splitter  is always ‘DT_WSTR’  or it is a property I can set ?

I use OLE DB  Connection Manager  with ‘Native OLE DB\SQL Server Native Client 11.0’  to connect to Destination Table in SSIS.

I Use SQL Server 2012.

Thanks,

Reji Sebastian

↧

How adding a data source-data destination inside SSIS 2012-SSDT

April 3, 2014, 7:15 am
$
0
0

Hi,

I need to see inside a SSIS 2012 project a new SSIS installed component but in the SSDT 2010 I cannot see the SSIS Data Flow Items tab for adding data source/data destination respect to the choose toolbox items pane:

It seems a SSIS bug.

Any helps to me, please?

Thanks



↧
↧

flat file format - importing vs typing it out

April 3, 2014, 7:08 am
$
0
0
Hi.  I've heard there is a way to import the format (rather that typing it out in connection mgr) of a fixed width flat file.  What r the general steps or where is there a set of instructions online?  I generally have a txt doc with column names (lots of them) , widths etc that I would use for import and could easily transfer them to a spreadsheet if necessary.   So far the word import is bringing up a lot of unwanted subject matter in my web searches.   I am spending a lot of time typing out flat file formats in conn mgrs and am thinking it may be worth a look at ssis's ability to "import" a format.   We generally land our data in "untyped" staging tables 1st so ssis could assume everything is string.   I dont really want to read my records as one long string and parse them later.
↧

SSIS 2012 Lookup Issue

April 3, 2014, 6:50 am
$
0
0

Hi ,

Currently I am working for SSIS 2012.

I am facing issue with Lookup transformation when I am trying to pass SQL command using Variable.

my variable value (schema change as per DEV ,QA,PROD)

I am trying to use dynamic lookup for that I have set up only SQL qury  of lookup for SQLcommand.

but when pacakge deplyed on server ssis through error saying  SQL command parameter is failed.

do we need to set  SQL command parameter also ?

if yes whe we need to setup both I mean  SQL command and  SQL command parameter.

when I reopen pacakge I have seen SQL command is set properly but  SQL command parameter showing old value how. I have not done anything for  SQL command parameter  from where it geting value and how I am not sure


↧
Search

Having "Test connection failed because of an error in initializing provider"

April 3, 2014, 6:27 am
$
0
0

Hello All,

I have package with multiple connection strings. few of the connection strings throughing error as 'Test connection failed because of an error in initializing provider'.

When i change the provider and click on test connection those are working fine. But when i am executing the package i am getting the same error again and again.

Can any one help me in this?

↧

How to Control flow of Package component in SSIS Package

April 3, 2014, 6:23 am
$
0
0

Hi all,

   While running the package it is not executing in the flow which i have designed in the Control flow

I have designed one package like it having following components in sequence container 

1. Sequence container 1(Some Data flow Task )

2. Backup Task

3.Sequence container (some data flow task )

I want to execute as i mention in the above but it giving error for second operation because these are depend on 1 Task but it is not working it is asking about resource.

As in below diagram i have designed flow which is want execute but it executing 2 task

I want to control the flow of component as i have declared please suggest me way to fix this problem

Sequence defined as below

 

Niraj Sevalkar



↧
↧

Deploying standard changes to SSIS packages

April 1, 2014, 11:27 am
$
0
0
A couple glitches were discovered in our SSIS template.  Approximately 100 packages were built from the template.  Is there a mechanism to update all packages with the changes?  Or do I have to open each one and manually change?
↧

SSIS package takes longer time when pulling data from Oracle

April 3, 2014, 12:45 pm
$
0
0

Hi ,

I have a package in Dev environment where  it takes over 6 mins when loading from a staging table when it is present in SQL Server, but same process takes over 30 mins when pulling from Oracle which is the actual source. are there any best practices when pulling data from other environments into SQL using SSIS. I do know that ssis has to run on 32 bit mode when using Oracle as source but will that cause such a huge perfomance gaps ??

Thanks ,

Vishal.

↧

Import flat CSV file with double quotes and extra comma

April 3, 2014, 12:55 pm
$
0
0

I want to parse this, possibly with RegEx, to get rid of the comma before 'The'. It is causing an extra column.

String 1 Value,"String 2 value (""S2V""), The",12345,String 3 value,2,B,1234,"String 4 value",ABC.

Most rows are ok, without the comma, but not these.

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>