Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS inserting wrong data that's coming from Oracle for field type NUMBER

$
0
0

I have a view in Oracle from which I am reading data and inserting in SQL Server. When I run "desc myview" command then it returns the following:

FIELD1
NUMBER

FIELD2
NUMBER

As you can see both field types are NUMBER. I created similar table in SQL Server with field type "INT" but when records are inserted, in FIELD2 it is inserting -1861 and sometimes 1876 instead of actual value from Oracle. FIELD1 data is fine.

I have checked that data in Oracle is fine and have no issues. I have tried changing INT to FLOAT but still same issue. What could be the reason?

EDIT

By the way even the "Preview" in SSIS packages shows wrong values. You know when I drag and drop that Oracle Source from toolbox, select view name from drop down list and when I click "Preview".


How to handle Null Contraints and how to redirect error rows from Flat file source task,Derived column task,OLEDB Destination too flat file destination and how to get exact error descrption from mentioned data flow task's?

$
0
0

Hi Experts,

Please help me to resolve the below mentioned issues,

(i)I had created NOT NULL table level contraints.

(ii)In SSIS data flow task i have Flat File Source,Derived column and OLE DB Destination(Inserting data into SQL Server table).

(iii)My requirement is i want to redirect error rows to flat file destination from all the above three mentioned task's with exact error descrption(Like we if we try to insert NULL OR '' then we should get error saying "Column doesnot allow nulls" and for primary key voilation also).

(iv)As of now in my SSIS package when i am trying to insert "" empty value to a NOT NULL column i am not getting any error like "column doesnot allow nulls".

(v) and i am not able to get the error description with error rows.

(vi) When i am trying to redirect error rows from OLEDB Destination,it's removing the error data in the row

As i couldn't find exact solution for this issue in this forum kindly help me..

Many thanks,

Asma



How to execute a Task, Pause for 30 seconds then execute again until table row count is zero?

$
0
0


I have looked on the net and read several blogs but cant seem to find what I am looking for.

I need to run a task based on the row count of a table. If the count is greater than zero, then run the task. Pause for 30 seconds, check the count again, then run the task again. keep doing this until the count is zero then stop or move to something else.

Thank you for your help.



emptying a folder using SSIS script task

$
0
0

Hi Guys,

I am generating reports to a directory (folder), via ssis script task and C#.. I want to validate the following..

1. Deleting all old reports except last 10 reports. My report name for example is Report_DDMMYYYY

2. If current report already exists then I want to overwrite that report every time if i run the ssis script task (which exists in a foreach loop container) manually.

I am using Streamwriter to dump the data into a flatfile report.

Thanks.

 

SSIS 2008 - Import all CSV files in folder - each target different table

$
0
0

I'm new to SSIS 2008, and I'm attempting to import a series of CSV files into a database. I want to loop over every CSV file in a specified folder and import each file into a different table that must be created on the fly (name of table should be base name of file, i.e. with path and extension stripped off). The file structures are similar, but not identical, so the single target table solution won't work.

Using an example I found here:

http://microsoft-ssis.blogspot.com/2011/02/how-to-configure-foreach-loop-file.html

I'm able to successfully load all files into ONE table, but I need to load each file into a separate table. Can anyone provide some assistance on exactly how to modify the project to allow for a table to be created, on the fly, for each source file?

thanks,

Mark

 

how to fail a package from script component(data flow)?

$
0
0

Hi,

I want to fail my package in script component from data flow if error row count > 50. and if error row count > 50 then data should not insert into the table itself and package should fail as mentioen.

Note:

I dont want to fail a component fron control flow.

Please any one help me.

HELP: Failed to create the task. (Microsoft Visual Studio)

$
0
0

I created my first SSIS project in BI Dev Studio but get the following error when trying to add a data flow task to the Control container:

==================================

Failed to create the task. (Microsoft Visual Studio)

===================================

Value does not fall within the expected range. (Microsoft.SqlServer.ManagedDTS)

------------------------------
Program Location:

   at Microsoft.SqlServer.Dts.Runtime.Executables.Add(String moniker)
   at Microsoft.DataTransformationServices.Design.DtsBasePackageDesigner.CreateExecutable(String moniker, IDTSSequence container, String name)

Any advice greatly appreciated..

cheers,
jordan

SSIS - Change Config File Path LOCATION in SQL Agent Job Step (NOT USING DTEXEC)

$
0
0

SSISers;

I am not new to ssis but am trying to deal with promoting of ssis config files differently for a specific project. We are using SQL 2008 R2.

As a standared pattern used for years, we just use SQL Agent, build a job step for the ssis package, add the ssis package as SQL Integration Services Package type from fileshare (not using Integration Services), and add the necessary production config files in the configutation tab of the job step. Easy.  We do not execute our packages with DTEXEC command line.

A new project has the developers leaving the config files in the package - not removing the config files for deployment. Is there a way to override JUST THE CONFIG FILE PATH LOCATION in the job step for ssis package? Remember, we are NOT using dtexec.  I was told that /SET might do it but I do not see a good example anywhere of hooking this in and how it works for a CONFIG FILE PATH LOCATION - I see variable overrides but not CONFIG FILE PATH LOCATION. The packages were written with Absolute config file path and not Relative path.

Please understand that my goal is to let them leave the packages as is, we move the config files to the production sever and all we have to do is flip the location of where the config files are sitting for the ssis pacakge to look for them.  We would rather NOT have to use DTEXEC command  line with the job step for reasons that I do no need to get into on this forum.

Any suggestions are appreciated.



Import data from non relational database to relational database

$
0
0

Hi,

I have a task to import data from non relational database to relational database.

I need to check the constraints conditions  of all the columns and check whether it satisfies with new relational database and then only data need to be inserted.

For example validations like foriegn keys, datatype match, no of charcters,etc

Can u anyone give me small example how to do with ssis or any other method.

Thanks In Advance.


Aggregate and delete data from a database

$
0
0

Hi,

We have a MSSQL database used by SCOM 2012R2 for Audit Collection Services. We collect Kerberos logon so the database stores lots of entries which we need to aggregate and once aggregated, remove them from the database to free up space.

Can anyone help me on the right track to do this?

P.s. I know how to open SQL Server Manager Studio and query for some data but that's about as far as my SQL knowledge goes :-/

Grts.

VSTA Opening but No Debugging in SSIS Script Task (VSTA Gui not appearing while Debugging Script Task). Very Urgent!

$
0
0

Hi All,

I am facing a Typical Issue first time... any help please?

I have a package and only one script task with a single line like a MessageBox.Show("test").

I'm trying to set a debug point on that and running the package. Immediately the task turning out yellow but Package is saying 'Execution Completed' although no debug is happening nor the message box is appearing.

Surprisingly, in my Task Manager, I'm getting VSTA.Exe *32 immediately when I'm starting to debug. But VSTA is not opening in Front end. (Although if I just try to execute VSTA.exe from CMD it's working fine and opening the Visual Studio Gui)

Any help please? very urgent.


Regards, Avik M.

How to extract data from multiple flat files to load into corresponding tables in SQL Server 2008 R2 ?

$
0
0

Hi,

          I have to implement the following scenario in SSIS but don't know how to do since I never worked with SSIS before. Please help me.

          I have 20 different text files in a single folder and 20 different tables corresponding to each text file in SQL Server 2008 R2 Database. I need to extract the data from each text file and load the data into corresponding table in Sql Server Database. Please guide me in how many ways I can do this and which is the best way to implement this job.  Actually I have to automate this job. Few files are in same format(with same column names and datatypes) where others are not.

1. Do I need to create 20 different projects ?

               or

    Can I implement this in only one project by having 20 packages?

             or

    Can I do this in one project with only one package?

Thanks in advance.

Import/SSIS Issue

$
0
0

Hi All,

We are trying to insert records returned from query to table but whenever
we map the column, we are getting different column than what we selected.
Here is the script from which we want data to be inserted.
This return the server space detail


Thanks

Data Flow Task. Issues with the memory allocation and deallocation.

$
0
0

Good morning,

I'm testing in my local database a SSIS package. This package extracts data from 5 different sources with OLE DB Dataflow Sources, transforms it with Derived Columns Transformations, joins it with an Union All and finally stores it in the Staging Database with an OLE DB Data Flow Destination.

The issue that I've detected is, that before de execution of the package I have 2673MB in use and after the execution the memory usage is 7824MB . When the package finishes to store the 20M of rows, it doesn't deallocate the memory allocated along the process.

Because I'm using a OLE DB Destination with "Fast Load", I've tried to change the parameter "Maximum Insert Commit Size" from the default value to 1000000. The result is the same.

I've checked the OLE DB Sources configuration too and I couldn't find configuration about the memory allowance.

Does anyone know what can be the reason of this problem?

Kind regards.

Extract data from Flat file CSV to SQL Server 2008 using SSIS 2008 (Data gets corrupted when extraction)

$
0
0

Hi,

I am trying to extract data from multiple CSV files to SQL into a single table. The data type of all the columns in SQL table is nvarchar(MAX).  I am able to extract the data from the flat files but some of the data(on extraction) is corrupt including question marks(?) and other invalid special characters. Also I tried selecting the UTF-8, 65001(Unicode) format but the problem still persists. Also I tried using data converter but no use.

I checked with the data in the flat file but there is no data with question mark(?) or any other special characters.

The separator in the flat file is Comma(,)

Please help.

Thanks in advace.



Expression to select only FileName Dynamically.

$
0
0

Hi,

I have file names like below  and i need to capture only name part using ssis.

QHP_Strategy_20140117110230.txt

QHP_Strategy_20140117110231.txt

I need to select  Only File Name  QHP_Strategy 

How to get this please help me in building an expression Dynamically.

Thanks

Suresh

Extract Data from the BMC Remedy

$
0
0

Hi ALL ,

Our organization is using the BMC Remedy to maintain Incidents and Work Orders . Am working on a  Sql Server Reporting project for that  i need to access data from the BMC Remedy Tables . I thought of 2 approaches one is creating a linked Server to the BMC DB and other one is loading data into reporting DB Via SSIS. For the first approach i have already asked a question in the concerned forum .

Am a newbie so kindly guide me how can i extract the data from the Remedy DB and create reports over it . If there is another suitable solution kindly suggest because my end requirement is to create Reports over the BMC Remedy data .

Thanks

Priya

Troubleshooting the cryptic error - 0xC002F210

$
0
0

When I try to execute my SSIS package in SQL server agent, an execute SQL task in my SSIS package fails. I get the error - 0xC002F210. The query works correctly in Management studio and even in SSIS. I checked everything and it seems fine. Yet, i get the error -

Code:0xC002F210
Source: GetData Execute SQL Task     
Description: Executing the query "SELECT          [col_1]        
[col_2..." failed with the following
error:"Invalid object name 'TableThatReallyExists'.".
Possible failure reasons: Problems with the query "ResultSet"
property notset correctly parameters notset correctlyor connection not established correctly.End Error  DTExec: The package execution returned DTSER_FAILURE (1)

That error is misleading. The table name is correct and it actually exists. How do I find out what is actually causing the problem. I don't know if I am missing something or if its a quirk of SSIS.

How to find out if SQL server Agent has access to a remote server ?

$
0
0
I want to execute a job from Server1. This job will execute a query on a DB of Server2. I don't know if Server1's SQL server agent has access to Server2's DBs. Is there a way to find out ? If yes, then also is there a way to allow Server1 to access Server2 ?

I do not want to use linked servers and such. 

Thanks.

How to Import Excel 2007 worksheet that has more than 255 columns into SQL Server 2008 table using SSIS 2008.

$
0
0

I am using Excel source which uses Microsoft ACE 12.0 OLE DB provider, this only allows the first 255 columns to be imported and not the rest.

I need to export all the columns into the table .

Any pointers to this is greatly appreciated

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>