Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS package is not failing when the supplied column valuse are more than the number of columns in a table.

$
0
0

I'm having a table "Sample" with 3 columns COL1, COL2, COL3 and a flat file with below contents

1¦2¦3

1¦2¦3¦4

When I tried to load data from flat file to table, the data is loaded as below

Flat file
  values

Actual
  Result

Expected
  Result

Values   inserted in table

COL
  1

COL
  2

COL
  3

1|2|3

pass

pass

1

2

3

1|2|3|4

pass

fail

1

2

3 |4

But the package should fail, if it gets the values for more than 3 columns. To resolve this I used text qualifier “in flat file. But still I’m facing some issues when the text qualifier is missing.

Flat file
  values

Actual
  Result

Expected
  Result

Values   inserted in table

COL
  1

COL
  2

COL
  3

"1"|"2"|"3"

pass

pass

1

2

3

"1"|"2"|"3"|"4"

fail

fail

no row inserted

"1"|"2"|3"

pass

fail

1

2

3"

"1"|"2"|"3

fail

fail

no row inserted

How to resolve this issue?


Parent package is getting failed even though the child package is executing successfully.

$
0
0

I have a parent package and a child package.

Child package contains foreach loop container, which loads data from a list of flat files to a table. If there is any flat with wrong data (mismatch with the number of supplied values to a number of columns in a table) then the flat file should be rejected and continue with the next file.

But the package was getting failed when the wrong file process and was not continuing with the remaining files. To resolve this I set the propagate property to false.

Now when I call the child package through parent package, the parent package is getting failed even though the child package is executing successfully (might be because the child package task is turning to red when it process problematic file) how to resolve this issue?


I also want my parent package to fail if any other issues arises in a child package exept the above foreach loop container issue.

can't insert dt_str to char type

$
0
0
Hi,

Having problem with OLE-DB connection to informix.

Created a flat file has two columns and 2 row:
1|a
2|b

tried to load it to a informix table:
create table t
( c1  int,
  c2 char
);

2 rows inserted, but only column c1 got data.

Changed c2 from char to varchar then ok.

thanks for any help.

gg


Extracting data from sharepoint using Script in SSIS 2005

$
0
0
Can sharepoint lists be accessed using ODATA in SSIS 2005. Or using web services the only option when getting SharePoint lists data is SSIS 2005 through script task.

SSIS tasks properties

$
0
0

Hi,

          Can any one explain me with example for the following features in SSIS.

1)Direction in execute sql task's parameter mapping:What is the use of output,returnvalue?parameter value is only for passing a value to query rignt?

2)parameter size in Execute Sql task's parameter mapping.

3)Force Executionvalue.




scheduling ssis package fails to post file to unc sharepoint path

$
0
0
  • I have created SSIS package where it  copy files from my local drive (c:) & post it to SharePoint path(\\sharepoint.corp.*******.com\DavWWWRoot\sites\sitename....)

SSIS package works FINE no issue,but when i try to SCHEDULE the same package it throws the following error:

DTExec: Signature verification failed.  The signature status is not present.  The package could not be loaded.  The step failed.

  • sql server and sql server agent SERVICES running my account(DOMAIN\username).
  • i have an access to SharePoint path.
  • i have created PROXY and ran it didn't workout.
  • From DOS command also it works.when i schedule it it will not work.

I am using

  • WINDOWS server 2008 service pack1 64 bit
  • sql server 2008 r2 64 bit

please help me..I'm waiting for the respond...:(

Check Points Enabling in Loop Iterations

$
0
0

Hiii

I have created package of using for each loop container inside contains so many tasks and i set container and each task fail package on failure 'TRUE'.. but when error RAISED i cant able to restart from where error raised so can u pls help me..

After processing each file then send notification with the following format

$
0
0
  1.  After processing each file then send notification with the following format

Subject : {FileName} has been processed.

Body : {FileName} has been successfully processed and transfered {N} records. (Here {N} is number of records transferred from the particular file to table)

Note : Use configurations to get FROM, TO and CC list


how to copy excel files to sharepoint

$
0
0

hi,

how to copy excel files from my C: drive( from remote desk)  to  sharepoint unc path (\\sharepoint.corp.********.com\sitename.......) PRO GRAMMATICALLY  using ssis package.

and i have to schedule the same in sql server agent.

thanks,

Porting data from One Server to Another Server

$
0
0

Hiii

I am Using SSIS 2005, we are Porting data from One server to another server, say 'A' server of 'X' Database contains around 900Gb data of 85 columns, have to port into 'B' server of 'Y' Database, when i Run my Package for first time, it should insert all records(Because of 'New Records' and Destination table should be 'Empty' so), when i run for second Time(Old With New), it should insert only Newly Added Records, if any Modified Records are their In the old Records that should be Insert as a New records, not Updated.

HOW TO ACHIEVE THIS IN SSIS 2005, By Creating PACKAGES with very good performance, Can anyone Please Help Me.

ExecuteProcessTask is not calling bat file?

$
0
0

Hi All,

I have SSIS package which contains execute process task which calls bat file. The bat file contains the below code. In execute process task, i have selected this filename(C:\StartStopPublication\ICRV_STOP.bat) as executable.

@echo off
:Begin
setlocal

SET CLASSPATH=C:\Program Files\Java\jdk1.7.0_03\lib;C:\StartStopPublication\lib;

@echo off
java -Djava.ext.dirs=./lib/ StartStopPublication ogrdsdevuser ogrdsdevpwd Stop CA1 ICRV >MessageID.txt
exit 0

Iam trying to call batch(.bat) file from SSIS of executeProcess task. But The batch file is not triggered when i tried to execute this package. If SSIS execute process task calls this batch file which can write a messageID into text file, it is not happening.

if i run this batch file from command prompt, it is working fine.

Could you please suggest me what i did wrong here.


Thanks & Regards, Anil

Loading Excel files using Multiple Dataflow Task

$
0
0

Hi All,

I have following scenarios in my requirement:

Scenario 1:I have a client folder in which there are multiple clients Eg:- ABC, XYZ. I need to take all the client from the client master and check for the clients in the client folder and load the data only for the existing client's data into the database.

My Solution: I am able to achieve the above task using the script task. I get the names of the Sub-folders  ABC,XYZ etc. which are the existing clients.

Scenario 2:  I need to load all the excel sheets present  in ABC folder then XYZ and so on.. only after they are validate in the scenario 1.The clients which I have got in the client folder has multiple format excel workbook with multiple sheets in it. 

Challenges: I get the sub-folder names in Scenario 1 but to populate the multi format excel I need to have multiple dataflow task as the destination table is different for each format. Depending upon the format I need to pass the control to the respective dataflow task.How to handle such complexity in SSIS?  


Thanks and Regards, Franco Lopes. Ask a Question and you are fool for a second but if don't ask a question you are fool forever.

Comparing data within the same file

$
0
0

Hi,

The data will be in a text file. I need to check the two columns from within the same textfile.

like, we have 2 columns Place and Country as like with below said similar values

---Place---|----Country----

--NY, US--|-----US-----

Alabama-|---------------

Now i have check the column 'Country' whether it is null or not null..accordingly i have to remove the last 2 character of the field 'Place' . If value is there then blindly i can remove the last 2 character from col 'Place' if not i will not remove any characters.

like in above said xample, i will remove the character with expression like substring~~. But i am confused here how to check against the same file..

If any had this similiar kind of work plz do let me know how can i handle this ?

Thanks !


--------------------------- Radhai Krish | Golden Age is no more far | --------------------------

Range In look up transformtation ssis

$
0
0

Hi,

I have a situation where i need to apply look up a range. I have distance_from_dealer column in customer transaction table. I have all the ranges defined in dim.distance table. this has start_range and end_range. So Now i need to match the distance_from_dealer to the between of start_range and end_range.

here is the image.

How do i do that in ssis. 

Thanks for any help.

Eliminating Duplicates upon Importing to DB

$
0
0

Hello!

Everyone on this forum is awesome and have helped alot. I only have one more challenge in my SSIS project. Now that I have "cleansed" the data from Duplicates in an Excel spreadsheet and accomplished many transformations I now need to insert this data into an already existing Table. However, there could be duplicates in the primary ID (called CaseID) between the cleansed spreadsheet data and the Table they are being imported into. How can I check each row I am inserting into the Table to see if it is duplicate and if not, insert it, but if it is send that row to an exception table. This i can not figure out with SSIS how to do. Your guidance will be greatly appreciated. I can implement it if I am directly to the best way to do with with SSIS components.

Thanks again!
Mike


Mike Kiser


Running SSIS packages In Parallel To Optimize

$
0
0


Hi, 

I currently have a Master-Child Packages set up :

1. A Excel CSV file which contains package order, package name and package location

2. I import the CSV file data into the SQL server table and then using the ForEachLoopContainer in Master Package- Execute the child package - using Execute package tasks.

Since I have around 80 child packages, I would want some of the packages which dont have any dependencies to run in parallel and others which do wait for the dependent package to finish and then execute. 

Using the set up that I currently have, please advice possible ways to execute my child packages in  parallel. Currently per my setup all my packages execute one after the other which is not an optimal solution.

Please advice,

Thanks 


EVA05

No Availabel External Columns in XML Source

$
0
0

I got a XML Data file From a Webservice Task,and i want to import data to db(sql server 2008 R2).

In SSIS,use a Data Flow Task,add a XML Source Component,Choose the XML File,Generate XSD file,but no Availabel External Columns in the Columns card.

The following is the XML file:

<?xml version="1.0" encoding="utf-16"?>
<Report xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema">
  <TaskName xmlns="http://send.com/">7.26Send</TaskName>
  <Subject xmlns="http://send.com/">Londen Olympic</Subject>
  <SenderName xmlns="http://send.com/" />
  <SenderEmail xmlns="http://send.com/" />
  <ReplyName xmlns="http://send.com/" />
  <ReplyEmail xmlns="http://send.com/" />
  <SendDate xmlns="http://send.com/">2012-07-26T17:00:00</SendDate>
  <FinishDate xmlns="http://send.com/">2012-07-26T17:02:58</FinishDate>
  <Total xmlns="http://send.com/">1267</Total>
  <Sent xmlns="http://send.com/">1267</Sent>
  <HardBounce xmlns="http://send.com/">188</HardBounce>
  <SoftBounce xmlns="http://send.com/">21</SoftBounce>
  <OpenCount xmlns="http://send.com/">105</OpenCount>
  <UniqueOpenCount xmlns="http://send.com/">83</UniqueOpenCount>
  <MailClicked xmlns="http://send.com/">5</MailClicked>
  <LinkClicked xmlns="http://send.com/">0</LinkClicked>
  <AllClicked xmlns="http://send.com/">6</AllClicked>
  <Unsubscribe xmlns="http://send.com/">3</Unsubscribe>
</Report>

Who can tell me how to generate the XSLT and XSD File,Thanks a lot.

Access to path denied in SSIS 2012 script task

$
0
0

Note: this applies to SQL 2012 only.

I'm using the project deployment model in SQL SSIS 2012

I have a script task inside the SSIS package that renames some files on a domain share. (\\mydomain\myfileshare)

The database owner is a domain user (mydomain\svclogin)

I start the package from a stored procedure like so:

EXEC [SSISDB].[catalog].[start_execution] @execution_id

When the package is deployed to my local machine, it executes without error.

When it is deployed to a remote server on the same domain (2012), I get an error:

Access to the path \\mydomain\myfileshare is denied.

The report log show that the caller is mydomain\svclogin. I added some informational logging of my own and I see that the variable System::UserName is also mydomain\svclogin

I logged on to windows as mydomain\svclogin and verified that I can modify/delete/change files on  \\mydomain\myfileshare

On older packages, I used credentials and proxy accounts to set up access to domain resources.

1. How do you specify the account (a domain account) that will access domain resources in an SSIS 2012 package ?
2. How do I fix the error?


John Lucas - Code Monkey

DataStage Vs SSIS

$
0
0

Hi,

We are in a process of migrating a process running in Ascential Data Stage to SSIS. The database server is ORACLE 9i.

We need samples/guide on the following datastage equivalent features.

1. Calling a function/script/routine from task's Data Flow transformer as Before/After Stage event.
2. Complex XML parsing and loading into sequential files.
3. Creating a batch & based on the condition calling the tasks. For example, if condition=YES then call task 'A' or call task 'B'.
4. Any shared container concept. (A portion of activity will be used by most of the tasks)
5. In the Data Flow Destination, is we have feature like insert new row or update existing row, clear the table and insert etc.,
6. Error log and process log on each task execution.

Could you please provide driver details to use all the SSIS stages to connect to Oracle 9i.

The OLE DB provider used by the OLE DB adapter cannot convert between types "DT_DBTIMESTAMP" and "DT_I4" for date column.

$
0
0

Hi,

I have this OLEDB Source and I am getting the data using sqlcommand

this is my sqlcommand query. I am Not at all converting the birthdate column to int. 

SELECT    
	customer_id, 
	client_id, 
	social_id, 
	provider_id, 
	lead_id, 
	type_gender_code, 
    type_customer_code, 
    type_transaction_code, 
    lead_type_code, 
    first_name, 
    prefix_name, 
    middle_name, 
    last_name, 
    suffix_name, 
    birth_date , 
    address1, 
    address2, 
    city, 
    state, 
    country, 
    zip, 
    facebook_id, 
    twitter_id, 
    email_address, 
    phone_number, 
    dms_link_name, 
    password, 
    user_name, 
    profile_image_url, 
    screen_name, 
    age, 
    [annual salary], 
    is_deleted, 
    dnc_status, 
    cast(isnull(distance_from_dealer,0) as int) as distance_from_dealer 
   
FROM            
	cdc.customer_customer_CT

how to know which one caused this error.

Thanks for any help .

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>