Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS Package execution fails with project parameters

$
0
0

Greetings,

I am looking into utilising the new project deployment model for SSIS with MSSQL 2012.

I have created a simple project that has a entrypoint package calling a number of child packages, where the check point file name property is populated via an expression that references an project parameter named CheckPointFileNameBase.

The child packages are executed via an execute package task (in process)

When the SSIS project is tested in VSDT, everything works as expected and the checkpoint files are created.

When the SSIS project is deployed to MSSQL Integaration Services Catalog, configured and executed; the child package fails to execute.

The error is that there is no appropriate variable for the check point file name property. When I execute the child package directly with the same configuration as for the entry point package then the execution succeeds.

Thus my question is how to correctly configure the deployed package such that project parameters are available to all child packages?

The route I dont want to take is to pass the parameters from entry point to child package as this would defeat the purpose of shared project parameters.


Thank you and Kind Regards


No rows returned when importing a view from Oracle to SQl Server

$
0
0
When I try to import a specific view from Oracle 11 to SQL server 2008, there are no rows returned.  However, this same view imports into Access 2010 and Access 2002 quickly and easily.   There are many other views and tables that I import routinely with no problem.  But this import process for the view worked for 10 years, but stopped only when we created a new instance (And yes our tnsnames file is updated.  When I "Test Connection" all is OK.  When I run a SSIS package, i see zero rows returned and no errors.  When I try to import directly into SQL management studio the same results, no errors, no rows.  I have tried the import on 2 SQL servers, 2008 and 2008 R2.  I have tried it with Oracle 10 and Oracle 11 drivers.

Long duration Pre-Execute phase

$
0
0
Does anyone know why SSIS sometimes just sits in the Pre-Execute phase of a data flow and does nothing?  It doesn't matter how elaborate the data flow is or the volume of data.  It can sometimes take 80% of the task's run time.

SSIS OLE DB Source - Query is fast but procedure lasts forever

$
0
0

Hi everyone!

I have a simple package: one OLE DB Source and one OLE DB Destination.

An interesting problem happened - when I execute query in OLE DB Source component it executes and fills the table in 5 minutes. When I create the stored procedure from that same query and callexec proc_name, it's not working and is stucked in "Pre-Execute phase is beginning." for 1, 2,...5 hours!

So far I've tried following:

  • delete / recreate the procedure
  • create procedure with new name
  • DBCC FREEPROCCACHE on database where procedure is created (procedure queries the data from 3 databases)
  • SET FMTONLY OFF at the beginning of the procedure and also before calling the procedure (beforeexec proc_name)
  • grant execute on the procedure 

and nothing works for me. Does anyone has a clue what could be the problem? Is there any way to trace what is going on and why is this happening?

Thanks in advance,

Miljan

some question

$
0
0

hi,

 

as you can see from the excel source 65,535 rows and 58,110 rows are coming into sort.

but after sort why it is less.

it i remove all other component and just execute till merge, its same no of rows

i dotn understand why i am getting error,

Error: 0xC0209029 at Data Flow Task, OLE DB Destination [113]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "OLE DB Destination.Inputs[OLE DB Destination Input]" failed because error code 0xC020907B occurred, and the error row disposition on "OLE DB Destination.Inputs[OLE DB Destination Input]" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "OLE DB Destination" (113) failed with error code 0xC0209029 while processing input "OLE DB Destination Input" (126). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Merge Join" (80) failed with error code 0xC0047020 while processing input "Merge Join Right Input" (88). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Sort 1" (160) failed with error code 0xC0047020 while processing input "Sort Input" (163). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Sort" (145) failed with error code 0xC0047020 while processing input "Sort Input" (148). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

Issue with package and config files

$
0
0

Greetings,

I'm a little stuck with a package I've inherited from someone else.

The package extracts lists out of Sharepoint so there are a few tasks to define lists and create a SQL table etc...

The issue I have is when I run the package, I get the following errors in the Output window.

 The package is attempting to configure from the XML file "C:\Path\configName.dtsConfig".
The configuration file name "C:\Path\configName.dtsConfig" is not valid. Check the configuration file name.

The config files seem to be for the useraccount and sharepoint lists.  However, the path indeed doesn't exist now and I'm not sure where to configure the package to use new dtsConfig files, if need be.

1. I'm assuming I need to create new config files?

2. how do I change the path with the package to the new config files?

Many thanks

SSIS - extract all SharePoint 2010 lists to file

$
0
0

Hi,

I was looking at a way of extracting all lists in a Sharepoint 2010 site.  This includes parent and child lists with all columns in the views.

I've looked at the SharePoint List Source & Destination Adapter from Codeplex but am not sure if I can use this to extract all lists with the adapter.

Please can someone help me find an easy (ish) solution that will accomplish this?

Many thanks

Is there a way to programmatically display the SSIS task Log Error message in VB.NET as shown in this message?


populate two tables from an xml file with xsd

$
0
0

How to populate the following tables from the following xml file which has the following xsd

I would like to use xslt

Tables:

Question

Questionid

questionnarrative

questiontype (multiple choice, true and false,etc.)

 

Question_answer

QuestionID

AnswerID

AnswerSeq

AnswerNarrtive

Correct_Y/N

Feedback

WrongAnswerFeedback

 

Test_Question

TestID

 QuestionID

page#

Sequence#

maxpoint

schema:

http://www.imsglobal.org/xsd/ims_qtiasiv1p2p1.xsd

assessment xml file

<?xml version="1.0" encoding="ISO-8859-1"?>

<questestinterop xmlns="http://www.imsglobal.org/xsd/ims_qtiasiv1p2p1" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">

  <assessment ident="QDB_1" title="Pretest">

    <qtimetadata>

      <qtimetadatafield>

        <fieldlabel>cc_profile</fieldlabel>

        <fieldentry>cc.exam.v0p1</fieldentry>

      </qtimetadatafield>

      <qtimetadatafield>

        <fieldlabel>qmd_assessmenttype</fieldlabel>

        <fieldentry>Examintaion</fieldentry>

      </qtimetadatafield>

    </qtimetadata>

    <section ident="S_1">

      <item ident="QUE_104045" title="Question 01">

        <!-- start multiplechoice -->

        <itemmetadata>

          <qtimetadata>

            <qtimetadatafield>

              <fieldlabel>cc_profile</fieldlabel>

             <fieldentry>cc.multiple_choice.v0p1</fieldentry>

            </qtimetadatafield>

            <qtimetadatafield>

             <fieldlabel>cc_question_category</fieldlabel>

             <fieldentry>Chapter 01</fieldentry>

            </qtimetadatafield>

          </qtimetadata>

        </itemmetadata>

        <presentation>

          <material>

            <mattext texttype="text/html">Which of the following best defines psychology?</mattext>

          </material>

          <response_lid ident="QUE_104045_RL" rcardinality="Single">

            <render_choice>

             <response_label ident="QUE_104045_A1">

               <material>

                 <mattext texttype="text/html">the scientific study of behavior and mental processes</mattext>

               </material>

             </response_label>

             <response_label ident="QUE_104045_A2">

               <material>

                 <mattext texttype="text/html">the science of mental and emotional disorder</mattext>

               </material>

             </response_label>

            </render_choice>

          </response_lid>

        </presentation>

        <resprocessing>

          <outcomes>

                                                 <decvar minvalue="0" maxvalue="100" varname="SCORE" vartype="Decimal"/>

          </outcomes>

          <respcondition continue="Yes">

            <!-- note: general feedback is provided unconditionally -->

            <conditionvar>

             <other/>

            </conditionvar>

            <displayfeedback feedbacktype="Response" linkrefid="general_fb" />

          </respcondition>

          <respcondition title="Correct">

            <conditionvar>

             <varequal respident="QUE_104045_RL">QUE_104045_A1</varequal>

            </conditionvar>

            <setvar action="Set" varname="SCORE">100</setvar>

            <displayfeedback feedbacktype="Response" linkrefid="QUE_104045_A1_fb" />

            <displayfeedback feedbacktype="Response" linkrefid="correct_fb" />

          </respcondition>

        </resprocessing>

        <itemfeedback ident="QUE_104045_A1_fb">

          <flow_mat>

            <material>

             <mattext texttype="text/html"><![CDATA[Feedback for 1]]></mattext>

            </material>

          </flow_mat>

        </itemfeedback>

        <itemfeedback ident="QUE_104045_A2_fb">

          <flow_mat>

            <material>

             <mattext texttype="text/html"><![CDATA[Feedback for 2]]></mattext>

            </material>

          </flow_mat>

        </itemfeedback>

      </item>

      <item ident="QUE_102010" title="Question 02">

        <!--start trueorfalse-->

        <presentation>

          <material>

            <mattext texttype="text/html">Sigmund Freud and Carl Jung both belong to the psychoanalytic school of psychology.</mattext>

          </material>

          <response_lid ident="response_1" rcardinality="Single">

            <render_choice>

             <response_label ident="true">

               <material>

                 <mattext texttype="text/html">True</mattext>

               </material>

             </response_label>

             <response_label ident="false">

               <material>

                 <mattext texttype="text/html">False</mattext>

               </material>

             </response_label>

            </render_choice>

          </response_lid>

        </presentation>

        <resprocessing>

          <outcomes>

                                                 <decvar minvalue="0" maxvalue="100" varname="SCORE" vartype="Decimal"/>

          </outcomes>

          <respcondition continue="Yes">

            <conditionvar>

             <other/>

            </conditionvar>

            <displayfeedback feedbacktype="Response" linkrefid="general_fb" />

          </respcondition>

        </resprocessing>

        <itemfeedback ident="general_fb">

          <flow_mat>

            <material>

             <mattext texttype="text/html"><![CDATA[general feedback]]></mattext>

            </material>

          </flow_mat>

        </itemfeedback>

      </item>

    </section>

  </assessment>

</questestinterop>


sz

how to add a datetiemstamp on filename generated by flat file destination

$
0
0


in my data flow task, i have oledb source and flat file destination (using flat file connection manager)

here in above data flow, oledb source has some sql statmenet as

select  '"'+ employee + '","'+ +  '","'+ eid+ + '","'+ empcity + '","'+ EMPDOB + '"'

it will write to file in d:\ssis\myfile.txt

so  far it is working fine now,

but now how to have filename with date and time stamp on it i.e., when the file generates

myfile 11/5/2012 16:30.010.txt

myfile 11/5/2012 17:13.010.txt

myfile 11/5/2012 18:33.010.txt

myfile 11/5/2012 19:20.010.txt

etc

how can i acheive this, could some body please assist me, or any other ideas please ....

Thaanks in advance
asitti

Load a flat file which has details within a header

$
0
0

Hey,

I have a file, which looks like this:

--Records Start

Id = 1

Name = John

INum = 2341

###

###

1,20120823,141213,0001

1,20120824,141234,1234

###

###

--Records End

I need to load this file into a sql table with Id,Name,INum,Date(Value=20120823),Snum(value=141213)

How can i achieve this?

SSIS Flat File(.csv) Issue

$
0
0

Hi All,

I have a SSIS 2005 package where in the Flat file connection manager, I have specified two columns, with CR - LF as Row delimiter and Comma as Column delimiter(,).

Sample file:

Id, Name

1,Raj

2,ABC

3,DEF

But during run time I placed a file similar to below structure,

Id

1

2

3

As you can see, there is one column totally missing. And I don't expect SSIS to dynamically handle this, rather fail saying Invalid File Format. But package executes successfully and when I placed a data viewer I could see no rows.

Do we have a work around to fail for this scenario?


Rajkumar

BCP query out file naming question

$
0
0

Is it possible to pull data from the db and make it part of the queryout filename.    It would be Date time stamp and trailer#.csv

set SAVESTAMP=%DATE:/=-%@%TIME::=-%.csv
set SAVESTAMP=%SAVESTAMP: =%
bcp "SELECT holmandb.dbo.tlcentry.tl_ID, holmandb.dbo.tlcentry.recordno, holmandb.dbo.tlcentry.tl_recvr, holmandb.dbo.tlcentry.tl_trailer_no, holmandb.dbo.tlcentry.tl_sku_no, holmandb.dbo.tlcentry.tl_julian_date, holmandb.dbo.tlcentry.tl_ac_no, holmandb.dbo.tlcentry.tl_time, holmandb.dbo.tlcentry.tl_qty_no, holmandb.dbo.tlcentry.tl_partialflag from holmandb.dbo.tlcentry " queryout "s:\Material Handling\Holman\Load Reports\tlreport_%SAVESTAMP%" -Slocalhost\HOLMAN -T -c -t, -r\r

Question on Script task

$
0
0

Hi,

Could you please tell me if the C# code written inside below funciton under a script task, would it execute the statement sequentially?

public override void Input0_ProcessInputRow(Input0Buffer Row) {

string x= "" ;

Row.Column1 = x + "Somevalue";

}

In the above code, would the value x be initialized as empty string for each row in the Data Flow?

In the above code, would the Column1 have  value of just "somevalue" or would it append with previous values?



how to load xml file that has complex type mixed=ture in its schema to sql database table

$
0
0

how to load xml file that has complex type mixed=ture in its schema to sql database table

I have an xml file and a schema that has complex type mixed=true

what is the best way to import the data from xml file to a table or create one from the xml file

how to pick only selected columns

Thanks


sz


see existing data

$
0
0

hi,

i am getting new file,i need to see if that file has 1 column number,if that number is already exists in table then ignore ,if not add it.

how to do it

SSMS connect to remote ssis error: Not enough resources are available to complete this operation

$
0
0

Hello together,

I installed a new SQL 2008 R2 server with all components.

I get the following error if I try to connect from my laptop to the Integration Services: (local ssms connect works fine)

Connecting to the Integration Services service on the computer "ServerName" failed with the following error: "Not enough resources are available to complete this operation.".

What did I configure:

- Windows Firewall port ‘135’ and MsDtsSrvr

- Client components, dcom config ‘MsDtsServer100/security’

- User is in the local admins

I get the same error with a switched of Firewall.

I’m browsing the web since this morning without any results.

Do you guys know about this error?

Thanks

backup of 2000 database to 2012

$
0
0

i wan tot back 2000 database to sql 2012.

but it shows an error : "not compatible with this version."

is there any other way i can do it

Logging an SSIS task

$
0
0

I set up a connection in my SSIS program to a folder/file for logging.  When I run the SSIS program I have to go to the logging tab, select 'SSIS log provider for Text files' then select my Log connection in the Configuration String.  Is there a way to do this automatically?  Can I run a script that includes these settings?  Can this be done from a SQL Agent job?

Thanks.

Processing XML files in SSIS and Update table in Sql Server

$
0
0

Hi,

I have two XML files ,accepted.XML and rejected.XML which have similar structure. One of the nodes of these files is CLIENT_CLAIM_NUM. IF the CLIENT_CLAIM_NUM ifs from accepted.xml I need to update SQL Server table with corresponding status as accepted.Same is the case with rejected.xml
My accepted.XML has the following structure:

<CLAIM>
  <CLIENT_CLAIM_NUM>1</CLIENT_CLAIM_NUM>
  <Vendor_ASSIGNED_CLAIM_NUM>434772</Vendor_ASSIGNED_CLAIM_NUM>
  <LASTNAME>#########</LASTNAME>
  <Date>2012-01-06T00:00:00</Date>
</CLAIM>

Also how can I send the count of claim numbers in each file by mail?

Thanks for your time and help.

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>