Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Where is the package data(XML) stored?

December 23, 2014, 2:15 pm
$
0
0

We have created an SSIS catalog and deployed our packages using the deployment wizard.  We would like to know where the actual package(XML) gets stored.  We have looked inside SSISDB in internal.packages, we have looked in MSDB in the sysssispackages table, we have looked at the file system of the server in DTS\Packages and they are no where to be found.

The reason we want to know is so that we may be able to configure them to be stored in SSISDB and then we would be able to leverage AlwaysOn to have package data automatically replicated in another data center.  

↧
Search

why dataviewer is not popping up in visual studio 2013 SSIS?

February 26, 2016, 10:24 am
$
0
0

Hi  Experts,

I am using visual studio 2013 for integration service.  in side data flow task i put data viewer. but run time it is not popping up.

Why it happen? how i can resolved it?

i had also check to create ohter project and check sample but its not popping up at all 

↧
↧

Querying SSIS XML definition - package deployment method

March 1, 2016, 4:13 am
$
0
0

Hello,

I need to query the xml defintion of SSIS packages which we have deployed using the package deployment method.

These packages do not exist on the msdb.dbo.sysssispackages table but on the catalog.packages table on the SSISDB database.

Is there a way of querying these packages? We are using SQL 2014 and deployed the packages using Visual Studio 2013.


Thanks

↧

Updating SSIS 2014 Project Deployment

March 1, 2016, 7:29 am
$
0
0

A dev created an ispack which I deployed and configured. Unfortunately a bug was found so I need to re-deploy a corrected package of the same name.  When I do that will I need to re-establish the configuration on the Server (like I did the first time) or will SSIS use the existing config? Are there any other things (as in "surprises") I should watch out for?

TIA,

edm2

↧

Issue with SQL Server 2005 Job agent - Auto schedule job fails

January 20, 2016, 10:27 pm
$
0
0
We have a SSIS package using BIDS 2005. It has a sub package being called from the task.
All these days , we had stored procedures to be called from the subpackage and is running fine.
We had a requirement to extract data from Teradata using Volatile table concept to send data to-and-from SQL server tables.
We created a .net console application exe using 2.0 framework for the above and called this exe from the individual tasks.  Framework on the server where the job is deployed is also 2.0
From BIDS it is perfectly running fine and even from SQL Job agent it is running fine when scheduled for multiple times on the same day, but when the schedule is set for next day , it is failing.
The error code is

Code: 0xC0029151

   Source: Get Customer Name Address (NW_CUSTOMER_NAME_ADRS FastBuild) Execute Process Task

   Description: In Executing "E:\SLS_after430GDWConsoleAppn\ConsoleExe\GDW_Teradata.exe" "SLSReports_ReleasesGDW_REL_CUSTOMER_NAME_ADRS" at "", The process exit code was "-532459699" while the expected was "0".

End Error

DTExec: The package execution returned DTSER_FAILURE (1).
We searched google and based on the suggestions provided, we ensured both the development OS and the server where it is deployed is 32 bit, ensured to the set the protection level to "Rely on server storage" while deploying, and the permissions of the job agent (owner of the job)  has full permissions where the exe is placed.
It runs fine after deployment for 3 to 4 times automatically, but when we reschedule it to next day, it is failing. Error code being same.
↧
↧

To run a SSIS package outside of SQL Server Data Tools you must install Move File to Archive of Integration Services or higher

February 12, 2016, 9:43 am
$
0
0

I am testing SSIS package that I upgraded from VS2005 project to VS2013 project. This is very simple package which just processes files and updates database based on those files. And I am getting odd error and I cant find solution for that.

Issue is my package runs fine and it does exactly what it suppose to do (extracting data from file and inserting into table). But part of this operation is to move file to archive. And I am getting this error"Description: To run a SSIS package outside of SQL Server Data Tools you must install Move File to Archive of Integration Services or higher." 

I have used VS2013 with SSDT BI for 2014 and SSIS Designer version matches with dtexec utility in my dev test VM (12.0.2000.8 x64 bit). Below is output from CLI.

I am sure it has something to do with some missing component but I just can't figure out what. Any help is appreciated.

Microsoft (R) SQL Server Execute Package Utility
Version 12.0.2000.8 for 64-bit
Copyright (C) Microsoft Corporation. All rights reserved.

Started:  10:45:58 AM
Progress: 2016-02-11 10:45:59.20
   Source: Truncate StagingTable
   Executing query "TRUNCATE TABLE StagingTable".: 100% complete
End Progress
Progress: 2016-02-11 10:45:59.25
   Source: Insert into Staging
   Executing query "exec dbo.staging  @xml_fileName,NULL,'C...".: 100
% complete
End Progress
Progress: 2016-02-11 10:45:59.25
   Source: Move to MasterXML
   Executing query "exec dbo.insertXML".: 100% complete
End Progress
Error: 2016-02-11 10:45:59.25
   Code: 0xC000F427
   Source: Move File to Archive
   Description: To run a SSIS package outside of SQL Server Data Tools you must
install Move File to Archive of Integration Services or higher.
End Error
Progress: 2016-02-11 10:45:59.30
   Source: Execute SQL get_next_file
   Executing query "exec get_next_file".: 100% complete
End Progress
Progress: 2016-02-11 10:45:59.51
   Source: Execute SQL notify_users
   Executing query "exec notify_users".: 100% complete
End Progress
DTExec: The package execution returned DTSER_SUCCESS (0).
Started:  10:45:58 AM
Finished: 10:45:59 AM
Elapsed:  1.172 seconds

↧

Get the lasted file from a ftp server

March 1, 2016, 8:52 am
$
0
0

Hi all

I need to get the last file put in a remote FTP directory but I don't much Visual C# or VB code to use the script task component.

I saw the way to achieved it from a local path in the following page

http://www.techbrothersit.com/2013/12/ssis-how-to-get-most-recent-file-from.html

What I need is to implement the ftp connection in the code so It can implement this logic remotely

Can Anyone help me?

Thanks in advanced

Security

↧

SSIS transaction

March 1, 2016, 12:09 pm
$
0
0
So I have been struggling with handling transactions in SSIS. My requirement is to achieve transaction without enabling MSDTC service and I have partially achieved that but I just got another error which I feel like is one of the many bugs in SSIS. I used execute SQL task and explicitly mentioned begin tran and commit/rollback tran in my package. My package is working fine. All the tables are enclosed in a sequence container. I have a condition where one output from one table goes in 2 different tables and that's where the problem is. The funny part is even the package fails, I will still see insert in only these two tables. SSIS is shown in the attached image. I have disabled two tables. These two tables take input from Frholdsum and even if the package fails and there is no data in FDR holdssum tables. Microsft never ceases to amaze me :(.
↧
Search

ETls with excel source connection manager are failing while executed from SQL job

March 2, 2016, 4:22 am
$
0
0

Executed as user: <Service Account>. Microsoft (R) SQL Server Execute Package Utility  Version 11.0.3373.0 for 32-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  6:20:55 PM  Error: 2016-02-29 18:20:56.86     Code: 0xC0202009     Source: Connection manager "Excel Connection Manager"     Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.  An OLE DB record is available.  Source: "Microsoft Access Database Engine"  Hresult: 0x80004005  Description: "Unspecified error".  

This is the error I keep on getting when I try to run the etl from sql job, while the same etl runs perfectly when I run it from visual studio.

Version: SQL Server 2012 enterprise edition

Visual Studio 2010.

I want to mention one more thing that this is not a new etl I am trying to deploy and run. I have plenty of such etls which pull data from excel source and they were all working fine till last week. I am experiencing this problem for last few days only. 

↧
↧

Lookup transformation from sample AdventWorks giving error

September 5, 2012, 9:34 am
$
0
0

I am following the sample given in the msdn adventworks and I am on the step 9 of the testing package phase and I can't seem to fathom what the problem might be, I have mapped key to the correct columns and is still giving me error , the error details are displayed here: 

SSIS package "Lesson 1.dtsx" starting.
Information: 0x4004300A at Extract Sample Currency Data, SSIS.Pipeline: Validation phase is beginning.
Information: 0x4004300A at Extract Sample Currency Data, SSIS.Pipeline: Validation phase is beginning.
Information: 0x40043006 at Extract Sample Currency Data, SSIS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Extract Sample Currency Data, SSIS.Pipeline: Pre-Execute phase is beginning.
Information: 0x402090DC at Extract Sample Currency Data, Extract Sample Currency Data [1]: The processing of file "C:\Users\bishal.TRIANGLE\Desktop\sample adventworks\Integration Services\Tutorial\Creating a Simple ETL Package\Sample Data\SampleCurrencyData.txt" has started.
Information: 0x400490F4 at Extract Sample Currency Data, Lookup Currency Key [26]: component "Lookup Currency Key" (26) has cached 14 rows.
Information: 0x400490F5 at Extract Sample Currency Data, Lookup Currency Key [26]: component "Lookup Currency Key" (26) has cached a total of 14 rows.
Information: 0x402090E2 at Extract Sample Currency Data, Lookup Currency Key [26]: The component "Lookup Currency Key" (26) processed 14 rows in the cache. The processing time was 0.016 seconds. The cache used 728 bytes of memory.
Information: 0x402090E4 at Extract Sample Currency Data, Lookup Date Key [51]: The component "Lookup Date Key" (51) succeeded in preparing the cache. The preparation time was 0.001 seconds.
Information: 0x4004300C at Extract Sample Currency Data, SSIS.Pipeline: Execute phase is beginning.
Information: 0x402090DE at Extract Sample Currency Data, Extract Sample Currency Data [1]: The total number of data rows processed for file "C:\Users\bishal.TRIANGLE\Desktop\sample adventworks\Integration Services\Tutorial\Creating a Simple ETL Package\Sample Data\SampleCurrencyData.txt" is 1097.
Error: 0xC020901E at Extract Sample Currency Data, Lookup Date Key [51]: Row yielded no match during lookup.
Error: 0xC0209029 at Extract Sample Currency Data, Lookup Date Key [51]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "component "Lookup Date Key" (51)" failed because error code 0xC020901E occurred, and the error row disposition on "output"Lookup Match Output" (53)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.
Error: 0xC0047022 at Extract Sample Currency Data, SSIS.Pipeline: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Lookup Date Key" (51) failed with error code 0xC0209029 while processing input "Lookup Input" (52). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.
Information: 0x40043008 at Extract Sample Currency Data, SSIS.Pipeline: Post Execute phase is beginning.
Information: 0x402090DD at Extract Sample Currency Data, Extract Sample Currency Data [1]: The processing of file "C:\Users\bishal.TRIANGLE\Desktop\sample adventworks\Integration Services\Tutorial\Creating a Simple ETL Package\Sample Data\SampleCurrencyData.txt" has ended.
Information: 0x40209314 at Extract Sample Currency Data, Lookup Date Key [51]: The component "Lookup Date Key" (51) has performed the following operations: processed 1 rows, issued 1 database commands to the reference database, and performed 0 lookups using partial cache.
Information: 0x402090DF at Extract Sample Currency Data, Sample OLE DB Destination [76]: The final commit for the data insertion in "component "Sample OLE DB Destination" (76)" has started.
Information: 0x402090E0 at Extract Sample Currency Data, Sample OLE DB Destination [76]: The final commit for the data insertion  in "component "Sample OLE DB Destination" (76)" has ended.
Information: 0x4004300B at Extract Sample Currency Data, SSIS.Pipeline: "component "Sample OLE DB Destination" (76)" wrote 0 rows.
Information: 0x40043009 at Extract Sample Currency Data, SSIS.Pipeline: Cleanup phase is beginning.
Task failed: Extract Sample Currency Data
Warning: 0x80019002 at Lesson 1: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED.  The Execution method succeeded, but the number of errors raised (3) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
SSIS package "Lesson 1.dtsx" finished: Failure.
The program '[7056] Lesson 1.dtsx: DTS' has exited with code 0 (0x0).

Any help would be greatly appreciated.

↧

SQL 2005 -> SQL 2000

July 18, 2006, 12:00 pm
$
0
0
How can I export my database from SQL Server 2005 to SQL Server 2000? Restoring .bak, does not work. I'm lost here.

I have created a db on my dev machine which runs SQL Express 2005 and I wouldn't have ever dreamed that you can't transfer data from SQL 2005 to SQL 2000. There's even a setting to set compatibility of the db (and I have it set to SQL 2000) which doesn't help at all.

Maybe you can suggest an intermediate format to use? For example, with mysql you can easily export the whole db (structure + data) in one text file. I think there should be a way to at least export db structure from SQL 2005 and then import it to SLQ 2000. SQL Server Management Studio Express (which I use with my SQL Express) allows me to copy-paste the data in db tables, so I could paste the raw data into text files and then import them in SQL 2000. Those are just my thoughts, I don't have an idea how to do what I need. It's just a database export/import, I can't believe MS has a problem with this.

Any help would be greatly appreciated.
↧

SSIS in VS 2012 -- Set 32-bit mode permanently?

September 8, 2014, 7:46 am
$
0
0
I am using BIDS in Visual Studio 2012. I need my SSIS packages to run in 32-bit mode. I set the debugging property for Run64BitRuntime to "false," but the next time I start Visual Studio it's set back to "true." Is there a way to set VS to use 32-bit mode all the time without having to manually change it every time I open my project?
↧

64 bit excel/ssis error DTS_E_OLEDB_EXCEL_NOT_SUPPORTED, Access Database Engine 2010 Redistributable

March 1, 2016, 2:19 pm
$
0
0

Attempting to load data from Excel to SQL via 2008 BIDS/VS 2008 SSIS package, built on a 64 bit windows 7 machine, connecting to Excel 97-2003 and a SQL Server 2008 R2 database. I have gotten it to work on this machine after setting the Run64BitRuntime setting to false in BIDS. I have now copied the dtsx package file and config file to a 64 bit windows 2008 r2 standard server, set up the sql agent job, checked the "use 32bit runtime" box on the job step, I have also verfied that the 32 bit components BIDS and Management Tools -Complete were installed, but when the job runs it fails with "Description: SSIS Error Code DTS_E_OLEDB_EXCEL_NOT_SUPPORTED: The Excel Connection Manager is not supported in the 64-bit version of SSIS, as no OLE DB provider is available." error. 

Looking for what options I have here as I would prefer not to install excel/office on the server. I have read Todd McDermid's very thorough posts on this topic which have helped but not resolved. I believe I still need to install some updated drivers (Access database engine 2010 redistributable 32 or 64 bit) but have not done that as I wanted to see if I could get any further advice from what Todd has posted. One more thing I will mention, the package is straight forward data flow task, it has an excel source, a conditional split, a transformation of the columns, and a oledb destination.

Todd's McDermid's rundown on this: http://toddmcdermid.blogspot.com/2009/10/quick-reference-ssis-in-32-and-64-bits.html

Thanks.


↧
↧

Varable expression yesterdays date

March 5, 2012, 11:01 am
$
0
0

Hello All!

I wrote out an expression to get files current date and it works just fine. Well now the scope has changed and now they need previous days date and I'm having issues getting that to work. What I've been reading is that I need to use the DATEADD function, however when I attempt to use it in many different ways it blows up during the evaluate process.

"File_DP_" +  (DT_STR, 4, 1252) YEAR( GETDATE()  )  +  (LEN((DT_STR, 2, 1252) MONTH( GETDATE()  ) ) == 1 ? ("0" + (DT_STR, 2, 1252)  MONTH( GETDATE()  ) ) :  (DT_STR, 2, 1252)  MONTH( GETDATE()  ) ) + (LEN((DT_STR, 2, 1252)DAY( GETDATE() ) ) == 1? ("0" + (DT_STR, 2, 1252)  DAY( GETDATE()  ) ) :  (DT_STR, 2, 1252)  DAY ( GETDATE()  ) ) + "*"

Does anyone know how I can get the DATEADD function to work using my code? Or better yet tell me if DATEADD is even needed? THANKS!

↧

SSISDB just set up - trying it out - ssis package won't complete but it does quickly in Visual Studio Ultimate

March 2, 2016, 6:27 am
$
0
0

We just set up the SSISB for the first time. I executed an SSIS package. It won’t complete. The status is still 2 (running) after an hour. The package runs in less than a minute from Visual Studios Ultimate.
Here are the event messages:
select message from  SSISDB.catalog.event_messages  where operation_id = 66
test:Validation has started.
test:Validation has started.
test:Information: Validation phase is beginning.

New information: Above, I was right clicking on the package in SSISDB and executing. Now I tried right clicking on the package in SSISDB choosing execute, then I choose to script the execute rather than just running it. Then I ran that script and it did complete and gave me error messages. It completed with the status of 4 (failed).



↧
Search

handling abnormal termiantion of underlying Stored Procedure

March 2, 2016, 8:50 am
$
0
0
Hi,

I have a scenario SSIS calls --> Stored Proc.

Is there a way to error handle in such a way that if SP fails (abnormally), SSIS should gracefully exit, instead of failing as well

could you please advise

thanks
↧

SSIS to Microsoft Dynamic CRM using kingswaysoft performance issue

March 2, 2016, 9:49 am
$
0
0

Hi All,

I am loading data using SSIS into CRM using kingswaysoft adapter but having issue with performance. I have tried all things which I found online to improve performance like adding more threads using BDD, changing config files to allow more connection, increased buffer size and rows but still maximum performance I am getting is 15000 records per hour into account entity which is very slow.

Can someone please help me out with this issue. I am using SSIS 2008 R2 and CRM 2015.

Thanks.

↧
↧

Using Enterprise Edition for Development of SSIS packages

March 2, 2016, 10:22 am
$
0
0

Currently i have Enterprise Edition edition installed on my machine that provide me with all features to do development in SSIS Data Tool.  I have been developing and deploying ssis packages to DEV server and asking DBA to deploy those SSIS packages to deploy on PROD. are there cons to using enterprise edition to do your development ?.  

If you think i should use Developer Edition please advise why  and example would help. Advantage or disadvantage if you know any.

↧

Can we capture the FTP success or failure done by FTP Task in SSIS?

March 2, 2016, 8:39 am
$
0
0

I have a package in which the first task is execute task that runs a exe file from a specific location. the second task is a FTP that send file to FTP server from a specific location. I want to track the success/failure of the FTP task. Is there any way I can get a acknowledgement that the FTP is successful or not??

Any help is appreciated

Thanks

Sucharita Dansana

↧

DTS package error

March 2, 2016, 7:21 am
$
0
0

Please let me know if I need to post this question on another forum.

We have an old DTS package that imports a TXT file to a table in SQL Server.
The table has a field ValuePercent that is of data type numeric(18,2).
The TXT file has a negative percent number in this format: .03-(minus sign at the end) instead of -.03 (minus sign in the front).

This resulted in this error:

Error:  -2147213268 (8004202C); Provider Error:  0 (0)
Error string:  TransformCopy 'DTSTransformation__7' conversion error:  General conversion failure on column pair 1 (source column 'ValuePercent' (DBTYPE_STR), destination column 'ValuePercent' (DBTYPE_NUMERIC)).

Error source:  Microsoft Data Transformation Services (DTS) Data Pump
Help file:  sqldts80.hlp
Help context:  30501

What do you think is the best way to fix the issue ? Shall I change the data type of ValuePercent to Float ?

How do we usually populate negative numbers like .03- instead of -.03 into a Numeric(x,y) field ?

Thank you.

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>