Pulling count of records from Teradata

December 18, 2012, 3:40 am

≪ Previous: Facing issue "The SSIS runtime process crashes when you run the SSIS package under a low-memory condition" with SSIS 2008 R2 32 bit (C:\Program Files\Microsoft SQL Server\100\DTS\Binn\DTExec.exe)

Hi,

I am pulling count of records from a Teradata table.

I have used Execute SQL Task in SSIS to get the count, and assigning the count to SSIS variable "TeradataCount" of type Int32.

based on the count I want to proceed further.

while I am execuing the package I am getting below error

[Execute SQL Task] Error: An error occurred while assigning a value to variable "TeradataCount": "Value does not fall within the expected range.".

Note: I am using SSIS 2008 and ODBC Drivers for Teradata

your help is much appreciated

Thanks
Prasad

Thanks & Regards Prasad DVR

↧

RealTime RSS Feed with SSIS

December 18, 2012, 10:58 pm

≫ Next: Oracle connection fail with Microsoft OLEDB provider for Oracle MSDAORA.1

≪ Previous: Pulling count of records from Teradata

I have a Feed (on internet securities) which might update anytime.

We are trying to use SSIS to get the feed , load it to SQL Server and give access to end-users for slice/dice the details.

But they need it to be NearRealTime with 5-10 mins of latency at MAX.

Do we have any provision for this with SSIS+SQL Server?

Any other options would be helpful.

Vidya

sagar

↧

Oracle connection fail with Microsoft OLEDB provider for Oracle MSDAORA.1

February 22, 2006, 6:19 am

≫ Next: Dynamically load data from source to destination

≪ Previous: RealTime RSS Feed with SSIS

Hello,

On my dev server I have working ssis packages that use connections Microsoft OLEDB provider for Oracle MSDAORA.1 and Oracle provider for oledb and OracleClient data provider.

I use one or the other according to my needs.

In anticipation and to prepare for the build of a new production server, I have build a test server from scratch and deployed to it the entire dev.

Almost everything works except Microsoft OLEDB provider for Oracle.

ssis packages on the test machine will return an error

Error at Pull Calendar from One [OLE DB Source [1]]: The AcquireConnection method call to the connection manager "one.oledb" failed with error code 0xC0202009.

Error at Pull Calendar from One [DTS.Pipeline]: component "OLE DB Source" (1) failed validation and returned error code 0xC020801C.

[Connection manager "one.oledb"]: An OLE DB error has occurred. Error code: 0x80004005.

An OLE DB record is available. Source: "Microsoft OLE DB Provider for Oracle" Hresult: 0x80004005 Description: "Oracle error occurred, but error message could not be retrieved from Oracle.".

I have used the same installers for OS, SQL and Oracle SQL*Net on both dev and test machines. The install and then the restore/deployment on Test went fine.

Does anyone could point me to the right direction to solve this issue?

Thanks,

Philippe

↧

Dynamically load data from source to destination

December 19, 2012, 1:32 am

≫ Next: Conditional Split add new row

≪ Previous: Oracle connection fail with Microsoft OLEDB provider for Oracle MSDAORA.1

Hi,

I would like to map input (source) and output (destination) columns dynamically, given that the names of the input and output columns are same.

I was looking at the code at http://msdn.microsoft.com/en-us/library/ms136020.aspx . This piece of code is able to read the input columns and map to output columns, but how on earth can I ' trigger the flow of data from the source to the destination table'. Is there any method that I need to call to start the data flow.How do initiate the data movement once I have dynamically mapped the source and the destination columns through code?

Please help, this is very urgent. I would need very specific (code or example). The ability to move data using SSIS dynamically is essential , else SSIS is not going to be the tool of choice.

Regards

Viks

↧

Conditional Split add new row

December 18, 2012, 8:24 pm

≫ Next: Login timeout expired" in ssis pack

≪ Previous: Dynamically load data from source to destination

Hi,

I have been following tutorials online and reading about this,

my package does the following so far

Lookup if record does not exsist then add new record..then

I need to Lookup Match the output compare if the priority has changed for a record then if the priority has changed add a new record with the new priority not change the priority on the exsisting record

my pkg so far is this is saying if after the compare the priorty has stayed the same then union all and if priority has changed union all.

I dont want to union all, i want to add new record to the stgOutatWLHist, and i cannot seem to join from the Conditional Split to the Data flow Dest.

So i have my logic wrong, if anyone can help that would be great

Pic below.

David

↧

Login timeout expired" in ssis pack

December 19, 2012, 12:15 am

≫ Next: How to force SSIS package stop on data flow

≪ Previous: Conditional Split add new row

Hi,

i am geting below error when i am exce ssis package... please help me

SABMLR_MDM_Dimensions_Load Connection manager "MDM" Description: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005. An OLE DB record is available. Source: "Microsoft SQL Server Native Client 10.0" Hresult: 0x80004005 Description: "Login timeout expired". An OLE DB record is available. Source: "Microsoft SQL Server Native Client 10.0" Hresult: 0x80004005 Description: "Unable to complete login process due to delay in login response". An OLE DB record is available. Source: "Microsoft SQL Server Native Client 10.0" Hresult: 0x80004005 Description: "TCP Provider: Timeout error [258]. ". End Error Error: 2012-12-19 02:32:09.54 Code: 0xC0202009 Source: SABMLR_MDM_Dimensions_Load Connection manager "MDM" Description: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005. An OLE DB record is available. Source: "Microsoft SQL Server Native Client 10.0" Hresult: 0x80004005 Description: "Login timeout expired". An OLE DB record is available. Source: "Microsoft SQL Server Native Client 10.0" Hresult: 0x80004005 Description: "Unable to complete login process due to delay in login response". An OLE DB record is available. Source: "Microsoft SQL Server Native Client 10.0" Hresult: 0x80004005 Description:"TCP Provider: Timeout error [258]. ". End Error Error: 2012-12-19 02:32:16.25 Code: 0xC020801C Source: DFT_Load_Supplier_Branch OLE_SRC_SupplierBranch [70] Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "MDM" failed with error code 0xC0202009. There may be error messages posted before this with more information on why the AcquireConnection method call failed. End Error Error: 2012-12-19 02:32:19.16 Code: 0xC020801C Source: DFT_Load_Location OLE_SRC_Location [167] Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "MDM" failed with error code 0xC0202009. There may be error messages posted before this with more information on why the AcquireConnection method call failed. End Error Error: 2012-12-19 02:32:22.52 Code: 0xC004701A Source: DFT_Load_Supplier_Branch SSIS.Pipeline Description: component "OLE_SRC_SupplierBranch" (70) failed the pre-execute phase and returned error code 0xC020801C. End Error Error: 2012-12-19 02:32:25.34 Code: 0xC004701A Source: DFT_Load_Location SSIS.Pipeline Description: component "OLE_SRC_Location" (167) failed the pre-execute phase and returned error code 0xC020801C. End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 2:30:00 AM Finished: 2:32:25 AM Elapsed: 144.972 seconds. The package execution failed. The step failed.

regards venkat

↧

How to force SSIS package stop on data flow

December 19, 2012, 2:47 am

≫ Next: how can we call SQL XML Bulk Load dll in java ?

≪ Previous: Login timeout expired" in ssis pack

Hi everyone,

I would like to stop the SSIS package on Data Flow.

I know a way to do that. This is to throw an exception on script component on data flow. But on windows form, when I call the package, the error message appear with many info that can make the end user confused.

Could you tell me another way to handle this.

Thanks a lot.

↧

how can we call SQL XML Bulk Load dll in java ?

December 19, 2012, 3:45 am

≫ Next: Script task error in Sql server agent

≪ Previous: How to force SSIS package stop on data flow

steps to access this dll in java and also steps to pass the required paramter details using java.

Please let me if any sample available.

Thanks in advance,

Kamesh Palani

↧

Script task error in Sql server agent

December 19, 2012, 6:13 am

≫ Next: How to restrict to stop the package if one of the excel tab gives error

≪ Previous: how can we call SQL XML Bulk Load dll in java ?

My Package executed perfectly in Bids enviornment, when i try to scheadule the package i got the error at script task

Microsoft (R) SQL Server Execute Package Utility  Version 10.0.1600.22 for 32-bit  
Copyright (C) Microsoft Corp 1984-2005. All rights reserved.    Started:  13:02:17 
 Error: 2012-12-19 14:06:19.97     Code: 0x00000001    
 Source: Merge Files      Description: System.Reflection.TargetInvocationException: 
Exception has been thrown by the target of an invocation. ---> 
System.NullReferenceException: Object reference not set to an instance of an object.     
at ScriptTask_5c1aa4b8953f4e17b72095548353ef1c.vbproj.ScriptMain.Main()  
   --- End of inner exception stack trace ---     at System.RuntimeMethodHandle.
_InvokeMethodFast(Object target, Object[] arguments, SignatureStruct& sig, MethodAttributes methodAttributes, 
RuntimeTypeHandle typeOwner)     at System.RuntimeMethodHandle.InvokeMethodFast(Object target, Object[] arguments,
 Signature sig, MethodAttributes methodAttributes, RuntimeTypeHandle typeOwner)     at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder,
 Object[] parameters, CultureInfo culture, Boolean skipVisibilityChecks)     at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters,
 CultureInfo culture)    
 at System.RuntimeType.InvokeMember(String name, BindingFlags bindingFlags, Binder binder,
 Object target, Object[] providedArgs, ParameterModifier[] modifiers, CultureInfo culture, String[] namedParams)    
 at System.Type.InvokeMember(String name, BindingFlags invokeAttr, Binder binder, Object target, Object[] args, CultureInfo culture)     
at Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTATaskScriptingEngine.ExecuteScript()  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  13:02:17  Finished: 14:06:20  Elapsed:  3842.33 seconds.  The package execution failed.  The step failed.

can u help on this

↧

How to restrict to stop the package if one of the excel tab gives error

December 19, 2012, 6:31 am

≫ Next: Redirect bad rows to some text file in a DFT

≪ Previous: Script task error in Sql server agent

Hi,

I have developed a SSIS package.

Source : XLSX File

Destination : SQL Server Table

The XLSX files contains 4 tabs. I am loading 4 tabs into 4 different tables by creating 4 data flows.

Steps:

inside For each loop container

1. Used Script Component

i have checked whether the given file is valid or not. if valid, it executes the step 2. if not valid, it send out an email

2. Used 4 Dataflows one for each tab. All are independent data flows

please find the strucure below:

Ques:

If any one of the tabs get failed, it should not load the other three tabs.

Please advise how to proceed.

Regards

SqlStud

↧

Redirect bad rows to some text file in a DFT

December 19, 2012, 5:25 am

≫ Next: winword.exe process on the loose and do not terminate

≪ Previous: How to restrict to stop the package if one of the excel tab gives error

Hi,

In my DFT, I am redirecting rows which is not satisying conditons like can cause error like turncate, data type mismatch or duplicate. I am successfully able to store such records in a text file. And I am storing this info in a sql table also as how many rows are redirected by which package. I want to log the error or cause why these rows redirected .

On Event Handler- On Error, I am getting the exact reason in system variable "Error Description" and if i could use this varibale , my work would have done but neither my package is getting failed (coz of this redirecting of bad records to logfile.txt) or throw any error nor I am getting this system variable in my event handler- On PostExecute. Any other way to find this info- Error Info

↧

winword.exe process on the loose and do not terminate

December 17, 2012, 7:58 am

≫ Next: Why are port numbers preferred method for connecting to sql server named instances when using jdbc?

≪ Previous: Redirect bad rows to some text file in a DFT

Greetings,

Microsoft SQL Server 2008 R2 (SP2) - 10.50.4000.0 (X64)
SSIS 2005 Package

Execute Task is calling a home-grown Windows application that pulls data from a database and
writes it to the FileSystem in either Tif or PDF format, depending on the circumstances, using
Word>SaveAs functionality as the PDF generator. For future reference, Word is called via COM Objects.
Although it's a windows application, it has no GUI. Parameters are sent to it via command prompt.
This is a well tested application standing on its own. When I test it I watch
the Server Processes in Task Manager and see WINWORD.EXE appear, and disappear when it's complete.

For Each loop has 10 ADO records to process. The first 8 records process correctly by producing
8 tif's as desired. The ninth record should result in a PDF, but instead, it opens WINWORD.exe,
doesn't produce my PDF file, it leaves WINWORD.EXE open, and the For Each loop continues-on to
produce the final tif file (record 10). WINWORD.EXE becomes a runaway process, growing until it has
completely consumed all of the memory resources and locks-up the server.

I don't want to debate about how I should be producing my tif and pdf files. I have no control
over that. The problem here is that when the home grown application is run on its' own,
it performs as expected by terminating WINWORD.EXE and producing the correct output.
However, when it runs inside of an SSIS package/ForEach Loop container, it has a problem with it.
The fact that the home-grown application works fine on its' own, and that SSIS successfully
produces the desired output on 9 out of 10 loops, suggests that SSIS is the culprit here.

Lastly, the SSIS Package is launched via SQL Job.

Thoughts and suggestions are greatly appreciated.

Thank you very much.

↧

Why are port numbers preferred method for connecting to sql server named instances when using jdbc?

December 19, 2012, 8:14 am

≫ Next: Upload text file to FTP site only when text file has some data

≪ Previous: winword.exe process on the loose and do not terminate

On this page: http://msdn.microsoft.com/en-us/library/ms378428.aspx

Microsoft claims:

"SQL Server allows for the installation of multiple database instances per server. Each instance is identified by a specific name. To connect to a named instance of SQL Server, you can either specify the port number of the named instance (preferred), or you can specify the instance name as a JDBC URL property or a datasource property."

Why are ports the "preferred" method for connecting to sqlserver named instance with jdbc? What are the advantages and disadvantages of using ports over instance names?

↧

Upload text file to FTP site only when text file has some data

December 19, 2012, 7:54 am

≫ Next: I have simple SSIS package in which source (sql query) to destination (txt file). If i run this package , it executed successfully. I can not delete the file generated by SSIS package and gives error "file is being used" while deletion.What is the reason?

≪ Previous: Why are port numbers preferred method for connecting to sql server named instances when using jdbc?

Hi,

I have a SSIS package which after all the calculation loads data in the target .txt file. There are 2 targets files coming out of the SSIS package, which may have data in both the target files or may not have data in any.

I have to upload the target file to FTP server only when the files has data. If any 1 file has data upload only that file to FTP and do not upload the other file. So if both the files have no data do upload any in the FTP server.

I was able to create a script task to upload all the target files in the local folder to FTP server. I am struggling to upload files based on the above criteria.

Any suggestion how should I do that? I think I should be writing the code in the script task. But since I am not very good with VB .NET, I am struggling.

↧

I have simple SSIS package in which source (sql query) to destination (txt file). If i run this package , it executed successfully. I can not delete the file generated by SSIS package and gives error "file is being used" while deletion.What is the reason?

December 19, 2012, 10:56 am

≫ Next: SSIS 2008R2 FTP Upload Fails if OverwriteDestination is set to False

≪ Previous: Upload text file to FTP site only when text file has some data

I have simple SSIS package in which source (sql query) to destination (txt file). If i run this package , it executed successfully. I can not delete the file generated by SSIS package and gives error "file is being used" while deletion.What is the reason?

↧

SSIS 2008R2 FTP Upload Fails if OverwriteDestination is set to False

December 19, 2012, 11:59 am

≫ Next: Building a data flow task, within a foreach loop for dynamic table name, but ole db source not allowing variable

≪ Previous: I have simple SSIS package in which source (sql query) to destination (txt file). If i run this package , it executed successfully. I can not delete the file generated by SSIS package and gives error "file is being used" while deletion.What is the reason?

I've tested this consistently and uploading a file via the FTP task always fails with [FTP Task] Error: Unable to send files using "FTP Connection Manager". if the OverwriteDestination flag is set to False. Yes, I have checked to make sure the file doesn't exist on the destination server. It does not. I can upload a file if the flag is set to True. Then I can delete the file on the FTP server and set the flag to false and then try to upload and I get the failure. I set the flag back to True and it runs.

We need to stop the upload process if the file already exists on the destination. How else other than writing custom code (get directory list from FTP server, loop and then process) are we supposed to handle this? This clearly appears to be a bug.

Thanks,
M Wise

↧

Building a data flow task, within a foreach loop for dynamic table name, but ole db source not allowing variable

December 19, 2012, 11:53 am

≫ Next: Jobs getting hanged due to SSIS package execution.

≪ Previous: SSIS 2008R2 FTP Upload Fails if OverwriteDestination is set to False

In my control flow, I set up a variable for the table name, enumerated by SMO, following the instructions from the link here:
http://www.bidn.com/blogs/mikedavis/ssis/156/using-a-for-each-loop-on-tables-ssis

Now, I put a data flow task inside the foreach. I selected the OLE DB connection manger for my database, set the Data access mode to "Table name or view name variable", and selected my variable name from the drop down. So far so good. When I click on OK, it gives me an error 0x80040E37, basically saying it can't open the rowset for "my variable", Check that the object exists in the database.

So, I assume I won't be able to do this "that' easily, and I will need to build a "SQL command from variable" or some such thing. Any advice on how to build this Source editor to dynamically name my columns from the variable?

Thanks in advance!

mpleaf

↧

Jobs getting hanged due to SSIS package execution.

December 19, 2012, 12:40 pm

≫ Next: Microsoft Jet OLEDB 4.0 STILL not working on 64-Bit?

≪ Previous: Building a data flow task, within a foreach loop for dynamic table name, but ole db source not allowing variable

Hi,

I have a job in SQL Server agent which runs an SSIS package at 3A.M. At the same time another job runs from Datastage which references the same tables as SQL Server does. The package takes around 3 hrs to complete and finish the job. Also the CPU usage goes to 100% when the SSIS job is running.

The Datastage jobs are getting hanged when the SSIS package is running. Looks like there is a Lock due to SSIS job. It is blocking all the datastage jobs. After killing the SSIS job, the CPU came down and also all the Datastage jobs finished.

Does SSIS package creates lock for the SQL objects(in the package) while running a package?

Is there any SSIS configuration which can prevent this from happening? or Can someone please help me find a solution for this issue?

↧

Microsoft Jet OLEDB 4.0 STILL not working on 64-Bit?

April 30, 2009, 12:54 pm

≫ Next: Can we run 32 bit supported excel task and 64 bit supported Fuzzy lookup on same 64 bit machine?

≪ Previous: Jobs getting hanged due to SSIS package execution.

I've seen all the posts (hundreds of them) concerning the fact that the Microsoft Jet OLEDB 4.0 provider only works on 32-Bit systems. Really? I'm running Windows Server 2008 Data Center and have an urgent need to run an SQL Job that needs to query an Access database. The job runs DTExec to execute an SSIS package (the Job step is configured with the "Use 32 bit runtime" checked (set to true)). I am getting the follwing error message when I'm on the part of the SSIS package, which is an 'Execute SQL Task', which attempts to open the Access Database:

DTExec: The package execution returned DTSER_FAILURE (1).
Started:  2:31:08 PM
Finished: 2:31:12 PM
Elapsed:  4.438 seconds
Microsoft (R) SQL Server Execute Package Utility
Version 10.0.1787.0 for 32-bit
Copyright (C) Microsoft Corp 1984-2005. All rights reserved.

Started:  2:37:14 PM
Error: 2009-04-30 14:37:19.13
   Code: 0xC002F210
   Source: DoDeletes Execute SQL Task
   Description: Executing the query "DELETE From [dbo].[zsong] where [MUZENBR] in    (
SE..." failed with the following error: "The OLE DB provider "Microsoft.Jet.OLEDB.4.0" has not been registered.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.
End Error
DTExec: The package execution returned DTSER_FAILURE (1).
Started:  2:37:14 PM
Finished: 2:37:19 PM
Elapsed:  4.422 seconds

I find it highly ridiculous that Microsoft would not care to release a 64-bit driver for Jet OleDb 4.0. There is obviously a need, judging by the hundreds of posts out there with people asking about this.

Or am I missing something? Is there a driver that I just can't find?

Thanks.

↧

Can we run 32 bit supported excel task and 64 bit supported Fuzzy lookup on same 64 bit machine?

December 19, 2012, 4:07 pm

≫ Next: flat file source out of synchromization

≪ Previous: Microsoft Jet OLEDB 4.0 STILL not working on 64-Bit?

Hi everybody,I have a package(Resided on 64 bit machine) where I am using excel task to pull data from excel to sql server destination.

During the process I am using the fuzzy look up transformation in data flow task .

The problem here is I am getting error specific to excel (Because SSIS is running on 64 bit and excel supports 32 bit)

So when I went to the project propertes and in DEBUGGING changed USE 64 bit to 32 bit

But now I am getting the error specific to fuzzy lookup.

It gets executes with a quick command prompt and stops at fuzzy lookup.

1 - Lookup task turns yellow
2 - A black box flashes up and then disappears
3 - Output message states SSIS package "blah blah.dtsx" finished: Canceled

When Changing back to 64 bit ..Lookup runs fine without any error..

Is there any way where I can't shift the multiple tasks in different project i.e Excel specific on 32 bit and fuzzy process on 64 bit...?

Thank you

↧