New Oracle Data Provider for .NET (ODP .NET) 10.2.0.2.20 failure.

August 2, 2006, 9:13 pm

≫ Next: SSIS 2012 Catalogs seem inefficient...

≪ Previous: Record ID for New Records in SSIS Data Flow

Oracle recently released Oracle Data Provider for .NET (ODP .NET) 10.2.0.2.20. It happened on August 1, 2006. Oracle claims that its software is compliant with Microsoft ADO.NET 2.0 and “…more flexible, faster, and more stable….”. On top of it Oracle introduced many new features “… not available from other .NET drivers…”.

http://www.oracle.com/technology/tech/windows/odpnet/index.html

I decided to give it a shot and try in SSIS.

I installed ODP.NET on my machine and it works just fine in PL/SQL Developer

Next, I opened Data Source Wizard in BIDS for SSIS project.

I see Oracle Data Provider for .NET option is enlisted under .NET Providers node on a tree. But when I select it, I am getting an error dialog:

Failed to find or load the registered .Net Framework Data Provider.

So what could be done in such scenario?

Regards,

Yitzhak

↧

SSIS 2012 Catalogs seem inefficient...

September 4, 2012, 10:40 am

≫ Next: LineageID of an input column has an another value in runtime

≪ Previous: New Oracle Data Provider for .NET (ODP .NET) 10.2.0.2.20 failure.

So a few weeks ago I made a switch from our SSIS 2008 package to the new SSIS 2012 project deployment model. I really love having the new project parameters feature (instead of config files) and I enjoy the ability to encase all the sub packages as one big project...

My biggest issue with the new SSIS 2012 Catalog is SSISDB and it's reporting feature. Since we have packages that runs every minute and uses multiple threads, the SSISDB transaction log fills up FAST. We resolved this issue by changing the database mode to SIMPLE however performance still becomes an issue with this many transactions. We ended up turning off logging for our packages (until something breaks) and this seems to resolve a lot of issues.

So here are my questions thus far:

Is there a way to make a central SSIS server that host all the projects and have child servers process the ETLs using the child's resources?
How do you all manage the SSISDB database? Size? Performance?
This bugs me 'To view the details for the execution, right-click on the Integration Services Catalog, and open the [All Executions] report'.. why can't we at least see the last onError message in the Log File Viewer like before? That made stuff so much more simple!
What the heck is up with the SSIS Server Maintenance Job? It seem to screw everything up for a few hours!

In the end I reverted our major project back to the package deployment model instead of the project deployment model. Any inputs? Thanks!

↧

LineageID of an input column has an another value in runtime

August 30, 2012, 4:09 am

≫ Next: SSIS Custom Task. Package Variables not refreshing in IDE

≪ Previous: SSIS 2012 Catalogs seem inefficient...

Hi all,

I upgraded my own data flow transformation component to SQL 2012. My component has one input and one asynchronous output.

I found the following unexplained behavior: a value of the LineageID of an input column at the runtime differs from a value which is currently set (and I can check it in designtime using Advanced Editor). E.g. component's input has only one column with the name "Address" and its LineageID equals 10. But during debugging component at the runtime I see that input contains only one column with the name "Address" but its LineageID equals 11. How is it possible?

So somebody could explain me what is it or give me an advice how to avoid this behavior. And in general how is it possible at all that LineageID for the same column has different values in the design time and the runtime?

PS. Versions of this component for SQL 2005 and 2008 work without such problem.

Igor

↧

SSIS Custom Task. Package Variables not refreshing in IDE

September 10, 2012, 6:43 pm

≫ Next: job to delete old files

≪ Previous: LineageID of an input column has an another value in runtime

Have a custom task component which during the create process adds a variable to the SSIS Package. The Following code is an example.

Dim P As Package = CType(_taskHost.Parent, Package) If Not P.Variables.Contains("ContinueProcess") Then P.Variables.Add("ContinueProcess", False, "User", 0)

The code executes with no errors. If I then view the variables for the package, nothing appears to be added. However, when I close the package and re-open the variable was actually created. It appears that the IDE didn't refresh.

I've been pulling my hair out on this for a few years... The reason I'm asking the question again is because I've been asked to update the components for SQL2012.. Everything works great except the variable still do not refresh without closing the package.

Can you tell me what I'm missing?? is there a change event that I need to call to tell the IDE to refresh? I'm already using the IComponentChangeService Service for the task but I'm unable to find a similar service for the package..

Can you help?

Thanks

Jason Rawlins

↧

job to delete old files

September 14, 2012, 10:03 am

≫ Next: Object variable lost in Script Task

≪ Previous: SSIS Custom Task. Package Variables not refreshing in IDE

I would like to create a sql agent job to run operating system cmd, as a step for a job.

I tried to delete the files with .txt extension in a log directory that is older than 5 days,

I tried below, but it is not working.

forfiles -p "C:\SSISFILES\Log\" -s -m *.txt -d -5 -c "cmd /q /c del C:\SSISFILES\Log\"

I don't know how I can put this to the command window in sql agent job type: Operating system(CmdExec)

Is this the right syntax, I tried but not working.

I don't want to use EXEC xp_cmdshell, but I can also open to a .bat file.

What is the syntax? Thanks.

SQLFriend

↧

Object variable lost in Script Task

September 12, 2012, 10:47 am

≫ Next: "Cannot retrieve code page info..."

≪ Previous: job to delete old files

In my SSIS package I have a object variable which gets intialize inside foreach loop container in Script Task. When I debug the code i see the values are adding to object. I'm using the same object variable outside foreach loop to read the values into arraylist in script task as follows: But when I debug the code it is showing the count as 0. Any thoughts please.

System.Collections.ArrayList names = new System.Collections.ArrayList();

names.Add(Dts.Variables["users"].Value);

↧

"Cannot retrieve code page info..."

November 20, 2006, 5:09 am

≫ Next: How to create an SSIS variable to check if it is a Weekday or Weekend

≪ Previous: Object variable lost in Script Task

Hello again!

I got a problem using an OLE-DB Source in my data flow task. It is an Informix-Server using the newest OLE DB-Driver provided by IBM. However, when I set up the OLE DB-Source with connection manager and SQl-Query, I get the following warning message:

Warning at {2B334CA3-A792-4BC2-93AA-12FADCF1E696} [OLE DB Source [45]]: Cannot retrieve the column code page info from the OLE DB provider. If the component supports the "DefaultCodePage" property, the code page from that property will be used. Change the value of the property if the current string code page values are incorrect. If the component does not support the property, the code page from the component's locale ID will be used.

Later when I try to execute the package, the destination adapter gets errors like

Error 3 Validation error. Data Flow Task: OLE DB Destination [2985]: Columns "antrag" and "Antrag" cannot convert between unicode and non-unicode string data types. Informix_OLEDB.dtsx 0 0

I guess that SQL Server cannot get the data types from the Source.

Has anyone an idea? Thanks in advance!

↧

How to create an SSIS variable to check if it is a Weekday or Weekend

September 14, 2012, 9:37 am

≫ Next: Unpivot task is generating rows for null inputs

≪ Previous: "Cannot retrieve code page info..."

In the Snapshot (below) there are two Execute Package Tasks(1 and 2) along with two Execute SQL Tasks (A and B).

I have to create an SSIS variable such that if the value is a day of the week and a weekday (Ex: Monday), then the Execute Package Task 2 has to be triggered. If the value is a weekend (Ex: Saturday or Sunday), then Execute Package Task 1 has to be triggered. Based on 1 or 2 getting triggered, B automatically gets triggered.

The variable should be such that if the user inputs the value as 0 it should trigger Execute Package Task 2 (this pulls data for weekdays)

and if the user inputs value as 1 then it should trigger Execute Package Task 1 (this pulls data for weekends).

Can someone help me creating the variable?

Thank you.

Sandeep.P

↧

Unpivot task is generating rows for null inputs

September 14, 2012, 12:33 pm

≫ Next: Text filed processing on SSIS 2012

≪ Previous: How to create an SSIS variable to check if it is a Weekday or Weekend

So I have a C# application (VS 2012 with .NET4.5) that builds SSIS (SQL2012) packages programatically. the packages can be opened in the designer and they run fine. However, there is one case that is giving me a problem. I have an OleDb source connected to a table in SQL server. I am using the unpivot task to convert columns in a sparse matrix to an Entity Attribute Value model. So basically, the primary key value of the source table is a pass-through value in the unpivot task, each column is mapped to the destination column, and the attribute id is hard coded as the pivot key. Like i said this works great EXCEPT i came across one column and a table that was null for all the rows in the table. when I run the package, it fails with:

OnError,SERVERNAME,DOMAIN\user,{94E83A3B-5386-4712-BEDC-11E35341675F},{94E83A3B-5386-4712-BEDC-11E35341675F},{3187347C-8D44-4D51-8FDB-B5C4159A58B0},9/14/2012 9:48:02 AM,9/14/2012 9:48:02 AM,-1071607780,0x,There was an error with OLE DB Destination.Inputs[OLE DB Destination Input].Columns[AttributeId] on OLE DB Destination.Inputs[OLE DB Destination Input]. The column status returned was: "The value violated the integrity constraints for the column."

So I set up a data viewer on the data flow and found that the unpivot component was generating rows for every null value. not only that, but the values for the key column and the attribute id (which was hard coded) were also null for all the rows sent from the unpivot to the ole db destination. I manually created a package with an unpivot for just the column in question and got the same result. then I inserted a value for every row in the table and the same package runs fine.

can someone offer any help or advice on what might be causing this?

↧

Text filed processing on SSIS 2012

September 14, 2012, 11:03 am

≫ Next: SSIS using Stored Procedures to do incremental loads into DW

≪ Previous: Unpivot task is generating rows for null inputs

Hello Team,

I have a text datatype field in the database. It has a create table script. In a SSIS project i want to query this field and pass the value to backend again to execute as sql.
How i can store this value of the field on SSIS side(because it can not fit in VARCHAR (8000)) and pass to execute sql task or any other thing. i have seen DT_TEXT field. But i am not sure on how to use this ?

Alternatively i can explain the goal of task here.
I have text field in the database which has create table script or any other bunch sql statements (just in one field). I want to execute from ssis based on a criteria. What are the options and how can i do that?

Version:2012

Please suggest.

Thanks,

Jyodhu.

↧

SSIS using Stored Procedures to do incremental loads into DW

September 14, 2012, 11:13 am

≫ Next: Script Task Inside a For Each Loop Container

≪ Previous: Text filed processing on SSIS 2012

Is it insane to have SSIS to use a Stored Procedures to do incremental loads into DW, if the frequency is like every 5 minutes?

Here is the bacground. We use SSRS to report off of our production server via stored procs. We are now thinking of creating a replicated server to which we will point the report into. However, we also have a need to give the users access to report data (stored procs), so they can link them with other data sets as they need to using MS Query in excel. Problem is that users won't be able to link data sets if they are based off of stored procs. Have already tried encapsulating SPs inside of Functions but that also does not seem to work.

What my boss wants:

- Forget the replicated server.

- Create a DW which will hold the report data sets in a table per report, to be populated by the existing report stored procedures via SSIS which will be updated every 5 minutes. Some of our SPs are highly complex and have aggregated result sets.

- Have all the reports point to their corresponding tables in the DW

- Have the users access these tables so they can link the dataset as they need to.

↧

Script Task Inside a For Each Loop Container

September 14, 2012, 10:17 am

≫ Next: Modify Buffer size Custom SSIS Tranformation

≪ Previous: SSIS using Stored Procedures to do incremental loads into DW

Hi ,

Getting Following Error:

Error: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.ArgumentException: The path is not of a legal form.
   at System.IO.Path.NormalizePathFast(String path, Boolean fullCheck)
   at System.IO.Path.GetFullPathInternal(String path)
   at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy)
   at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options, String msgPath, Boolean bFromProxy)
   at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options)
   at System.IO.StreamWriter..ctor(String path, Boolean append, Encoding encoding, Int32 bufferSize)
   at System.IO.StreamWriter..ctor(String path, Boolean append)
   at ST_0ee84cb2c2004e1faf97979dfbc79354.vbproj.ScriptMain.Main()
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle._InvokeMethodFast(Object target, Object[] arguments, SignatureStruct& sig, MethodAttributes methodAttributes, RuntimeTypeHandle typeOwner)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture, Boolean skipVisibilityChecks)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at System.RuntimeType.InvokeMember(String name, BindingFlags bindingFlags, Binder binder, Object target, Object[] providedArgs, ParameterModifier[] modifiers, CultureInfo culture, String[] namedParams)
   at Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTATaskScriptingEngine.ExecuteScript()

Please help me this issue.

I am having a script task inside a For Each Loop Container

For Each Loop:

Script Task:

I have the following code where I am replacing the row delimiter and checking for valid records

It has 3 Read Write Variable

↧

Modify Buffer size Custom SSIS Tranformation

September 14, 2012, 5:02 pm

≫ Next: Failed to find or load the registered .Net Framework Data Provider

≪ Previous: Script Task Inside a For Each Loop Container

I have developed a custom ssis data transformation and was wondering if there is a way to increase the buffer size?

Thanks,

↧

Failed to find or load the registered .Net Framework Data Provider

September 14, 2012, 11:19 am

≫ Next: connection of db

≪ Previous: Modify Buffer size Custom SSIS Tranformation

Failed to find or load the registered .Net Framework Data Provider

when i run in server with local host it working when i used www.domainname.com/page.aspx

it show this error

what i hae to add in the code

can u solve this

+966508818095

↧

connection of db

September 14, 2012, 9:55 am

≫ Next: SSIS execution using DTEXEC in a batch script

≪ Previous: Failed to find or load the registered .Net Framework Data Provider

hi... in vs2012 express mvc4 when i add the existing item and add my db"qecsms" (name) the message is pop up your acess is denied! now what is problem? plz guide me

rubab

↧

SSIS execution using DTEXEC in a batch script

September 12, 2012, 9:30 pm

≫ Next: Event Notification is not sending an even when Service Broker Queue disable.

≪ Previous: connection of db

Hi,

Let me set the context first. I am executing an SSIS package using DTEXEC command in a batch script. The SSIS package takes an input text file(A.txt) to execute a stored procedure and updates the database table. From the batch file, I write the return code of the DTEXEC command to a file.

Now, my problem is that the ERRORLEVEL in the batch file does not capture all failures. When I delete the input text file(A.txt) and run the batch file, I expect the batch file failing on the data flow task component (which involves the input text file), but the ERRORLEVEL in the batch file is still 0, which means successful execution of the SSIS package.

Could anyone help me understand this behavior of the DTEXEC command? I want the error code to be captured in the errorlevel when a data flow task component of an SSIS package fails. How do I do it?

Thanks,

Veena

Thanks! Veena

↧

Event Notification is not sending an even when Service Broker Queue disable.

September 15, 2012, 10:26 am

≫ Next: Sending query result from a table via email in SSIS in a table format

≪ Previous: SSIS execution using DTEXEC in a batch script

Hi All,

I am trying an option "BROKER_QUEUE_DISABLED" in EVENT NOTIFICATION it seems it is not properly generating a Broker Queue disabled event. SO can some one please validate the script wcich i created(see below)

-Thanks in Advance

Script:

CREATE

SERVICE NotifyService

QUEUE NotifyQueue

[http://schemas.microsoft.com/SQL/Notifications/PostEventNotification]);

CREATE

EVENT NOTIFICATION [CHS_QueueDisabledNotif]

ON QUEUE [CHS_Change_Queue] WITH FAN_IN

FOR BROKER_QUEUE_DISABLED

TO SERVICE 'NotifyService', 'current database'

--Testing

--Try Disabling Application Queue

ALTER QUEUE dbo.CHS_Change_Queue WITH STATUS = OFF

(

QUEUE NotifyQueue

Vinay

↧

Sending query result from a table via email in SSIS in a table format

February 16, 2012, 10:26 pm

≫ Next: Capture redirected Column name and datatype through SSIS package

≪ Previous: Event Notification is not sending an even when Service Broker Queue disable.

How to send query results extracted from an execute sql task and then send it via email by script task using HTML formatting?.
I was able to send the query results using execute sql task then a for each loop container inside which i had a script task where the results were (stored in variables) appended to a string.
Then i sent the string using send mail task.
By this method i was able to seperate the data with help of TAB's in String.Format.

But i have to get that in a table format.

Is it possible to create a mail message in script task and use html tags to display results in a table with the help of variables in the package?

Well i am new to vb.net and SSIS so might require a detailed solution.

Thank You!

↧

Capture redirected Column name and datatype through SSIS package

September 15, 2012, 9:15 am

≫ Next: Used "Data Conversion" Transformation - VS_ISBROKEN - cannot convert between unicode and non-unicode string data types.

≪ Previous: Sending query result from a table via email in SSIS in a table format

Hi All,<o:p></o:p>

I designed SSIS package for loading data from Sql server to Sql server Destination table. 
While loading data from source to Destination need to check is there any mismatch of datatype.
If any mismatch in data type need to redirect thse records to error table.<o:p></o:p>

In error table I need to store datatype mismatched column name and datatype of that column.<o:p></o:p>

Can you please help on this to resolve this issue.<o:p></o:p>

Regards, Praveen

↧

Used "Data Conversion" Transformation - VS_ISBROKEN - cannot convert between unicode and non-unicode string data types.

September 14, 2012, 4:35 pm

≫ Next: SQL 2012 SSISDB catalog - read permission on folder, but still can't see it

≪ Previous: Capture redirected Column name and datatype through SSIS package

Our Oracle source changed from Non-Unicode to Unicode. So I am using "Data Conversion" Transformation to convert the DT_WSTR to DT_STR to match the target SQL Server sting/text.

I am getting following error.

Error at Load Audit_Log [ViewPoint AUDIT_LOG Source [1]]: Column "Column1" cannot convert between unicode and non-unicode string data types.

Error at Load Audit_Log [ViewPoint Table Source [1]]: Column "Column2" cannot convert between unicode and non-unicode string data types.

Error at Load Table [SSIS.Pipeline]: "component "DB Table Source" (1)" failed validation and returned validation status "VS_ISBROKEN".

Error at Load Table [SSIS.Pipeline]: One or more component failed validation.

Error at Load Table : There were errors during task validation.

(Microsoft.DataTransformationServices.VsIntegration)

We are not planning to change the Target table structure, so using the Data Conversion function to change it to Non-Unicode.

Really appreciate your thoughts.

↧

Latest Images