hi,
I have 10 files in a folder,while i am loading files if any error comes in a file, that file should skip and remaining files should load
note: skip is not data level that should be in file level
↧
regarding ssis - Continue loading files on error
↧
Export from MS SQL to multiple Excel worksheets
Hi
In only one MS SQL table I have such field names:
Worksheet1_field11
Worksheet1_field12
Worksheet1_field13
...
Worksheet2_field21
Worksheet2_field22
Worksheet2_field23
...
I also have one Excel file with these worksheets and field names:
Worksheet1 containing field11, field12, field13...
Worksheet2 containing field21, field22, field23...
How to export every field from MS SQL to its corresponding Excel worksheet and field? I prefer using only SSIS, if possible.
Thanks a lot!
Gec
↧
↧
What is the most common way of deployment of SSIS package?
Hi everybody,
I am new to SSIS. I have created an SSIS package in development server. I want to deploy it to production server. What is the most common and efficient way of deployment? Please let me know the procedure in details.
Thanks in advance.
Regards,
Anujit Karmakar
Anujit Karmakar Sr. Software Engineer
↧
Use library in an SSIS package
hi all,
i need to use a library in an SSIS package and I need to know if I can do it without Visual Studio? i have SQl Server data tools installed on the server but i don't have the full visual studio. is it possible to use the library on the server without visual studio?
thanks in advance...
↧
The data type of column 'Spec_Desc' is not supported
I am using a Fuzzy lookup and I get the following error.
Error 1 Validation error. Data Flow Task: Fuzzy Lookup [3201]: The data type of column 'Spec_Desc' is not supported. Package.dtsx 0 0
I checked the table in SQL Server and the data type of 'Spec_Desc' is varchar(50).
I am not sure why it is not supported as varchar is a standard data type.
Mr Shaw
Error 1 Validation error. Data Flow Task: Fuzzy Lookup [3201]: The data type of column 'Spec_Desc' is not supported. Package.dtsx 0 0
I checked the table in SQL Server and the data type of 'Spec_Desc' is varchar(50).
I am not sure why it is not supported as varchar is a standard data type.
Mr Shaw
↧
↧
SSIS Script task inside For Each loop halts after first execution due to message box?
I'm looking for an explanation for this one. I have narrowed this down for hours until finally reaching the source of my problem. I have a "for each" container, enumerating through a folder of flat files. Inside the container is a script task that looks at the first 2 letters of the flat files file name, and sets 1 of 5 boolean variables to true, which are then used to direct which 1 of 5 data flows gets executed. I wanted to do a little debugging for an unrelated issue, so I added message boxes to let me know certain values through the execution process. Long story short....simply having this in the script task causes my issue:
DialogResult debugMessage = MessageBox.Show("This freaking blows", "debug", MessageBoxButtons.OK);
Dts.TaskResult = (int)ScriptResults.Success;
This causes the first iteration to go just fine...but on the second, it halts. No error message or warning, it just stays yellow and hangs forever. Removing the messagebox line allows all iterations to go through and the package runs as expected. What could cause this message box to halt everything?
↧
SSIS script component to use defined connection manager to load data from a Oracle
In SSIS script compoment, I can connect to oracle with hard-coded connectionstring:
OracleConnection conn;
conn = new OracleConnection();
conn.ConnectionString = "Data Source=XE;User ID=hr;Password=******";
however, when I defined an connection managers in the script compoment and call it as follows:
IDTSConnectionManager100 connMgr;
OracleConnection conn;
public override void AcquireConnections(object Transaction)
{
connMgr = this.Connections.MyADONETConnectionManager;
conn = (OracleConnection)connMgr.AcquireConnection(null);
}
I got error below:
TITLE: Package Validation Error
------------------------------
Package Validation Error
------------------------------
ADDITIONAL INFORMATION:
Error at Data Flow Task source [Script Component C# Oracel HR Oracle [21]]: System.InvalidCastException: Unable to cast COM object of type 'System.__ComObject' to class type 'Oracle.DataAccess.Client.OracleConnection'. Instances of types that represent COM
components cannot be cast to types that do not represent COM components; however they can be cast to interfaces as long as the underlying COM component supports QueryInterface calls for the IID of the interface.
at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.HandleUserException(Exception e)
at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.AcquireConnections(Object transaction)
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostAcquireConnections(IDTSManagedComponentWrapper100 wrapper, Object transaction)
Error at Data Flow Task source [SSIS.Pipeline]: Script Component C# Oracel HR Oracle failed validation and returned error code 0x80004002.
Error at Data Flow Task source [SSIS.Pipeline]: One or more component failed validation.
Error at Data Flow Task source: There were errors during task validation.
(Microsoft.DataTransformationServices.VsIntegration)
I did not find any example for Orale. A similar SQL server example is as linked below:
http://technet.microsoft.com/en-us/library/ms135939(v=sql.110).aspx
can anybody shed some light? I appreciate it...
thanks,
Steve
↧
Using connection manager connections inside a script component
Within a data flow I have a script component that I want to perform some data calls from. I want to execute SQL commands to connections already defined in the package's connection manager.
Is there a way to set my script's connection variable to the connection manager connection? Or, can I use the connection manager connections directly from within the script?
↧
Need to sequence duplicate records in source and destination.
We have a need to copy records from a table in SQL Server 2008R2(source) to an Oracle 11g(destination) table. If there are no duplicates of a record in the source table, I have a column named SequenceNumber in the destination table with the value of 1. If there are duplicates in the source table I want the SequenceNumber to increment. And if there are records in the source table that are already in the destination table I want the SequenceNumber to increment. The source table can have duplicate records. The destination table cannot have duplicates. I want the SequenceNumber in the destination table to provide uniqueness.
What would be the simplest way to do this?
Thanks for your help,
Fred
Fred Schmid
↧
↧
How to Create Destination automatically if it not avaiable with defined columns.
We have data which need to be send to some Other System.
The SSIS package extracts the data from Some Table based on some business logic, and dump it
into text file.
The Flat File Destination which has the layout defined below
This is the file layout:
05 BR-ISSUE-VOID-IND PIC X.
05 BR-ACCT-NBR PIC X(9).
05 FILLER PIC X.
05 BR-SERIAL-NBR PIC 9(10).
05 BR-CHECK-AMT PIC 9(8)V99.
05 BR-CK-ISSUE-DATE PIC X(6).
05 FILLER PIC X(43).
The above are Cobol Datatype which need to type cast to SSI datatype.
If the Destination doesnot exists the SSIS package need to create automatically, so that the load
process doesnot fail.
Could you please suggest how to create the destination everytime
since the file will be moved(No longer destination will be avaialbe) once data got loaded into the flat file destination , which
will be send to some other system
↧
SSIS Yammer Group is here
Hi all,
We just created the first SSIS specific group in Yammer for all of us to ask questions, to discuss and to share anything about SSIS, including SSIS new release plan, demo and discussion under NDA. We are planning to do a lot of exciting things on SSIS for SQL15 release. We are also working on improving the product as an on-going basis. We will love to have you as part of this journey! Please join the Yammer group and let’s keep in touch on Yammer if you are looking for SSIS SQL15 information (under NDA) discussion!
https://www.yammer.com/bpdtechadvisors/#/threads/inGroup?type=in_group&feedId=4692625
Jimmy↧
Update/Insert records from Oracle to MySQL
Hi team,
My application will insert/update records into Oracle database, I need to sync all of records into MySQL database. I designed a package to load data from Oracle to MySQL, the Oracle database use OLE DB component and MySQL database use ADO.NET.
How to insert new records into MySQL? If the old record exists, we also need to replace with new record. I did some research, someone suggest to create a stage table to handle this scenario, but I have 14 tables in this case. How to handle this scenario with high performance?
If there is anything unclear, please let me know.
Thank you in advance.
↧
Jobs in SSIS
Hi All,
How many jobs we can run parallelely in SSIS.
Thanks in Advance....
↧
↧
OData Source Component for SSIS 2012 for OData v4
Is there any word on an OData Source component for OData v4?
So far as I can tell, the recently released version only supports OData v2 and v3.
↧
SSIS Package Load Failure and is missing Execute SQL Task in Toolbox
Also, BIDS closes after right-clicking the toolbox and selecting “Choose Items”.
I’ve tried several ways to fix these issues with no success.
I’m running SSIS/SSMS/SQL Server 2008 R2 (but not running an SQL instance on my PC) on a Windows XP with Service Pack 3 workstation. I get the following errors:
WHEN OPENING BIDS:
I get 2 errors titled “Package Load Failure”. They both reference ‘Visual Studio Explorers and Designers Package’ as being what failed to load. The first message references GUID 8D8529D3-625D-4496-8354-3DAD630ECC1B. The second references GUID AA612177-A69A-4391-B2F4-17F8A88F4BBA . They both mention contacting the package vendor, but I haven’t got any Add-ins loaded so I’m not sure what that means exactly. They also both ask if I’d like to skip loading the package in the future.
ONCE BIDS IS OPEN:
No error messages appear here. There is no ‘Execute SQL Task’ in the toolbox for Control Flows. Also, if I attempt to open a project containing this object (Execute SQL Task), I get this error in a modal window:
TITLE: Microsoft Visual Studio
------------------------------
There were errors while the package was being loaded.
The package might be corrupted.
See the Error List for details.
------------------------------
BUTTONS:
OK
------------------------------
. . . and these errors in the Error List at the bottom of the IDE:
Error 1 Error loading Package.dtsx: Failed to load task "Execute SQL Task", type "Microsoft.SqlServer.Dts.Tasks.ExecuteSQLTask.ExecuteSQLTask, Microsoft.SqlServer.SQLTask, Version=10.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91". The contact information for this task is "Execute SQL Task; Microsoft Corporation; Microsoft SQL Server 2008 R2; © 2007 Microsoft Corporation; All Rights Reserved;http://www.microsoft.com/sql/support/default.asp;1". C:\Documents and Settings\848862.VCHS_NT_DOMAIN\My Documents\Visual Studio 2008\Projects\LearnSSIS\LearnSSIS\Package.dtsx 1 1
Error 2 Validation error. Execute SQL Task : The task has failed to load. The contact information for this task is "Execute SQL Task; Microsoft Corporation; Microsoft SQL Server 2008 R2; © 2007 Microsoft Corporation; All Rights Reserved;http://www.microsoft.com/sql/support/default.asp;1". Package.dtsx 0 0
Error 3 Validation error. Execute SQL Task : There were errors during task validation. Package.dtsx 0 0
Finally, when I attempt to add the Execute SQL Task via the Tools menu, “Choose Toolbox Items” selection, I do get the tabbed box for adding things. However, they only come up after issuing this error:
The following assemblies are installed SDK assemblies but could not be shown in the customize toolbox dialog because they are missing one or more components. Please make sure that all necessary libraries are available:
Microsoft.SqlServer.SqlCEDest.dll
Microsoft.SqlServer.Management.CollectorTasks.dll
Microsoft.SqlServer.SQLTask.dll
System.Data.SqlServerCe.dll
Microsoft.Synchronization.Data.SqlServerCe.dll
(above dll repeated at bottom of message)
After this message, I have my choice of .NET Framework Compnents. When I select COM Components, those come up with no problem. The WPF Components tab generates the same dll error above. The Maintenance tab is empty. The SSIS Data Flow Items tab loads fine, as does the SSIS Control Flow Items tab – but there’s no Execute SQL Task there either.
If you open the toolbox (on a new project, with a project loaded, or without a project loaded) and right-click, then select “Choose Items”, the entire application quickly closes. This “closing behavior” is the same thing you get if you attempt to add toolbox items through either the Tools menu or the right-click method when you launch BIDS in SafeMode.
In an effort to fix this – I’ve rolled back the .NET Framework version to 3.0 and reinstalled back up to 4; I’ve uninstalled and reinstalled SQL Server 2008 R2 shared services as well as the entire application; I’ve cleared the .tbd files from my user profile; and I’ve run several things from the command line (devenv.exe /resetuserdata, /setup, /resetskippkgs, etc.). Lastly – I’ve applied every Service Pack and update applicable to my PC (ok, it belongs to my employer – but no one here has been able to figure this out either).
After having worked this for several days now and, I think, exhausting every available avenue from search engines – I turn to you. Please let me know if you can help. Also, I can provide any additional files or information you may require.CBS
↧
Authorization Error using CozyRoc SSIS+
Using Sharepoint Connection (CozyRoc SSIS+ 1.6 ), getting the following error:
"The request failed with HTTP status 401: Unauthorized.".
The 'Test Connection' runs succesfully, but the package execution fails. Also, using the SPCRED connection manager, everything runs fine. However, our QA & Prod servers only have licenses for CozyRoc. Any ideas?
↧
SSIS Logging
Hello
We have SSIS running in a server, where we scheudled all our jobs and the pkg store is filesystem. Right now no logging is enabled on any packages. I am trying to implement the logging which will wrties to sysssislog in msdb.
Instead of depending on developpers, we like to do ourselfs enable the logging while scheduling the job. I see there is a tabl "Logging" in the job step properties, i selected the "SSIS log provider for SQL Server" and for the "Configuration string" not sure i am not sure what to put. I need to write the log to the sysssislog in msdb.
Attached is the screenshot. If you anyone know the solution please let me know.
Thank you so much!
↧
↧
SSIS Package Design Best Practices
I'm fairly new to SSIS. I inherited several convoluted SSIS packages and I'm thinking that, perhaps, redesigning them would be best. Here's some background on my situation:
These packages chain sequence containers together. Each sequence container performs a simple extract and load function on a particular set of files. If an extract succeeds or fails, it will move onto the next container.
This job is then deployed in our production environment and has a job associated with it.
My problem is that this package appears as one single step in the job - I wouldn't know if a sequence container fails or is taking long to process. Error handling in the package is nearly non-existent.
From my experience in programming, I would separate tasks into different procedure and I'm guessing proper SSIS package design follows the same principles. Would anyone else suggest this approach - breaking down this one large package into various packages and associate them into one job?
Any help is appreciated!
↧
Use JOIN's in SQL Script or SSIS JOIN Componments
I'm looking for any input anyone may have on using MERGE JOIN and LOOKUP in SSIS packages.
There are several SQL scripts I have that use JOIN's between multiple tables and sometimes between multiple databases as well.
My manager wants to convert all these scripts into SSIS pacakges, which in and of itself is not a big deal. But he also wants any and all JOIN'S in SQL scripts to be implemented using LOOKUP's and MERGE JOIN's in SSIS packages.
I'd like to hear people's opinions on whether or not it's worth it to take make the effort modify all those packages, or just use the scripts as-is and just use an OLE DB source utilizing the existing query. Personally, I think using the components would take more time and would not perform as well as a straight SQL script.
Any and all input is welcome!
Thanks!
A. M. Robinson
↧
Using SSIS to extract raw data(underlying data) from excel pivot table
Hi,
I need to extract data from an excel pivot table. Basically, I have a sheet that only has a few cells with data in them. When I double click on one of the cell(or right click and click on show details), a new sheet is created with new columns, and I want to extract data from the new sheet to a SQL table using SSIS.
Can anybody tell me how to do this please.
Thank you.
↧