Hi,
Can you please help with the following points?
1. What's the best method/architecture to connect SSIS with Dynamics keeping in mind that I have SQL Server 2005 version? The requirement is to read from the source CRM and load data in the target SQL database.
2. How to manage & log exceptions?
Your feedback will be highly appreciated.
Thanks
JJ
i need to implement below steps.
1. call a webservice to get the records in XML format.
2. After that we want that for each set of records in XML to written in separate reports.
3. the template of report is defined which we need to save in PDF format.
4. Then we need to place that PDF and PDF metadata XML as well at some FTP Location.
Any idea about this. how it can be implemented?
Thanks and Regards,
Dimple Mittal
Hi,
I am pretty new with SSIS.
If I want to bring columns from 2 different tables that are located in different DBs/Servers, and join them by a column that is not indexed in any of the 2 tables. I am only pulling information for the day before, so we are not talking about a lot of data.
Which will work better in this situation, a merge join or a lookup? Does it really matters that the table is not indexed by the column that I will using for my join?
thanks in advanced,
Gus
Some tables return data OK. Some not.
SELECT * FROM OPENQUERY([GAMMA_AZURE], 'SELECT * FROM Sales.SalesOrderHeader'); -- (31466 row(s) affected) SELECT * FROM [GAMMA_AZURE].AdventureWorks2012.Sales.SalesOrderHeader; /* Msg 7356, Level 16, State 1, Line 1 The OLE DB provider "MSDASQL" for linked server "GAMMA_AZURE" supplied inconsistent metadata for a column. The column "SubTotal" (compile-time ordinal 20) of object ""AdventureWorks2012"."Sales"."SalesOrderHeader"" was reported to have a "DBTYPE" of 131 at compile time and 6 at run time. */ SELECT * FROM OPENQUERY([GAMMA_AZURE], 'SELECT * FROM HumanResources.Shift'); /* Msg 7347, Level 16, State 1, Line 1 OLE DB provider 'MSDASQL' for linked server 'GAMMA_AZURE' returned data that does not match expected data length for column '[MSDASQL].StartTime'. The (maximum) expected data length is 16, while the returned data length is 12. */ SELECT * FROM [GAMMA_AZURE].AdventureWorks2012.HumanResources.Shift; /* Msg 7347, Level 16, State 1, Line 1 OLE DB provider 'MSDASQL' for linked server 'GAMMA_AZURE' returned data that does not match expected data length for column '[GAMMA_AZURE].[AdventureWorks2012].[HumanResources].[Shift].StartTime'. The (maximum) expected data length is 16, while the returned data length is 12. */
Kalman Toth Database & OLAP Architect
Paperback / Kindle: Pass SQL Exam 70-461 & Job Interview: Programming SQL Server 2012
We recently migrated from a SQL 2008 Standard server to SQL 2012 Enterprise. In doing so we had to move an SSIS package to the new server. This package is called via a stored procedure. Even though the package is installed on the new server and it runs fine, it will not execute from the stored procedure.
It returns "The SQL Server Execute Package Utility requires Integration Services to be installed by one of these editions of SQL Server 2008: Standard, Enterprise, Developer, or Evaluation. To install Integration Services, run SQL Server Setup and select Integration Services."
The sproc is using xp_cmdshell to execute dtexec from the command line.
I'm aware that 2012 changes the SSIS landscape drastically but I have not seen any documentation that the above method of executing a package from a sproc is not supported.
I did attempt to go the new way of executing a package from an sproc by using SSISDB.Catalog.Create_Execution, Set_Execution_Parameter_Value, and Start_Execution. This works but will only run if the executing user is a windows account. This sproc is fired off from a web application and the connection string to the database is a SQL user.
I tried using Execute As and specifying a windows account but I get the error "The current security context cannot be reverted. Please switch to the original database where 'Execute As' was called and try it again."
Lefka
Can we call multiple child packages from single Execute package task?. It should call child packages based on condition.
i have created 3 simple child packages called A, B, C respectively.
i have taken one user varibale called Event
Now
If Event is A, i need to call child package A
if Event is B, i need to call child package B
if Event is C, i need to call child package C.
Hi Guys,
I have a server which has both SQL database instance and SSIS on it. Which means when I run my packages RAM will be shared by both.
Can somebody please help me understand how I can monitor which is using how much memory when my packages are running?
I have a host of packages, few running in parallel and few in sequence. All the packages will be pulling data from SQL db's from another server and will be writiing into the SQL db's where the SSIS is running.
Any help is greatly appreciated.
Thanks, Pulkit Ojha Microsoft Business Intelligence Developer
Good Morning ,
I have a package that i'm trying to run in BIDS. The source and destination are both SQL Server databases. I'm just loading the data using the fast load, and the data flow task is failing with the following errors, these are the errors that i see under the execution results tab.
An OLE DB record is available. Source: "Microsoft SQL Server Native Client 10.0" Hresult: 0x80040E21 Description: "Multiple-step OLE DB operation generated errors. Check each OLE DB status value, if available. No work was done."
[Destination 3 - FUNGUIDE_Facility [309]] Error: Cannot create an OLE DB accessor. Verify that the column metadata is valid.
[SSIS.Pipeline] Error: component "Destination 3 - FUNGUIDE_Facility" (309) failed the pre-execute phase and returned error code 0xC0202025.
I think the problem is with a field name "Blurb". It has a datatype of "DT_STR" and the destination has a data type of "DT_TEXT". I tried the following options.
I right clicked on the source advance editor and changed the data type (still no luck), then i used the derived column transformation and still no luck. Can anyone please guide me in the right direction or tell me where i should be looking for or where i'm going wrong?
Thanks
SV
Hi,
I have to process some input dataset and i need to verify some conditions for each row if conditions are met then i have to insert a new row by doing some calculation on some rows along with previous rows. How can i do this in SSIS which task can do it more efficiently as i have around 50k rows at input. Can any one suggest best way of doing it and if possible provide any references doing similar task.
Thanks,
kiran
Hi, I am pretty new to Package Configuration, here what i am trying to acheive (sorry for the bad English it is not my native langagues). I got a package which is pretty simple it use a VB script to declare Global Variable , after that it goes to an Oledb connection which use a query that get information from a database and after that put them in a Flat File Destination. Here my problem I'm doing this for a compagnie and i dont want to change all the time the path for the file and and the connection String for the DataBase. I want them to update automaticly by just setting up a Configuration Manager Object. The problem is i dont really understand how it work. Right now its doing the complete opposite of what i wanna do it take the connection string of my oledb connection and put it in a Table, but what i want it to do is take the connection of my customer and puts it in the oledb Connection Source like dinamicly and the same thing with the flat file destination. I just want it to get the information from a Table and set it up automaticly.
I Hope i was clear enough thanks for response. Help me please
Hi Friends
I have a user variable RowNumber (Integer) value=0
Now I have 2 execute SQL Tasks and how to write & map a query like this:
1st Execute SQL Task:
select * from table where Row_Number = ?
And map parameter(?) to "Variable RowNumber + 1"
2nd Execute SQL Task:
select * from table where Row_Number = ?
And map parameter(?) to "Variable RowNumber + 2"
Royal Thomas
To whomever can offer assistance, I would be very grateful: Could someone please supply an example for how to consume a web service using a secure certificate in SQL Server Integration Services, preferably in C#. I'm working with a SQL Server 2008R2 platform with BIDS purchased after SQL Server installed (Visual Studio 2008, version 9.0).
My own research indicates that I need to combine use of the X509Certificate class, and the HttpClientConnection class (specifically using the Certificate property).
I have successfully enumerated the installed certificates. I can create an OLEDB connection. And I can consume an unsecured web service. I'm having difficulty, however, figuring out how to implement a web service when the certificate has to be packaged with a web service method request to retrieve data.
Where is it best to do this? In a script component, or script task?
Is there a better class to use than the HttpClientConnection?
As an aside ... this is a repeat inquiry of an Integration Services forum post, although a more focused question than before. It's being asked again subsequent to my TechNet subscription initiation, hoping that it will kick in and get my question answered if I can't obtain one from the forum community.
I'm an occasional C# .NET user, although no novice at programming, nor intimidated by challenging environments. I am, however, troubled by what appears to me to be a less than ideal number of examples that demonstrate how classes can be implemented in SSIS to facilitate higher-level, but surely common tasks, such as consuming web services with secure certificates.
This is a problem I've been trying to work through off and on for a couple of weeks now. I keep stumbling onto deprecated procedures, or outright Visual Studio examples that don't help understand deployments in the peculiar SSIS template environment. I'd sure appreciate a clear explanation - and thank you very much for the help.
SQL Server 2008 R2 SP2 - Windows 2008 R2
I am trying to delete a SSIS project from the BIDS. Please some one verify this. I think you can not delete a SSIS project from BIDS. You can unload, remove or "Exclude from project" but you need to go to the directory where you created the project and files and manually delete the files to get rid of the project all together.
I am trying to follow the instructions in the following msdb link
http://msdn.microsoft.com/en-us/library/ms141695(v=sql.105).aspx
and towards the bottom of this page there is this information;
In Business Intelligence Development Studio, open the solution from which you want to remove an Integration Services project.
In Solution Explorer, right-click the project, and then click Exclude From Project.
In Solution Explorer, right-click the project, and then click Remove.
Click OK to confirm the removal.
When I right click on a ptroject (I have 3 of them on the same solution and I have 2 different projects), I never see the option "Exclude from project". The question is, am I missing something, missing a piece of the software or Microsoft has someting that is dumb again ?
and yes I have checked the "Always show solution" option.
Thanks for any input.
Hi All,
Thanks in advance.
I am trying to connect the informix database through SSIS using Sql Server 2008 R2 64 Bit BIDS, But getting the following error.
Please help me out to resolve the same.
I have created the ODBC connection. Hence the connection has been succeed, But still I cant able to connect the informix Database using SSIS
by
Rajan
if I have a script task in a dataflow task as a datasource, and it produces 5 rows for example.
I have two third party components to insert records to crm entities. ie. ent_hrd and ent_body
The rows contain field1, field2, field3 field4 and field5
I can map the script output field1 to ent_hrd and the other fields to ent_body. the problem im trying to figure out is how (if possible) to just pass the 1st record to ent_hrd but all five rows to ent_body
I know there is multicast which will feed both components, but how to limit one branch to just one record
in this sceniro I would want to end up with 1 record in ent_hrd and five records in ent_body
Dont ask me .. i dont know
Hi All,
I have used other ETL tools before and nothing as frustrating as SSIS. This i sjust a simple package that i'm trying to run (created by a different user). In the simple package both the source and destination are sql server databases. I'm using the NATIVE CLIENT in the connection manager. The package loads data from 8 tables and all the laods are done fine except on one table. I'm getting the following error messages.
[OLE DB Destination [664]] Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80040E21.
An OLE DB record is available. Source: "Microsoft SQL Server Native Client 10.0" Hresult: 0x80040E21 Description: "Multiple-step OLE DB operation generated errors. Check each OLE DB status value, if available. No work was done.".
[OLE DB Destination [664]] Error: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "input "OLE DB Destination Input" (677)" failed because error code 0xC020907B occurred, and the error row disposition on "input "OLE DB Destination Input" (677)" specifies failure on error. An error occurred on the specified object of the specified component. There may be error messages posted before this with more information about the failure.
[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "OLE DB Destination" (664) failed with error code 0xC0209029 while processing input "OLE DB Destination Input" (677). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the failure.
Can the guru's please help me or point me in some direction as to what is happening , for this table i'm using a derived column operator to convert the data from D_STR to D_TEXT , In the expression of the derived column operator i'm using (DT_NTEXT)(COLUMNNAME), also i created a flat file to capture the bad records if any instead none of the rows are passed into the flat file. Its just a simple data load and shouldnt give a problem. i hope we use Oracle producuts.
hu guys,
Does anybody has loaded the USPS city/state addresses in a text file format to a table , my manager gave me a CD to load a flat file with no consistent delimiters and no headers in a table,does anybody have loaded USPS addresses in the past , if so can you guide me to do this
any help is much appreciated.
Hi,
Can anyone please guide me with this.We have a ftp server "172.19.312.12" and this server has files sav "B20130208.2200-20130208.2300_mobile-aaa","B20130208.2300-20130208.2400_seamobile-aaa","B20130208.2200-20130208.2500_seamobile-aaa",...on folder "data". The folder gets updated every hour. I need to grab these files from the ftp server and then place them in sql server database, that i have to create tables, script to insert data.Please can anyone guide me how to achieve this. I am not sure if i can achieve this using ssis packages.
Thanks!
rr
Hi All,
I have two measures: M1 and M2, and create new member:
CREATE MEMBER CURRENTCUBE.[Measures].[Average] AS
IIF(Not IsEmpty([Measures].[M2]) AND [Measures].[M2]=0,Null,[Measures].[M1]/[Measures].[M2])
And one Time Calculations:
CREATE MEMBER CURRENTCUBE.[Time].[Time Calculations].[TP] AS
SUM({[Time].[Time Calculations].DefaultMember} * { Members("[Time].[Date].[20120101]") : Members("[Time].[Date].["20120229]")));
The result is
TP
M1M2 Average
| $1,199,879.14 | 55,783 | $131.56 |
What's wrong?
Thanks,
Andrew Huang
andrew.huang.2009@gmail.com