With the explosion of data, the open source Apache™ Hadoop™ Framework is gaining traction thanks to its huge ecosystem that has arisen around the core functionalities of Hadoop distributed file system (HDFS™) and Hadoop Map Reduce. As of today, being able to have SQL Server working with Hadoop™ becomes increasingly important because the two are indeed complementary. For instance, while petabytes of data can be stored unstructured in Hadoop and take hours to be queried, terabytes of data can be stored in a structured way in the SQL Server platform and queried in seconds. This leads to the need to transfer data between Hadoop and SQL Server.
↧
Hadoop and SSIS
↧
Copy the files from ftp server to local meachine
Hi
I tried to copy the files( only today created) from ftp server to local meachine,can you help how to filter the today created files in ftp serve
↧
↧
SSIS and Social Media Data
Hello All,
I'm looking for insights on the capability of SSIS in handling social media Data ,i have been researching bigdata & Hadoop for past few days,is it anyway nearly possible to implement a limited micro level analytics of social media using Microsoft BI Stack .
Many Thanks
Kumar
↧
Attunity high speed Oracle connectors for SSIS
↧
SSIS Balanced Data Distributor
↧
↧
BULK LOAD to Oracle using SSIS
↧
Checkpoint in parent package and child packages
There are a post talking this issue already. But I hope to see some clear answer.
THere is one parent package, which includes several child packages, and the child packages may have child packages as well. So there is parent->child->grandchild packages.
I want to implement checkpoint mechanics so that, if a grandchild fails in a task, when rerunning the parent, it will start from the error task. Is it possible to use Checkpoint? I saw a solution that uses an audit table to implement the checkpoint mechanics mannually (i.e., not using standard checkpoint function).
Any ideas?
↧
SSIS Package Script task source is CSV file to load into Excel file destination. How load that?
Hi Experts,
SSIS package My Source is CSV file in diffrent server,my destination is local folder to load into Excel file formate.
How to load CSV to Excel formate.???
Please send me clear information on that.
Regards
Rama
↧
No sure how to go about this please see for more details
I wrote below query to get result in-terms of year,quarter wise
SELECT
YEAR(OrderDate) AS OrderYear,
SUM(CASE WHEN DATEPART(Q,OrderDate)=1 THEN TotalDue ELSE 0 END) AS Quater1,
SUM(CASE WHEN DATEPART(Q,OrderDate)=2 THEN TotalDue ELSE 0 END) AS Quater2,
SUM(CASE WHEN DATEPART(Q,OrderDate)=3 THEN TotalDue ELSE 0 END) AS Quater3,
SUM(CASE WHEN DATEPART(Q,OrderDate)=4 THEN TotalDue ELSE 0 END) AS Quater1
FROM Sales.SalesOrderHeader
GROUP BY YEAR(OrderDate)
Below is the query result
OrderYear Quater1 Quater2 Quater3
Quater1
----------- --------------------- --------------------- --------------------- ---------------------
2004 14170982.5455 17969750.9487 56178.9223 0.00
2001 0.00 0.00
5850932.9483 8476619.278
2002 7379686.3091 8210285.1655 13458206.13 10827327.4904
2003 8550831.8702 10749269.374 18220131.5285 16787382.3141
The same thing i am trying to achive using SSIS.Bit baffled how to go about this.
Smash126
↧
↧
Advise on Moving from Using Physical Machines to Virtual Machines for SSIS processing
As a Part of Infrastructure consolidation we are being suggested to move from using physical servers to Virtual machines for SSIS Dedicated processing.
Can you please advise some concerns or factors we need to consider before going virtual.
Also Any known issues with performance with Virtual machines and SSIS
or any Settings we need to be careful to utilize the virtual machines completely for optimal performance on SSIS.
Your Suggestions and Advice will be of great help.
dev
↧
Excel source to DB table load - Error - Pls help
Hi,
A simple Excel Source to OLE DB Table load, throws error
//////
[Excel Source [1]] Error: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC00F9304. There may be error messages posted before this with more information on why the AcquireConnection method call failed.
and
The Excel Connection Manager is not supported in the 64-bit version of SSIS, as no OLE DB provider is available."
////
I know this can be resolved by changing the Config Property > Debugging > Run 64bitRunTime = false...But I dont want this to be changed. I want 64bitruntime = TRUE only as our client is executing in PROD 64 bit server and wants 64bitRunTime only.
Is there any ways to accomplish this? Help would be greatly appreciated.
↧
"file name is not properly specified" error on 2008R2 Export Column transform
I have data of type image in a normal table which I am trying to export to disk files. Setting up an SSIS package with an Export Column transform appears to be very simple. There is not much to it.
When I run the package, I take the following error:
Error at Data Flow Component [Raw File Destination [73]]: The file name is not properly specified. Supply the path and name to the raw file either directly in the FileName property or by specifying a variable in the FileNameVariable property.
I'm sorry, but I have looked everywhere for a filename property anywhere in this package. If it is there, I sure can't find it.
Here is the query for the data source:
declare @path varchar(100)
set @path = 'c:\images\'
SELECT MM_Content
,@path +CAST(MM_KEY1 AS VARCHAR) + '.' + MM_TYPE AS Path
FROM AIM_APPS.AIM.DBO.MULTIMEDIA
Thanks for your time,
George
↧
send mail with a query results as table in email body
Hi,
I have a query that returns a few rows and columns, I'd like to set up a daily email to send it me automatically with this simple table in email body. I created Execute SQL Task that saves query results in a variable of object type but I cannot use this variable to pass the results onto the Send Mail Task as it was not of String type.
Do you know how to achieve it? I've tried to send email using Script Task and retrieve the query data from the variable and pass it on to the email body but couldn't do it. I thought that perhaps through Script Task it was possible to set up.
I found on the net this bit of code
Can you tell me if I'm thinking in the right direction?
I have a query that returns a few rows and columns, I'd like to set up a daily email to send it me automatically with this simple table in email body. I created Execute SQL Task that saves query results in a variable of object type but I cannot use this variable to pass the results onto the Send Mail Task as it was not of String type.
Do you know how to achieve it? I've tried to send email using Script Task and retrieve the query data from the variable and pass it on to the email body but couldn't do it. I thought that perhaps through Script Task it was possible to set up.
I found on the net this bit of code
Dim results As DataSet
results = CType(ReadVariable("MyAdoVariableName"), DataSet)
but it didn't work as I was getting the message "ReadVariable not declared". Any ideas?Can you tell me if I'm thinking in the right direction?
↧
↧
Execute SQL task - SQL statements see in runtime
I have Execute SQL Task in an loop, with Dynamic varialbes forming an SQL Statement in runtime.
I am getting error on running the package in the Execute SQL Task due to SQL statement.
how to see the SQLStatement ? i tryed in Locals immediate window by keeping breakpoint, i am not able to find any relevent Name
pls help
ShanmugaRaj
↧
Error at Data Flow Task [Excel Destination [6804]]: Columns......cannot convert between unicode and non-unicode string data types.
I have tried making the columns dt_str and dt_wstr in the derived column editor but does not fix the error. I am trying to copy data from a table (ole DB Source) to an excel spreadsheet (Destination). Changing the datatypes does not seem to make
a difference. MSSQL 2008 R2.
↧
Loading header and details information to separate tables
Hi,
I am developing SSIS packages for my current project. We get the data from different sources and for some files, we are getting header and details
information in single row, also details information can be 20 line or more. I need to load this data to two separate tables. I did googled on this, does not help much. Any help greatly appreciated.
Data format looks like below:
Order_Number, OrderDate, Amount, GrossCost, NetCost, Discount, Payment_Type..... Item 1 Product Code, Item 1 Quantity, Item 2 Product Code, Item 2 Quantity, Item 3 Product Code, Item 3 Quantity, Item 4 Product Code, Item 4 Quantity,........Item 25 Product Code, Item 25 Quantity
Thanks in advance
↧
matching interval values in ssis
Hi ,
i want to know the interval values in the data that search same pattern matching for multiple rows.
here is my data
i want to get the 1,2,4,5 records in one table because it contains same interval how i can do this by ssis??????
Is there any seperate pattern matching tools for ths please do reply.
Thanks in advance
↧
↧
UnZip a File Through SSIS2008R2
Hi,
I have one Zip File and How to Unzipe File Through SSIS2008 R2.
vasu
↧
How to Take a .txt File For Every day Through SSIS2008R2
Hi,
I have one Folder C:\Test\Files\ AA09112012ControlP01.txt like that iam getting .txt files .How to take a file Through Configure the Flot File connection string.
This is the Files Example:
AA09112012ControlP01.txt
AA10112012ControlP01.txt
AA11112012ControlP01.txt
Please help me on this........
Note:other wise i want all Text file In that path.
vasu
↧
Deriving datetime column from two string column
Hi everyone,
I just started learning SSIS today. Completed 2 tutorials. Now getting started with my tasks. However after reading some documentation on SSIS data types, i am so so dead.
In my oracle datasource, due to biz nature, my EVENT_D column are in DD/MM/YYYY format and my EVENT_T are in HH:MM:SS format. Both columns are strings. I need to do a data conversion to both field to date field and time field respectively. In addition, i need to concat these two columns to derive a new column named EVENT_DT which is needed to be in datetime data type.
i realized that i cant have data in DD/MM/YYYY format.
I wish to have my EVENT_DT to be in DD/MM/YYYY HH:MM:SS format. Are there any solutions?
Thanks.
↧