Hi,
I'm testing out the new task for Hadoop ins SSIS SQL2016. For this I have installed the HDInsight emulator and tried to execute a little pig script. When I execute it directly at the grunt prompt from pig the script works as expected, however if I execute it as a Hadoop Pig Script in SSIS it fails and I have the following output (Remove Comment from Logs is the name of the task):
[Remove Comment from logs] Information: Schedule hadoop job successfully. Job id is job_1455103176281_0024
[Remove Comment from logs] Information: Hadoop job job_1455103176281_0024 status is Prep
[Remove Comment from logs] Information: Hadoop job job_1455103176281_0024 status is Prep
[Remove Comment from logs] Information: Hadoop job job_1455103176281_0024 status is Running
[Remove Comment from logs] Information: Hadoop job job_1455103176281_0024 status is Succeeded
[Remove Comment from logs] Information: Hadoop job job_1455103176281_0024 tracking url is
[Remove Comment from logs] Information: Hadoop job job_1455103176281_0024 exit value is 255
[Remove Comment from logs] Error: Hadoop job job_1455103176281_0024 exit value is not 0
Task Remove Comment from logs failed
Likewise if I execute a hive script in the hive prompt everthing works as expected, however if I execute the same script as a Hadoop Hive Task It fails with the following output:
[Hadoop Hive Task] Information: Schedule hadoop job successfully. Job id is job_1455103176281_0025
[Hadoop Hive Task] Information: Hadoop job job_1455103176281_0025 status is Prep
[Hadoop Hive Task] Information: Hadoop job job_1455103176281_0025 status is Prep
[Hadoop Hive Task] Information: Hadoop job job_1455103176281_0025 status is Running
[Hadoop Hive Task] Information: Hadoop job job_1455103176281_0025 status is Running
[Hadoop Hive Task] Information: Hadoop job job_1455103176281_0025 status is Succeeded
[Hadoop Hive Task] Information: Hadoop job job_1455103176281_0025 tracking url is
[Hadoop Hive Task] Information: Hadoop job job_1455103176281_0025 exit value is 403
[Hadoop Hive Task] Error: Hadoop job job_1455103176281_0025 exit value is not 0
Task Hadoop Hive Task failed
It looks to me that the hadoop jobs are executed successfully, although no data is produced and that there is somehow a failure at the tracking url's causing the failure (just my thought).
Has anyone got the Hadoop Task in SQL2016 working or can anyone help me with this errors.
I'm using CTP 3.3
Thanks a lot in advance
Marc Mertens