hadoop - Problemas con el inicio del flujo de trabajo de Oozie

mapreduce

Question

Tengo un problema al iniciar un flujo de trabajo de Oozie:

Config:

<workflow-app name="Hive" xmlns="uri:oozie:workflow:0.4">
<start to="Hive"/>
<action name="Hive">
<hive xmlns="uri:oozie:hive-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<configuration>
<property>
<name>oozie.hive.defaults</name>
<value>hive-default.xml</value>
</property>
</configuration>
<script>/user/hue/oozie/workspaces/hive/hive.sql</script>
<param>INPUT_TABLE=movieapp_log_json</param>
<param>OUTPUT=/user/hue/oozie/workspaces/output</param>
<file>hive-default.xml#hive-default.xml</file>
</hive>
<ok to="end"/>
<error to="kill"/>
</action>
<kill name="kill">
<message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name="end"/>
</workflow-app>

Contenido del archivo:

[root@localhost ~]# hadoop fs -cat /user/hue/oozie/workspaces/hive/hive.sql
SELECT * FROM ${INPUT_TABLE}

Y obtengo un error:

2013-03-11 06:53:10,196 INFO org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@:start:] Start action [0000025-130310103217365-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2013-03-11 06:53:10,197 WARN org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@:start:] [0000025-130310103217365-oozie-oozi-W@:start:]Action status=DONE
2013-03-11 06:53:10,197 WARN org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@:start:] [0000025-130310103217365-oozie-oozi-W@:start:]Action updated in DB!
2013-03-11 06:53:10,351 INFO org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@Hive] Start action [0000025-130310103217365-oozie-oozi-W@Hive] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2013-03-11 06:53:11,244 WARN org.apache.oozie.action.hadoop.HiveActionExecutor: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@Hive] credentials is null for the action
2013-03-11 06:53:13,734 INFO org.apache.oozie.action.hadoop.HiveActionExecutor: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@Hive] checking action, external ID [job_201303101032_0029] status [RUNNING]
2013-03-11 06:53:13,838 WARN org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@Hive] [0000025-130310103217365-oozie-oozi-W@Hive]Action status=RUNNING
2013-03-11 06:53:13,839 WARN org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@Hive] [0000025-130310103217365-oozie-oozi-W@Hive]Action updated in DB!
2013-03-11 06:53:41,459 INFO org.apache.oozie.servlet.CallbackServlet: USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@Hive] callback for action [0000025-130310103217365-oozie-oozi-W@Hive]
2013-03-11 06:53:41,570 INFO org.apache.oozie.action.hadoop.HiveActionExecutor: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@Hive] action completed, external ID [job_201303101032_0029]
2013-03-11 06:53:41,610 WARN org.apache.oozie.action.hadoop.HiveActionExecutor: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@Hive] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.HiveMain], exit code [10001]
2013-03-11 06:53:41,807 INFO org.apache.oozie.command.wf.ActionEndXCommand: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@Hive] ERROR is considered as FAILED for SLA
2013-03-11 06:53:41,877 INFO org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@kill] Start action [0000025-130310103217365-oozie-oozi-W@kill] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2013-03-11 06:53:41,877 WARN org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@kill] [0000025-130310103217365-oozie-oozi-W@kill]Action status=DONE
2013-03-11 06:53:41,877 WARN org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[0000025-130310103217365-oozie-oozi-W@kill] [0000025-130310103217365-oozie-oozi-W@kill]Action updated in DB!
2013-03-11 06:53:42,030 WARN org.apache.oozie.command.coord.CoordActionUpdateXCommand: USER[hdfs] GROUP[-] TOKEN[] APP[Hive] JOB[0000025-130310103217365-oozie-oozi-W] ACTION[-] E1100: Command precondition does not hold before execution, [, coord action is null], Error Code: E1100

¿Algunas ideas?

Answer 1

El error proviene de Oozie, el coordinador no lanzó el flujo de trabajo; es decir, si inició Oozie con el usuario raíz, detenga el servicio y reinicie el servidor con el usuario que instaló Oozie. Ahora vuelva a ejecutar el flujo de trabajo.

¡Esto resolvería tu problema!