gui experience hadoop hive hue

hadoop - experience - hue editor



Error de Hive en todas las consultas: no se pudo encontrar el registro asociado con el identificador de operaciĆ³n (4)

Obteniendo un error en todas las consultas de colmenas que se ejecutan en Hadoop.

Simplemente ejecute una instrucción select de una tabla que exista y obtenga los siguientes resultados:

Fetching results ran into the following error(s): Couldn''t find log associated with operation handle: OperationHandle[opType=EXECUTE_STATEMENT, getHandleIdentifier()=263df9c3-c076-454f-a025-23f5b919e957]

Y los registros que acompañan a la consulta son:

Estado incorrecto para la solicitud TFetchResultsReq (fetchType = 1, operationHandle = TOperationHandle (hasResultSet = False, modifiedRowCount = None, operationType = 0, operationId = THandleIdentifier (secret = ''% / x1d / x0f / x11 / xce / xf4B / xd6 / xb8 / xb5 / x8ddv / xceKV '', guid = "/ xbc5 / xd9 | / xfa / x13J'' / x86 / x8e4 / xb3 / x87 / xa0 / xf4 / x05")), orientation = 4, maxRows = -1): TFetchResultsResp (estado = TStatus (errorCode = 0, errorMessage = "No se pudo encontrar el registro asociado con el identificador de operación: OperationHandle [opType = EXECUTE_STATEMENT, getHandleIdentifier () = bc35d97c-fa13-4a27-868e-34b387a0f405]", sqlState = None, infoMessages = [" * org.apache.hive.service.cli.HiveSQLException: no se pudo encontrar el registro asociado con el identificador de operación: OperationHandle [opType = EXECUTE_STATEMENT, getHandleIdentifier () = bc35d97c-fa13-4a27-868e-34b387a0f405]: 25: 24 ", '' org.apache.hive.service.cli.operation.OperationManager: getOperationLogRowSet: OperationManager.java: 257 '','' org.apache.hive.service.cli.session.HiveSessionImpl: fetchResults: HiveSessionImpl.java: 656 '','' sun. reflejar.GeneratedMe thodAccessor29: invoke :: - 1 '','' sun.reflect.DelegatingMethodAccessorImpl: invoke: DelegatingMethodAccessorImpl.java: 43 '','' java.lang.reflect.Method: invoke: Method.java: 606 '','' org.apache.hive. service.cli.session.HiveSessionProxy: invoke: HiveSessionProxy.java: 79 '','' org.apache.hive.service.cli.session.HiveSessionProxy: acceso $ 000: HiveSessionProxy.java: 37 '','' org.apache.hive.service .cli.session.HiveSessionProxy $ 1: run: HiveSessionProxy.java: 64 '','' java.security.AccessController: doPrivileged: AccessController.java: -2 '','' javax.security.auth.Subject: doAs: Subject.java: 415 '','' org.apache.hadoop.security.UserGroupInformation: doAs: UserGroupInformation.java: 1628 '','' org.apache.hadoop.hive.shims.HadoopShimsSecure: doAs: HadoopShimsSecure.java: 536 '','' org.apache.hive .service.cli.session.HiveSessionProxy: invoke: HiveSessionProxy.java: 60 '','' com.sun.proxy. $ Proxy28: fetchResults :: - 1 '','' org.apache.hive.service.cli.CLIService: fetchResults: CLIService.java:427 '','' org.apache.hive.service.cli.thrift.ThriftCLIService: FetchResults: ThriftCLIService.java:587 '','' org.apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults: getResult: TCLIService.java: 1553 '','' org.apache.hive.service.cli.thrift.TCLIService $ Procesador $ FetchResults: getResult: TCLIService.java: 1538 '','' org.apache.thrift.ProcessFunction: process: ProcessFunction.java: 39 '','' org.apache.thrift.TBaseProcessor: process: TBaseProcessor.java: 39 '','' org.apache.hive.service.auth.TSetIpAddressProcessor: process: TSetIpAddressProcessor.java: 56 '','' org.apache.thrift.server.TThreadPoolServer $ WorkerProcess: run: TThreadPoolServer.java: 206 '','' java.util.concurrent. ThreadPoolExecutor: runWorker: ThreadPoolExecutor.java: 1145 '','' java.util.concurrent.ThreadPoolExecutor $ Worker: ejecutar: ThreadPoolExecutor.java: 615 '','' java.lang.Thread: ejecutar: Thread.java: 744 ''], statusCode = 3), results = None, hasMoreRows = None) Estado incorrecto para la solicitud TFetchResultsReq (fetchType = 1, operationHandle = TOperationHandle (hasResultSet = False, modifiedRowCount = None, operationType = 0, operationId = THandleIdentifier (secret = ''c / xdf / xfe / xb7 / x8a / x10D / xea / xbaD / x93} B / xb5 / xc3 / xe7 '', guid ='' & = / xf9 / xc3 / xc0vEO / xa0% # / xf5 / xb9 / x19 / xe9W '')) , orientation = 0, maxRows = -1): TFetchResultsResp (status = TStatus (errorCode = 0, errorMessage = "No se pudo encontrar el registro asociado con el identificador de operación: OperationHandle [opType = EXECUTE_STATEMENT, getHandleIdentifier () = 263df9c3-c076-454f- a025-23f5b919e957] ", sqlState = None, infoMessages = [" * org.apache.hive.service.cli.HiveSQLException: no se pudo encontrar el registro asociado con el identificador de operación: OperationHandle [opType = EXECUTE_STATEMENT, getHandleIdentifier () = 263df9c3-c076 -454f-a025-23f5b919e957]: 25: 24 ", ''org.apache.hive.service.cli.operation.OperationManager: getOperationLogRowSet: OperationManager.java: 257'', ''org.apache.hive.service.cli.session. HiveSessionImpl: fetchResults: HiveSessionImpl.java: 656 '','' sun.reflect.GeneratedMethodAccessor29: invoke :: - 1 '','' sun.reflect.DelegatingMethodAccessorImpl: invoke: DelegatingMethodAccessorImpl.java: 43 '','' java.lang.reflect.Method: invoke: Method.java: 606 '','' org.apache.hive.service.cli .session.HiveSessionProxy: invoke: HiveSessionProxy.java: 79 '','' org.apache.hive.service.cli.session.HiveSessionProxy: access $ 000: HiveSessionProxy.java: 37 '','' org.apache.hive.service.cli. session.HiveSessionProxy $ 1: run: HiveSessionProxy.java: 64 '','' java.security.AccessController: doPrivileged: AccessController.java: -2 '','' javax.security.auth.Subject: doAs: Subject.java: 415 '','' org.apache.hadoop.security.UserGroupInformation: doAs: UserGroupInformation.java: 1628 '','' org.apache.hadoop.hive.shims.HadoopShimsSecure: doAs: HadoopShimsSecure.java: 536 '','' org.apache.hive.service. cli.session.HiveSessionProxy: invoke: HiveSessionProxy.java: 60 '','' com.sun.proxy. $ Proxy28: fetchResults :: - 1 '','' org.apache.hive.service.cli.CLIService: fetchResults: CLIService.java : 427 '','' org.apache.hive.service.cli.thrift.ThriftCLIService: FetchResults: ThriftCLIService.java: 587 '','' org.apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults: getResult: TCLIService .java: 1553 '','' org.apache.hive.service.cli.thrift.TCLIService $ Processor $ Fetc hResults: getResult: TCLIService.java: 1538 '','' org.apache.thrift.ProcessFunction: process: ProcessFunction.java: 39 '','' org.apache.thrift.TBaseProcessor: process: TBaseProcessor.java: 39 '','' org. apache.hive.service.auth.TSetIpAddressProcessor: process: TSetIpAddressProcessor.java: 56 '','' org.apache.thrift.server.TThreadPoolServer $ WorkerProcess: run: TThreadPoolServer.java: 206 '','' java.util.concurrent.ThreadPoolExecutor: runWorker: ThreadPoolExecutor.java: 1145 '','' java.util.concurrent.ThreadPoolExecutor $ Worker: ejecutar: ThreadPoolExecutor.java: 615 '','' java.lang.Thread: ejecutar: Thread.java: 744 ''], statusCode = 3) , results = None, hasMoreRows = None) Estado incorrecto para la solicitud TFetchResultsReq (fetchType = 1, operationHandle = TOperationHandle (hasResultSet = False, modifiedRowCount = None, operationType = 0, operationId = THandleIdentifier (secret = ''c / xdf / xfe / xb7 / x8a / x10D / xea / xbaD / x93} B / xb5 / xc3 / xe7 '', guid ='' & = / xf9 / xc3 / xc0vEO / xa0% # / xf5 / xb9 / x19 / xe9W '')), orientation = 0, maxRows = -1): TFetchResultsResp (estado = TStatus (errorCode = 0, errorMessage = "No se pudo buscar el registro asociado con el identificador de operación: OperationHandle [opType = EXECUTE_STATEMENT, getHandleIdentifier () = 263df9c3-c076-454f-a025-23f5b919e957] ", sqlState = None, infoMessages = [" * org.apache.hive.service.cli.HiveSQLException: No se pudo encontrar el registro asociado con el identificador de operación: OperationHandle [opType = EXECUTE_STATEMENT, getHandleIdentifier () = 263df9c3-c076-454f-a025-23f5b919e957]: 25: 24 ", ''org.apache.hive.service.cli.operation.OperationManager : getOperationLogRowSet: OperationManager.java: 257 '','' org.apache.hive.service.cli.session.HiveSessionImpl: fetchResults: HiveSessionImpl.java: 656 '','' sun.reflect.GeneratedMethodAccessor29: invoke :: - 1 '','' sun .reflect.DelegatingMethodAccessorImpl: invoke: DelegatingMethodAccessorImpl.java: 43 '','' java.lang.reflect.Method: invoke: Method.java: 606 '','' org.apache.hive.service.cli.session.HiveSessionProxy: invoke: HiveSessionProxy .java: 79 '','' org.apache.hive.service.cli.session.HiveSessionProxy: acceso $ 000: HiveSessionProxy.java: 37 '','' org.apache.hive.service.cli.session.HiveSe ssionProxy $ 1: ejecutar: HiveSessionProxy.java: 64 '','' java.security.AccessController: doPrivileged: AccessController.java: -2 '','' javax.security.auth.Subject: doAs: Subject.java: 415 '','' org. apache.hadoop.security.UserGroupInformation: doAs: UserGroupInformation.java: 1628 '','' org.apache.hadoop.hive.shims.HadoopShimsSecure: doAs: HadoopShimsSecure.java: 536 '','' org.apache.hive.service.cli. session.HiveSessionProxy: invoke: HiveSessionProxy.java: 60 '','' com.sun.proxy. $ Proxy28: fetchResults :: - 1 '','' org.apache.hive.service.cli.CLIService: fetchResults: CLIService.java: 427 '','' org.apache.hive.service.cli.thrift.ThriftCLIService: FetchResults: ThriftCLIService.java: 587 '','' org.apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults: getResult: TCLIService.java : 1553 '','' org.apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults: getResult: TCLIService.java: 1538 '','' org.apache.thrift.ProcessFunction: process: ProcessFunction.java: 39 '', ''org.apache.thrift.TBaseProcessor: process: TBaseProcessor.java: 39'', ''org.apache.hive .service.auth.TSetIpAddressProcessor: process: TSetIpAddressProcessor.java: 56 '','' org.apache.thrift.server.TThreadPoolServer $ WorkerProcess: run: TThreadPoolServer.java: 206 '','' java.util.concurrent.ThreadPoolExecutor: runWorker: ThreadPoolExecutor .java: 1145 '','' java.util.concurrent.ThreadPoolExecutor $ Worker: ejecutar: ThreadPoolExecutor.java: 615 '','' java.lang.Thread: ejecutar: Thread.java: 744 ''], statusCode = 3), results = Ninguno, hasMoreRows = Ninguno)


Si está utilizando AWS EMR, agregue lo siguiente al archivo hive-site.xml en /etc/hive/conf.dist/hive-site.xml :

<property> <name>hive.server2.logging.operation.enabled</name> <value>true</value> </property>

A continuación, inicie sesión en el nodo maestro y reinicie el servidor de hue y colmena

sudo stop hive-server2 sudo stop hue sudo start hue sudo start hive-server2

Esto lo arregló para mí (probado en la etiqueta de lanzamiento emr-4.6.0 ).


Este error puede ocurrir con el ie ("hive.server2.logging.operation.log.location") apunta a una ubicación que no existe para escribir registros.

Mira el código de OperationManager.java

OperationLog operationLog = getOperation(opHandle).getOperationLog(); if (operationLog == null) { throw new HiveSQLException("Couldn''t find log associated with operation handle: " + opHandle); }


Si está viendo esto en una distribución de Cloudera cuando usa Hue, agregue lo siguiente al Fragmento de configuración avanzada de Hive Service (Valve de seguridad) para hive-site.xml en Cloudera Manager (o directamente a hive-site.xml para otro distros):

<property> <name>hive.server2.logging.operation.enabled</name> <value>true</value> </property>


En Windows 8.1, también me enfrenté a la misma parte del problema dentro de la parte de consulta de la hive .

org.apache.hive.service.cli.HiveSQLException: Couldn''t find log associated with operation handle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=230485c4-a1be-4a17-94c8-a1ebce426319]

por lo tanto, fui al %HIVE_HOME%/conf/hive-site.xml y cambié el nombre de la propiedad hive.server2.logging.operation.log.location valor anterior ${system:user.name}/operation_logs para que me gustara a continuación dijo -

<property> <name>hive.server2.logging.operation.log.location</name> <value>/tmp/${user.name}/operation_logs</value> <description>Top level directory where operation logs are stored if logging functionality is enabled</description> </property>

y también reemplazó todos los valores que contienen el ${system:user.name} a /tmp/${user.name} y esto me lleva al problema del registro de trabajos en la colmena, gracias.