How to solve the "out of sequence response error" while executing more than one hive loader in the workflow?

Hi Knime team,

While executing the two hive loader parallely, we are getting the following error,

ERROR Hive Loader          2:45       Execute failed: org.apache.thrift.TApplicationException: ExecuteStatement failed: out of sequence response

We are configured the Database timeout for operations is 900s.

some time getting the following error as well for the same scenario.

ERROR Hive Loader          3:166      Execute failed: GetTables failed: out of sequence response
ERROR Hive Loader          3:57       Execute failed: org.apache.thrift.TApplicationException: ExecuteStatement failed: out of sequence response
ERROR Hive Loader          3:162      Execute failed: Read a negative frame size (-2147418110)!

how to avoid or fix the above error, while executing two or more hive loaders parallely in the workflow?

or Are we missed any configuration for running more than one hive loader scenario?

Is KNIME supports multiple hive loader execution?

Kindly provide the suggestion for this and let me know if you need more information regarding this.

Thanks in advance.

please, find the below knime.log for the Execute failed: org.apache.thrift.TApplicationException: ExecuteStatement failed: out of sequence response.

2015-11-17 12:58:47,537 : DEBUG : KNIME-Worker-99 : Hive Loader : Hive Loader : 2:45 : reset
2015-11-17 12:58:47,537 : ERROR : KNIME-Worker-99 : Hive Loader : Hive Loader : 2:45 : Execute failed: org.apache.thrift.TApplicationException: ExecuteStatement failed: out of sequence response
2015-11-17 12:58:47,538 : DEBUG : KNIME-Worker-99 : Hive Loader : Hive Loader : 2:45 : Execute failed: org.apache.thrift.TApplicationException: ExecuteStatement failed: out of sequence response
java.sql.SQLException: org.apache.thrift.TApplicationException: ExecuteStatement failed: out of sequence response
    at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:215)
    at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:333)
    at org.knime.core.node.port.database.DatabaseReaderConnection.getDataTableSpec(DatabaseReaderConnection.java:225)
    at com.knime.bigdata.hive.node.loader.HiveLoaderNodeModel.execute(HiveLoaderNodeModel.java:199)
    at org.knime.core.node.NodeModel.executeModel(NodeModel.java:563)
    at org.knime.core.node.Node.invokeFullyNodeModelExecute(Node.java:1136)
    at org.knime.core.node.Node.execute(Node.java:932)
    at org.knime.core.node.workflow.NativeNodeContainer.performExecuteNode(NativeNodeContainer.java:554)
    at org.knime.core.node.exec.LocalNodeExecutionJob.mainExecute(LocalNodeExecutionJob.java:95)
    at org.knime.core.node.workflow.NodeExecutionJob.internalRun(NodeExecutionJob.java:179)
    at org.knime.core.node.workflow.NodeExecutionJob.run(NodeExecutionJob.java:110)
    at org.knime.core.util.ThreadUtils$RunnableWithContextImpl.runWithContext(ThreadUtils.java:328)
    at org.knime.core.util.ThreadUtils$RunnableWithContext.run(ThreadUtils.java:204)
    at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
    at java.util.concurrent.FutureTask.run(Unknown Source)
    at org.knime.core.util.ThreadPool$MyFuture.run(ThreadPool.java:123)
    at org.knime.core.util.ThreadPool$Worker.run(ThreadPool.java:246)
Caused by: org.apache.thrift.TApplicationException: ExecuteStatement failed: out of sequence response
    at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:76)
    at org.apache.hive.service.cli.thrift.TCLIService$Client.recv_ExecuteStatement(TCLIService.java:229)
    at org.apache.hive.service.cli.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:216)
    at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:209)
    ... 16 more
2015-11-17 12:58:47,538 : DEBUG : KNIME-Worker-99 : WorkflowManager : Hive Loader : 2:45 : Hive Loader 2:45 doBeforePostExecution
2015-11-17 12:58:47,538 : DEBUG : KNIME-Worker-99 : NodeContainer : Hive Loader : 2:45 : Hive Loader 2:45 has new state: POSTEXECUTE
2015-11-17 12:58:47,539 : DEBUG : KNIME-Worker-99 : WorkflowManager : Hive Loader : 2:45 : Hive Loader 2:45 doAfterExecute - failure
2015-11-17 12:58:47,539 : DEBUG : KNIME-Worker-99 : Hive Loader : Hive Loader : 2:45 : reset
2015-11-17 12:58:47,539 : DEBUG : KNIME-Worker-99 : Hive Loader : Hive Loader : 2:45 : clean output ports.

 

Thanks & Regards,

velu

The above issue resolved using flow variable ports connection from one hive loader to another hive loader. This workaround working fine with out issue.

Thanks to Jon.

Regards,

velu

Hi Velu,

I will move you topic into the big data subfolder.

Best, iris

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.