timeout error in knime batch execution

cf_123 · January 9, 2024, 7:34am

I’m running my knime WF in batch mode. Everything works well, beside outputting a reporting node.
There are no errors if I run this WF interactively.

WF snipped which fails to execute in batch mode.

Any hints how to fix this timeout error?

batch execution log:
WARN main BufferedDataTable Table spec file is 11 MB large - this may result in increased memory consumption (path ‘C:\Temp\BatchExecutorInput18379\Teamcenter_WF_Dashboard_batch\Metanode (#154)\Cell Splitter (#144)\port_1\spec.xml’)
WARN main Node No grouping column included. Aggregate complete table.
WARN main Node No path variables selected.
WARN main Node No such variable “Path_location” of type STRING
WARN main Node Errors loading flow variables into node : Errors overwriting node settings with flow variables: Unknown variable “Path”
WARN main Node No grouping column included. Aggregate complete table.
WARN main Node Errors loading flow variables into node : Errors overwriting node settings with flow variables: Unknown variable “Path”
WARN KNIME-Worker-0-List Files/Folders 3:359 Node No grouping column included. Aggregate complete table.
WARN KNIME-Worker-0-List Files/Folders 3:359 Node No path variables selected.
WARN KNIME-Worker-0-List Files/Folders 3:359 Node No such variable “Path_location” of type STRING
WARN KNIME-Worker-3-Path to String 3:360 Node No grouping column included. Aggregate complete table.
WARN KNIME-Worker-2-Path to String 3:394:387 Node No grouping column included. Aggregate complete table.
WARN KNIME-Worker-0-String to Date&Time 3:394:391 Node No grouping column included. Aggregate complete table.
WARN KNIME-Worker-4-String to Date&Time 3:366 Node No grouping column included. Aggregate complete table.
WARN KNIME-Worker-3-Table Row to Variable 3:361 Node The node configuration changed and the table spec will be recalculated during execution.
WARN KNIME-Worker-0-String Manipulation 3:172 ColumnCalculator Row “Row3404” contains missing value in column “User Id” - returning missing (omitting further warnings)
WARN KNIME-Worker-3-String Manipulation 3:194 ColumnCalculator Row “Row6” contains missing value in column “EMail Address” - returning missing (omitting further warnings)
WARN KNIME-Worker-4-CSV Reader 3:17 Node Errors loading flow variables into node : Errors overwriting node settings with flow variables: Unknown variable “Path_location_location”
WARN KNIME-Worker-0-String Manipulation 3:27:25 ColumnCalculator Row “Row446” contains missing value in column “Process Stage List” - returning missing (omitting further warnings)
WARN KNIME-Worker-6-String Manipulation 3:154:132 ColumnCalculator Row “Row0” contains missing value in column “COSolutionItems” - returning missing (omitting further warnings)
WARN KNIME-Worker-2-String Manipulation 3:154:133 ColumnCalculator Row “Row0” contains missing value in column “CRImplementedBy” - returning missing (omitting further warnings)
WARN KNIME-Worker-6-Cell Splitter 3:154:139 Node No aggregation column defined
WARN KNIME-Worker-6-Cell Splitter 3:154:139 Node No aggregation column defined
WARN KNIME-Worker-7-Unpivot 3:154:140 Node No aggregation column defined
WARN KNIME-Worker-7-Unpivot 3:154:140 Node No aggregation column defined
WARN KNIME-Worker-4-GroupBy 3:154:143 Node No aggregation column defined
WARN KNIME-Worker-4-GroupBy 3:154:143 Node No aggregation column defined
WARN KNIME-Worker-4-Row Filter 3:177 Node No aggregation column defined
WARN KNIME-Worker-2-Row Filter 3:176 Node No aggregation column defined
WARN KNIME-Worker-1-Cell Splitter 3:154:144 Node 1 invalid aggregation column(s) found.
WARN KNIME-Worker-1-Cell Splitter 3:154:144 Node No aggregation column defined
WARN KNIME-Worker-1-Cell Splitter 3:154:144 Node No aggregation column defined
WARN KNIME-Worker-7-Concatenate 3:154:160 Node 1 invalid aggregation column(s) found.
WARN KNIME-Worker-0-Row Filter 3:186 Node No aggregation column defined
WARN KNIME-Worker-4-Row Filter 3:185 Node No aggregation column defined
ERROR KNIME-Worker-2-Component Output 3:378:0:369 ReportPortObject java.util.concurrent.TimeoutException: Executing script failed with timeout. The script is: ‘return (document.readyState == ‘complete’);’
ERROR KNIME-Worker-2-Component Output 3:378:0:369 ReportPortObject java.util.concurrent.TimeoutException: Executing script failed with timeout. The script is: ‘return (document.readyState == ‘complete’);’

hotzm · January 11, 2024, 4:45pm

Hi @cf_123,

the Report PDF Writer has a timeout setting under advanced settings. Have you tried increasing it?

cf_123 · January 12, 2024, 3:09pm

This doesn’t seem to help.
I’ve increased the default timeout value. If I run the script now, the error is thrown after approx 1min script execution. This is way before report timeout value of 30min is reached

tymsk3891 · March 12, 2024, 2:46pm

@cf_123 @hotzm

Hello,
This error is caused by the component’s output port being inactive. The state of the workflow after the batch mode is finished is as shown in the capture. If this workflow is reset and executed, it will work correctly. This may be a problem specific to batch mode. I hope this will be fixed in the future!

DanielBog · March 12, 2024, 3:43pm

Hey @tymsk3891,

we have identified some issues with batch executor on windows.
We are currently looking into possible solutions and will release it as soon as possible.

There is a vm parameter that you can try to set that is supposed to fix the problem
-Dchromium.multi_threaded_message_loop=true
This is not yet the final solution, but might help you if you are blocked by this issue.

Greetings,
Daniel

cf_123 · March 13, 2024, 9:43am

Hi @DanielBog
I tried to add your preference to knime.ini which resulted in a corrupt and broken knime GUI. This did at least not work for knime GUI

I then added this to my argument list for knime batch powershell script

$knimepath=“C:\Program Files\KNIME\knime.exe”

$ArgumentList=(“-Dchromium.multi_threaded_message_loop=true -consoleLog -reset -noexit -nosplash -application org.knime.product.KNIME_BATCH_APPLICATION -workflowFile=” + $workflow)

write-host (“Starting knime background process, please wait…”)
Start-Process $knimepath -ArgumentList $ArgumentList -wait

This resulted in an immediate knime error during script execution:

Where do I need to add this preference ?

Regards
Claus

DanielBog · March 13, 2024, 10:00am

Hey @cf_123,

yes this will most likely not work for the gui. For the batch executor you have to set it as a vm- argument rather than a normal argument. Should work with -vmargs ...

better set the vmargs in the knime.ini, as otherwise they will overwrite the knime.ini vmargs which can cause other problems.

Hope this helps.

Greetings,
Daniel

tymsk3891 · March 16, 2024, 3:16pm

Hi @DanielBog

It works when I try it. Thank you for the advice!

Regards,
tymsk3891

system · March 23, 2024, 3:17pm

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.