I would like to ask the experts out there for a best practise way on how to handle extensive workloads on the KNIME Server (Debian).
The issue is that we more and more run workflows which use the whole CPU capacity of the KNIME server. The issue I face is that as an admin I can’t control if a workflow run by a user will block the server for a long time, like a day or a week. What I have in mind is, if a workflow runs longer than a certain amount of time it will be canceled with a time up warning. Best would be to define this run time per workflow.
This problem gets even more specific if we run R code inside of the workflows, sometimes via our self designed KNIME nodes, which communicate with R via Java library (Rosuda REngine). If I cancel the workflow it looks like that the R process is still running (HTOP) until its natural end.
What we need is to immediately stop the R process if a certain time limit was reached.
I hope you have somehow solutions to these issues.
THX a lot