Is there a possibility to record the execution time and the data load(in MB/KB) for each node when executing?
My intention is to do a quality check before publishing in to prod in analyzing bad workflows that use incorrect or long running queries.
and welcome to KNIME Community!
Timer Info node might be helpful to you. Additionally have a look at this topic and follow furher links:
I’d like to create a workflow where all the failed process node will be written and save it as a error log file. For instance, if there is an error during the implementation or half way execution, it will generate a error log file. Else, continue the process till the end.
I’m new to Knime, hope to get some guidance on this.
In case of any specific questions feel free to ask more.
Thank you Ivan ! this would help to an great extent!
How is quality check(
automated if possible) done in Knime before they are deployed in to production - is there any documentation around this ?
Quality checks would involve the DB query validations/connection parameteres , Username validations, output source , etc. Quality checks would vary based on the domain as well.
Related to recording the Time-Stamps of node execution, you can start by checking the component “Record Component Time” created by @takbb in the linked post. This customized component can save some time and workarounds for you:
@Anoshpananda, sorry my bad and thanks for the clarification. I cannot think of any “automatic” solutions, and the only solutions I can think of are ultimately variations on what @gonhaddock has said as I don’t think there is going to be any automatic mechanism for this.
Whatever you do will almost certainly involve inserting additional nodes or components into your workflow at the points you wish to monitor.
I have decided to try approaching this from the point of view of creating a com…
This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.