What would it take for me to develop a “Sticky Data” node?
What is a Sticky Data node? Great question!
A Sticky Data node is a node that holds onto its last output tables even after the node is reset. When the node is run again, the output table data is updated and the node will hold onto this new output even if it is later reset.
Why have a Sticky Data node?
My actual problem is this. I develop workflows that take a long time to run but want to see intermediate results. I also want to develop “run forever” workflows for students so they can observe real-time emerging patterns from agent-based models.
Unfortunately the KNIME charts are blank 99% of the time waiting for the upstream workflow to finish running. Then you might see a quick flash from the chart as its input data is updated. But the workflow then loops, the nodes are reset, and the chart returns to a blank state.
The ideal would be to have both Sticky Data nodes and Sticky Chart nodes. But it may be possible to just develop a single Sticky Data node that does nothing other than pass through input data and then hold onto it. A regular Chart node could then sit downstream from the Sticky Data node, and the Sticky Data node could fool the Chart node into thinking the data is always ready.
I can foresee numerous complications with such an approach, but if Sticky Data nodes are possible then this might be a elegant solution to a difficult problem.