Wkf executed successfully but node shut down

Hi everyone, I have a problem with a wkf, the flow seems to work correctly when launched in batch mode but when I open it the component that I saved as a template is turned off and I don’t have any error messages, can anyone help me? Some info in can the wkf uses an HDFS connection, Hive and uses Livy and also has connections to oracle and db2

Thanks
Problem_component

Hi @cridiaz -

Usually questions like this go the other way, where everything is fine except for running in batch mode :sweat_smile:

If you open up the component with everything executed upstream, what does it look like inside? Is there any visual indication of where things are getting stuck there?

2 Likes

Hi I know :slight_smile: unfortunately this is a strange case, if I open the component it has nothing executed, first I thought it was because inside I have some string configuration nodes not attached to the component port to make it configurable but unfortunately this is not the case. I would also add that this happens randomly because the wkf is launched in batch on different files. These files are the same in structure but different in content for example I have a line table=name of a table and in another file I always have table=other table.
So this sometimes happens on the first one, sometimes on the second one. As soon as I can I will post a picture inside the turned off component

This is a picture of what the component looks like inside when it doesn’t work

Hi there @cridiaz -

I was talking to @armingrudd about this earlier. Can you also take a look inside the metanodes upstream from the components? We suspect one of the DB connections is erroring out for some reason, but it’s hard to tell.

1 Like

Thanks the connection nodes are green so it seems to be gone, but do you think it is possible that the HDFS part, Livy can lose the connection even if the node then appears to be running?