How to use wait node with S3 or HDFS

KNIME Analytics Platform
1

Hello.

I was wondering if wait node can use with S3 or HDFS.
I’d appreciate it if you could tell me how :slight_smile:

Thanks,
hhkim

2

Hi @hhkim,
You mean that the wait node waits for a file on S3 or HDFS? This is not possible (it uses certain file system functions of the operating system). But what you can do is build your own check using our S3 or HDFS connectors together with the List Files and Folders node and then run them in a loop, with a Wait node in-between so that the check is not performed in rapid succession.
Kind regards,
Alexander

1 Like
3

You could also rely on aws services for s3 updates (sns,…)
br

4

Thank you for your reply.

The idea of using Wait node in loop is very helpful to me.

Thank you so much :slight_smile:

1 Like
5

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.