How can we execute HDFS commands from KNIME?

KNIME Extensions
,
1

If I need to execute HDFS commands like - hadoop -fs ls /user/rghadge/ or hadoop -fs  chmod 777 /user/rghadge/a.txt or hadoop -fs mv /user/rghadge/a.txt /user/temp/ 

How can we execute it in KNIME? Please advise. 

2

Hi,

For file listings, there is a "List Remote Files" node. Take a look at the node guide for more details:

https://www.knime.com/nodeguide/big-data/big-data-connectors/hdfs-and-file-handling-example

For changing file permissions in HDFS, there is the "HDFS File Permission" node.

Unfortunately, there is currently no node to copy or move files in remote file systems such as HDFS.

Best,
Björn

3

Ok Thanks Bjorn for the update.

4

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.