Running Keras-Tensorflow Deep Learning (TFoS) on Hadoop Distributions (CDH)

KNIME Extensions
1

Hi,
I successfully managed to test and setup TensorflowOnSpark on our Cloudera environment. Following these links:
TFoS Yarn Setup
Resolved Issues

I now want to design and push all our deep learning jobs onto our Cloudera infrastructure. I did not find any Spark deep learning nodes. But I did find Spark and Deep Learning Network nodes, Is there a way to combine these two types and make a example for TensorflowOnSpark ?

For example: Is there a way to run “Train_MNIST_Classifier” example, available in the KNIME example server to run on Hadoop.

Any help appreciated. Thanks !

2

Hi mohammedayub,

There is no way I could think of to combine those nodes, unfortunately.
Nonetheless, we’re definitely interested in supporting deep learning in a distributed setup in the future, I can’t make any promises, though.

Marcel

3

Thanks Marcel. Looking forward to the updates from your team. We can definitely pilot test some of that work on our CDH clusters.

4

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.