How to import tables directly from DB to HDFS

KNIME Analytics Platform
1

Hello, I would like to import a specific table from oracle DB to HDFS and process the data.

  1. Is DB to HDFS possible like ‘sqoop’ in Knime? Is there a node that can import tables directly from DB to HDFS?
  2. If not possible, what nodes are used to import specific tables into oracle DB → hdfs with minimal resources?

I’d appreciate your help.

2

Hi,
In which format do you want to store your tables on HDFS? You could use the Oracle Connector followed by DB Table Selector and DB Reader, then write the result e.g. with a Parquet Writer. You can instruct the writer to write to HDFS by clicking the three dots on the node and choose to add a file system input port, then prepend a HDFS Connector.
Kind regards,
Alexander

2 Likes
3

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.