Amazon AWS S3 and KNIME Integration

I have an amazon AWS account created with a csv data uploaded. My objective is to create a KNIME workflow that will read data from the AWS S3 bucket.

To start with, i created a simple workflow as shown below.
1

The configurations are as below.


Could you please review my approach, given that I haven’t done this type of connection before?

  1. Am I handling it in the simplest way possible?
  2. Are there any issues with the workflow or its configurations?
  3. Based on the minimal workflow, could someone guide me on how to resolve the above?

Hi @setor

It works on my machine. To connect to a CSV Reader or List/Files Folder node, just click the 3 dots on the bottom left. A connection port will be visable .
afbeelding
gr. Hans

1 Like

Hi Hans,

I have gone through the workflow. A few observations made. See below

  1. With this option, i am able to see all my files in the bucket. Great, though it seems not secured.

  2. Using this option, test connection fails but node executes.

  3. i am unsure what values to key in here.

Summary

  1. Files are visible when Default Credential Provider Chain option is selected.
  2. With access key ID and secret key option, connection fails.

NB
I have tested my connection in the terminal and it works fine.

After exploring various workarounds, I have found these two options to be effective.

Option 1

Use of switch roles in the Amazon Authenticator

Option 2

Use of the Generic S3 Connector

Cheers, KNIMErs

2 Likes

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.