How to use the "Amazon S3 Connection (Labs)"

Hello,

I am trying to figure out how to use the “Amazon S3 Connection (Labs)” to upload CSVs to S3. But I am not able to figure our. I am able to authentication, but I am not sure what node to use to perform the actual upload.

Please advise.

Thanks.

1 Like

Figured it out. Here is that the documentation for the Excel Writer node says:

To write to other file systems, click on **...** in the bottom left corner of the node icon followed by *Add File System Connection port* . Afterwards, connect the desired file system connection node to the newly added input port. The file system connection will then be shown in the drop down menu.

1 Like

Hi @saqib,
thanks for responding to let other people know of the solution. Something I want to add: if a writer node does not provide the file system port, you can first write the file to disk and then use the File Upload node to send the file to S3, Azure Blob Storage, SSH, …
Kind regards
Alexander

1 Like

Thanks @AlexanderFillbrunn. However I am able to figure out what filepath I should use in the Excel Writer node. I tried the bucket name, fully-qualified object path, but neither of them worked.

Please advise.

Thanks.

Thanks @AlexanderFillbrunn. However I am able to figure out what filepath I should use in the Excel Writer node. I tried the bucket name, fully-qualified object path, but neither of them worked.

Please advise.

Thanks.

Hi,
how did you enter the bucket name? It should be /bucket/file.
Kind regards
Alexander

Hi @AlexanderFillbrunn, that’s the syntax i am using as well. Does the S3 User need additional permissions to access the S3 Bucket using the Knime client? This S3 User does have permissions to browse and Upload using the AWS S3 GUI.

Hi,
what is the error KNIME shows when you try to write to the bucket?
Kind regards
Alexander

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.