Transfer encrypted JSONL files from sFTP to Subfolders by date & topic

KNIME Analytics Platform
1

Hello,

I have a weekly file transfer from sFTP site. These files are JSONL format and are encrypted. I am trying to automate the transfer and decryption for these files at the same time.
I would like my workflow to grab last week’s files from sFTP site, decrypt them, divide them to the appropriate existing folders (by topic such as expense, customers, etc) and create subfolders by date within each folder.
I already created some processes but it is not cohesive.
I am not able to transfer the files to subfolders, I cannot decrypt them all at the same time (the loop hasn’t been working).
I also need to be able to automate and run this whole process in Knime but it gave me errors.
Can anyone help me with this?

2

Hi @spiltan,

Thank you for sharing the details of your issue. Could you please provide a sample workflow with some dummy data? This will help to understand the issue you are facing.

I would recommend the following:

  • Transfer all the files to a temporary folder in the KNIME workflow
  • Decrypt all the files in the temporary folder
  • Use a loop to move the decrypted files to their respective folders

Best,
Keerthan

2 Likes