Zipping Knime workflow folder for bitbucket upload

[nitin15585]

Hi all,

To upload Knime workflows to Bitbucket, we need to first zip them.
This activity needs to be done on a daily basis.
So I’m thinking of developing a utility which can zip knime workflow folders on a server.
We have tried the “compress files/folders” node but that does not accept folder paths while using CUSTOM URL.
Please provide your feedback, and I would appreciate it if any working examples were available.

Thanks in advance.

Regards,
Nitin Gupta
Senior Data Specialist

[mlauber71]

@nitin15585 welcome to the KNIME forum. There is this idea to ZIP KNIME workflows. Maybe you can check that out and see if it would work for you:

Copy/Move Files Node

@zedleb I created and example where the KNIME workflow (or workflow group) is being zipped into a file with a current timestamp. And can later be restored to a (separate) folder. [image] [image] This restore can either be automated also or you could do it manually if you need it. [image] [image] Please note you will have to configure the Path variables and workflow names to your needs. I use local paths that will be created dynamically.

Some nodes are of and older version. Would have to see if they might be updated.

[bruno29a]

Hi @nitin15585 and welcome to the Knime Community.

Perhaps this should be done at the OS level instead of within Knime. I’d write a script to do this (batch script for Windows and sh script for Linux/Unix/MacOS).

Zip the workflows, upload the zip files to bitbucket. This script could even be schduled to run by itself on a daily basis.

[nitin15585]

Thanks for the quick reply. Could you please share the .knwf file if possible.

Regards,
Nitin Gupta

[nitin15585]

Thanks. Agreed, this is one possible solution. I am looking for a Linux box. If it is possible to share, then it would be a great help.

Regards,
Nitin Gupta

[mlauber71]

@nitin15585 you can find the files on the KNIME hub like mentioned in the post

create your own backup system of KNIME workflows of KNIME workflow groups –...

best to download the whole workflow group. Here it is to make the download easier (I just switched out some old nodes):

kn_example_backup_workflow.knar (317.6 KB)

[nitin15585]

Thanks for sharing. This solution works perfectly on the local machine. But I need to perform this activity on the server. I have tried that but still have no success. I will give one more attempt to do the same, or else move to a linux-based script solution.

Regards,
Nitin Gupta

[gab1one]

Hi @nitin15585,

@nitin15585

But I need to perform this activity on the server. I have tried that but still have no success.

Server executors have only limited direct access to the server repository and the local file system.

Take a look at the Workflow Reader node which allows you to read a workflow as a port object, you can then use the Workflow Writer node to create a workflow archive. Both nodes support file system connection ports, so you can read workflows from the server with the KNIME Server Connector and then write them e.g. a temporary directory. Take a look at this workflow:

Read workflow dir from server – gab1one

Note that with that method you can only read / write workflows, if your users also upload other files to the server, you need to use the Transfer Files node for these files.

best,
Gabriel