Hello. KNIME Support Team!
I am currently working with a client on a KNIME collaboration and have an issue with Pyspark.
In the previous KNIME collaboration, ML analysis was conducted using Python Script, and the Pickle file containing the information of the derived analysis model was stored in the customer’s MinIO (Object Storage) as a “Model Writer” node using the “Pickled object” port in the output port of the Python Script.
However, in the current collaboration, the same requirement is implemented in Pyspark, but the problem is that the Pyspark script can only output a table as an output port. We need to save the Pickle file derived from Pyspark to our client’s MinIO, is there any way?
I’ve been thinking about it for a long time, but I don’t have a relative situation yet, so I’m asking for your help.
We are in a hurry, so a quick response would be very much appreciated.