Python.exe file path recognition issue in Pyspark Scirpt

Hello. KNIME Support team and all our users!

When using Pyspark Script in KNIME Local environment, we are getting an error that the path to python.exe is not found, stopping everything in progress.

I’m asking because I’ve read a lot of forum posts and tried to solve it, but I’m not making any progress.

When I connect the “Create Local Big Data Environment” node and the Pyspark Script, I get the following statement.

Could not start Python executable at the given location (no_conda_environment_selected\python.exe): Cannot run program “no_conda_environment_selected\python.exe”: CreateProcess error=2, The specified file was not found
Please refer to the KNIME log file for more details.

Here is my process after reading several forum posts to resolve these issues.

  1. Specify the path to File → Preferences → Conda

  1. Build a new environment with Python 3.9 in File → Preferences → Python

  1. Verify the Python3 installation path and environment in the epf file with File → Export Preferences

I’ve attached a picture and path for each. I would be grateful if you could let me know if something is wrong or what the solution is.

It’s very urgent. I need your help!

Thank you.

Have you checked the log as pointed out in the error message?
What about using pyspark outside of KNIME if it’s urgent?

1 Like

The log is shown below and there are no special error messages.

I also checked that there is a Python.exe in the path of the epf file.

Currently, I can’t use KNIME’s Pyspark Script, so I’m randomly downloading Java, Hadoop, and Spark into Jupyter on my personal PC Local.

I’d be grateful for an answer.

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.