how to configure directory for pyspark

[skam]

Hello,

I need help figuring out why PySpark Script (1 to 1) is not getting directed to my python environment, and give this error, Cannot run program “no_conda_environment_selected\python.exe”: CreateProcess error=2, The system cannot find the file specified. It say python succesfully started but then i get that error when trying to run the node. The regular python script node works fine and i have pyspark added to my environment.

Thanks

[skam]

ahh nevermind. I realized i needed to add the spark python spark.pyspark.python:myenvironment directory to the local big data environment. Its working now