Error during installation from local update site - bundling finished with success

MartinDDDD · November 5, 2024, 3:36pm

Hi all,

just added to my extension and managed to bundle successfully.

However when I then try to install from local update site I get this error:

An error occurred while installing the items
session context was:(profile=KNIMEProfile, phase=org.eclipse.equinox.internal.p2.engine.phases.Install, operand=null --> [R]org.finnovationflows.FinnovationFlows-Extension.channel.bin.win32.x86_64 0.2.0.202411051438, action=org.knime.product.p2.actions.ShellExec).
ShellExec command exited non-zero exit value:

Here’s image of terminal after bundling ran:

I already did re-bundle and repeated the process - also checked knime.log, but it does not seem to contain anything other than maybe this:

2024-11-05 16:15:44,350 : ERROR : Clear OSGi configuration :  : InvokeInstallSiteAction :  :  : Could not clean OSGi configuration area: C:\Users\marti\OneDrive\Desktop\knime_5.3.1\knime_5.3.1\configuration\org.eclipse.osgi\296\0\.cp\os\win32\x86_64\localfile_1_0_0.dll

Also tried to install the previous version again with similar outcome…

I also just downloaded a fresh 5.3.2 zipped version, installed relevant python extensions and tried again with the same result…

Any clue what can be causing this or what to do to further investigate?

I have for now published the bundled version on github here:

Maybe someone can try and install to see if it is an issue with my system or a general issue?

Nodes that should be available after installation:

Vision Model Promter
Schema Generator
Structured Output Prompter
Agent Web Search Tool (new)

Current version - pre updates - lives here:

ricciV1 · November 6, 2024, 8:14am

Hey @MartinDDDD,

as per your request
I tried to install your extension mentioned here (build_3).
Upon successful installation I get the following error:

ERROR PurePythonNodeSetFactory            Failed to parse Python node extension at path 'C:\Users\username\AppData\Local\Programs\KNIME\plugins\org.finnovationflows.FinnovationFlows-Extension_0.2.0.202411051438\src\main\python'. An exception was raised by the Python Proxy. Return Message: Traceback (most recent call last):
  File "C:\Users\username\AppData\Local\Programs\KNIME\bundling\envs\org_finnovationflows_FinnovationFlows-Extension\Lib\site-packages\py4j\clientserver.py", line 617, in _call_proxy
    return_value = getattr(self.pool[obj_id], method)(*params)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\username\AppData\Local\Programs\KNIME\plugins\org.knime.python3.nodes_5.3.2.v202409031144\src\main\python\_node_backend_launcher.py", line 1249, in loadExtension
    raise RuntimeError(
RuntimeError: Failed to load extension org.finnovationflows.FinnovationFlows-Extension from finnovationflows with error: Traceback (most recent call last):
  File "C:\Users\username\AppData\Local\Programs\KNIME\plugins\org.knime.python3.nodes_5.3.2.v202409031144\src\main\python\_node_backend_launcher.py", line 1244, in loadExtension
    importlib.import_module(extension_module)
ImportError: cannot import name 'category' from 'utils.category' (C:\Users\username\AppData\Local\Programs\KNIME\plugins\org.finnovationflows.FinnovationFlows-Extension_0.2.0.202411051438\src\main\python\utils\category.py)
ERROR PurePythonNodeSetFactory            Failed to parse Python node extension at path 'C:\Users\username\AppData\Local\Programs\KNIME\plugins\org.finnovationflows.FinnovationFlows-Extension_0.2.0.202411051438\src\main\python'. An exception was raised by the Python Proxy. Return Message: Traceback (most recent call last):
  File "C:\Users\username\AppData\Local\Programs\KNIME\bundling\envs\org_finnovationflows_FinnovationFlows-Extension\Lib\site-packages\py4j\clientserver.py", line 617, in _call_proxy
    return_value = getattr(self.pool[obj_id], method)(*params)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\username\AppData\Local\Programs\KNIME\plugins\org.knime.python3.nodes_5.3.2.v202409031144\src\main\python\_node_backend_launcher.py", line 1249, in loadExtension
    raise RuntimeError(
RuntimeError: Failed to load extension org.finnovationflows.FinnovationFlows-Extension from finnovationflows with error: Traceback (most recent call last):
  File "C:\Users\username\AppData\Local\Programs\KNIME\plugins\org.knime.python3.nodes_5.3.2.v202409031144\src\main\python\_node_backend_launcher.py", line 1244, in loadExtension
    importlib.import_module(extension_module)
ImportError: cannot import name 'category' from 'utils.category' (C:\Users\username\AppData\Local\Programs\KNIME\plugins\org.finnovationflows.FinnovationFlows-Extension_0.2.0.202411051438\src\main\python\utils\category.py)
ERROR PurePythonNodeSetFactory            Failed to parse Python node extension at path 'C:\Users\username\AppData\Local\Programs\KNIME\plugins\org.finnovationflows.FinnovationFlows-Extension_0.2.0.202411051438\src\main\python'. An exception was raised by the Python Proxy. Return Message: Traceback (most recent call last):
  File "C:\Users\username\AppData\Local\Programs\KNIME\bundling\envs\org_finnovationflows_FinnovationFlows-Extension\Lib\site-packages\py4j\clientserver.py", line 617, in _call_proxy
    return_value = getattr(self.pool[obj_id], method)(*params)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\username\AppData\Local\Programs\KNIME\plugins\org.knime.python3.nodes_5.3.2.v202409031144\src\main\python\_node_backend_launcher.py", line 1249, in loadExtension
    raise RuntimeError(
RuntimeError: Failed to load extension org.finnovationflows.FinnovationFlows-Extension from finnovationflows with error: Traceback (most recent call last):
  File "C:\Users\username\AppData\Local\Programs\KNIME\plugins\org.knime.python3.nodes_5.3.2.v202409031144\src\main\python\_node_backend_launcher.py", line 1244, in loadExtension
    importlib.import_module(extension_module)
ImportError: cannot import name 'category' from 'utils.category' (C:\Users\username\AppData\Local\Programs\KNIME\plugins\org.finnovationflows.FinnovationFlows-Extension_0.2.0.202411051438\src\main\python\utils\category.py)

It seems to be an issue with your category.py or the reference to it.

Hope that helped - let me know if I can do more to help

EDIT
Your pre-update version looks fine after installing.

Both were installed with the following KAP version:
KNIME Analytics Platform v5.3.2.v202409051351

BR Ricci

MartinDDDD · November 6, 2024, 8:27am

Thanks a lot! At least you can install it :D.

Checked the category error and indeed in the new node I made that wrong import… not sure why this was working during dev w/o errors…

Will try to rebuild and see if that changes anything.

MartinDDDD · November 6, 2024, 9:37am

ok a bit lost here…

I tried the following additional things:

fixed an error that @ricciV1 made me aware of above
deleted knime-ext-bundling env and re-created it
installed KNIME fresh from installer
delete Java 23
Created a new workspace and tried it with different knime installs (zipped, installer all v5.3.2)
re-bundled multiple times…

And still getting that same error when trying to install from local update site.

Given that @ricciV1 was able to install the new as well as the old version it is clear that something is wrong on my end, but I am really running out of ideas on where to look…

Have update the repo “build_3” above with a fixed version.

Any additional ideas are welcome!

Update: Now getting a new error…

An error occurred while installing the items
session context was:(profile=KNIMEProfile, phase=org.eclipse.equinox.internal.p2.engine.phases.Install, operand=null --> [R]org.finnovationflows.FinnovationFlows-Extension.channel.bin.win32.x86_64 0.2.0.202411061018, action=org.knime.product.p2.actions.ShellExec).
ShellExec command exited non-zero exit value:
Installation of the Python extension failed: 
See the files "C:\Users\marti\Downloads\000 KNIME Installs\KNIME532_installer\plugins\org.finnovationflows.FinnovationFlows-Extension.channel.bin.win32.x86_64_0.2.0.202411061018\bin\create_env.out" and "C:\Users\marti\Downloads\000 KNIME Installs\KNIME532_installer\plugins\org.finnovationflows.FinnovationFlows-Extension.channel.bin.win32.x86_64_0.2.0.202411061018\bin\create_env.err" for details. 
Please refer to the documentation at https://docs.knime.com/latest/pure_python_node_extensions_guide/index.html#installation_troubleshooting.

Here are the referenced files:

create_env.out (110 Bytes)
create_env.err (246 Bytes)

Error in the file:

critical libmamba Could not set URL (code: 3 - url = file://C:/Users/marti/Downloads/000 KNIME Installs/KNIME532_installer/plugins/org.finnovationflows.FinnovationFlows-Extension.channel.bin.win32.x86_64_0.2.0.202411061018/bin/yourrepourl/conda)

ricciV1 · November 6, 2024, 12:56pm

Hey @MartinDDDD,

funny enough, I was able to install your updated build_3!

I can see it in my node repository.

BUT…
Your Vision Model Prompter and Structured Output Prompter seem to be having a problem.

Please find the console output attached since the error message in full is too long.

model_prompter.txt (19.8 KB)
output_prompter.txt (19.8 KB)

Note: I did not read any description of how to use your nodes - so it may be an config issue - on the other hand, an issue like this should not occur even when it is not configured

MartinDDDD · November 7, 2024, 8:12am

Thanks for trying again and pointing those issues out.

There’s a reason why this extension lives in a public repo and is not (yet) a community extension - haven’t gotten to ironing out issues related to unconnected tables etc. Especially Schema Generator needs a specific input table format to work - anyways… different topic for a different time :-).

I upgrade to 5.3.3 this morning and tried again - also moved my KAP installations to a folder with less lengthy paths at I had the feeling this might be an issue.

Errors have changed:

An error occurred while installing the items
session context was:(profile=KNIMEProfile, phase=org.eclipse.equinox.internal.p2.engine.phases.Install, operand=null --> [R]org.finnovationflows.FinnovationFlows-Extension.channel.bin.win32.x86_64 0.2.0.202411060916, action=org.knime.product.p2.actions.ShellExec).
ShellExec command exited non-zero exit value:
Installation of the Python extension failed: 
critical libmamba Download error (37) Couldn't read a file:// file [file://C:/K/KAP533/plugins/org.finnovationflows.FinnovationFlows-Extension.channel.bin.win32.x86_64_0.2.0.202411060916/bin/yourrepourl/conda/win-64/ca-certificates-2024.8.30-h56e8100_0.conda]
error    libmamba Removing failed, error: remove_all: Der Prozess kann nicht auf die Datei zugreifen, da sie von einem anderen Prozess verwendet wird.: "C:\K\KAP533\bundling\root\pkgs\nomkl-1.0-h5ca1d4c_0"
See the files "C:\K\KAP533\plugins\org.finnovationflows.FinnovationFlows-Extension.channel.bin.win32.x86_64_0.2.0.202411060916\bin\create_env.out" and "C:\K\KAP533\plugins\org.finnovationflows.FinnovationFlows-Extension.channel.bin.win32.x86_64_0.2.0.202411060916\bin\create_env.err" for details. 
Please refer to the documentation at https://docs.knime.com/latest/pure_python_node_extensions_guide/index.html#installation_troubleshooting.

Here are the .out files:

create_env.err (2.4 KB)
create_env.out (53.4 KB)

MartinDDDD · November 16, 2024, 6:49pm

Update: I found the issue.

In a different forum post I helped a user to understand how to do an offline installation, which requires setting KNIME_PYTHON_PACKAGE_REPO_URL as environment variable containing the path to a local folder that contains all packages for a certain installation as described in detail here:

I must have either intentionally or unintentionally at the time have set this variable to “yourrepourl” in my environment and it looks like in all these past attempts to install my extension, KNIME tried it as an offline extension.

After removing this environment variable (I did it on windows like this):

 
Press Win + Pause/Break or search for "Environment Variables" in the Start menu.
Click on Advanced System Settings > Environment Variables.
Check both User variables for [Your Username] and System variables for KNIME_PYTHON_PACKAGE_REPO_URL.
If the variable is listed:
Select it and click Delete.
Confirm the deletion and click OK.

I was now able to install it again. Talking about shooting myself in the foot

system · November 23, 2024, 6:50pm

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.