Bundling Process (Python Extension) get stuck during Lockfile step

Hi all,

currently working on expanding my experimental AI extension.

After testing a new node locally tried to bundle and the bundling process gets stuck at the very beginning:

C:\Users\xxx>python "C:\Users\xxx\miniconda3\envs\knime-ext-bundling54\bin\build_python_extension.py" C:\Users\xxx\\src C:\Users\xxx\build1111
INFO:__main__:Filling template files from C:\Users\xxx\miniconda3\envs\knime-ext-bundling54\bin\templates\python-extension-plugin
and storing the resulting plugin to
C:\Users\xxx\AppData\Local\Temp\tmpt3fxndqg\org.finnovationflows.FinnovationFlows-Extension\src\main\python.
Using bundle name 'org.finnovationflows.FinnovationFlows-Extension.channel.bin'.
Using plugin template from 'C:\Users\xxx\miniconda3\envs\knime-ext-bundling54\bin\templates\conda-channel-plugin'.
Rendering plugin to 'C:\Users\xxx\AppData\Local\Temp\tmpt3fxndqg\org.finnovationflows.FinnovationFlows-Extension.channel.bin'...
Using bundle name 'org.finnovationflows.FinnovationFlows-Extension.channel.bin'.
Using fragment template from 'C:\Users\xxx\miniconda3\envs\knime-ext-bundling54\bin\templates\conda-channel-platform-fragment'.
Rendering fragment for linux-64 to 'C:\Users\xxx\AppData\Local\Temp\tmpt3fxndqg\org.finnovationflows.FinnovationFlows-Extension.channel.bin.linux.x86_64'...
Running 'conda-lock lock --micromamba --no-mamba --without-cuda --pypi_to_conda_lookup_file C:\Users\xxx\miniconda3\envs\knime-ext-bundling54\bin\pypi_mapping.yaml -f C:\xxx\src\knime_env.yml -c knime -c conda-forge -c nvidia -c defaults -p linux-64 --lockfile C:\Users\xxx\AppData\Local\Temp\tmpavdwafia\lockfile'...

I updated my knime_env.yml and changed relevant knime packages from 5.3 to 5.4:

  - knime-extension=5.4
  - knime-python-base=5.4

and added a new package:

  - pip:
      - markitdown

I did try a build with 5.4 packages but without markitdown package (other packages listed under - pip I kept) and after 1.5h it was successful.

I then tried again with the package and even after 4 hours no movement and also the temp folder that is created is empty…

Any ideas on how to make that work?
Any way to make the process more “verbose” or to generate additional logs to find out where it is stuck?

Was stuck at the same stage all day.

Just CTRL + C’ed it - here’s some more logs although that probably is just driven by the cancellation:

Traceback (most recent call last):
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\bin\build_python_extension.py", line 794, in <module>
    build_extension(
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\bin\build_python_extension.py", line 105, in build_extension
    _build_extension(
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\bin\build_python_extension.py", line 175, in _build_extension
    bundles += _create_conda_channels(render_dir_path, force, config)
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\bin\build_python_extension.py", line 450, in _create_conda_channels
    return bundler.bundle()
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\bin\bundle_channels.py", line 77, in bundle
    self._bundle_fragment(
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\bin\bundle_channels.py", line 119, in _bundle_fragment
    gather_env_specs(
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\bin\gather_env_specs.py", line 205, in gather_env_specs
    _perform_with_conda_lock(
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\bin\gather_env_specs.py", line 48, in _perform_with_conda_lock
    lockfile_dict = _run_conda_lock(env_yaml, platform, channels, lockfile)
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\bin\gather_env_specs.py", line 143, in _run_conda_lock
    run_and_capture(command)
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\bin\utils.py", line 119, in run_and_capture
    output = subprocess.run(command, capture_output=True)
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\lib\subprocess.py", line 507, in run
    stdout, stderr = process.communicate(input, timeout=timeout)
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\lib\subprocess.py", line 1134, in communicate
    stdout, stderr = self._communicate(input, endtime, timeout)
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\lib\subprocess.py", line 1524, in _communicate
    self.stdout_thread.join(self._remaining_time(endtime))
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\lib\threading.py", line 1060, in join
    self._wait_for_tstate_lock()
  File "C:\xxxminiconda3\envs\knime-ext-bundling54\lib\threading.py", line 1080, in _wait_for_tstate_lock
    if lock.acquire(block, timeout):

up

Any thoughts anyone?