[Bug] Memory Use ArrayIndexOutOfBoundsException

Hi,

the Memory Use Node throws an error on my OS X machine with 16 GB of memory:

ERROR Memory Use           2:1224     Execute failed: ("ArrayIndexOutOfBoundsException"): -1

Any idea what this might cause since it’s working perfectly on another Windows machine.

Kind regards
Mike

Hi Mike,

Yes, and no. We don’t have access to a Mac to test this on unfortunately, so it was implemented based on a ‘best guess’ from online documentation.

Are you comfortable with the mac command line console?

If you are, could you run the following command in the console and paste back the output, including the column headers?

top -l 1

Better still, if you can find the process id (pid) of KNIME while it is running, then if you could try:

top -l 1 -pid followed by the process id.

[This node gets most of it’s output from the Java Virtual Machine instance, but runs a system command and parses the output in an attempt to get the memory actually used by the JVM process, rather than what the JVM thinks it is using - and this is the bit that is going wrong]

In any case, we should probably change the node to report the other values and show a warning that this method failed, as I think the output can be a bit variable from one mac to the next, possibly even between individual users on the same mac…

Thanks

Steve

Here we go

Processes: 339 total, 3 running, 336 sleeping, 2278 threads 
2019/03/27 18:48:57
Load Avg: 8.49, 3.93, 2.77 
CPU usage: 22.32% user, 11.90% sys, 65.77% idle 
SharedLibs: 237M resident, 58M data, 18M linkedit.
MemRegions: 116993 total, 6816M resident, 112M private, 978M shared.
PhysMem: 15G used (2754M wired), 1052M unused.
VM: 1573G vsize, 1297M framework vsize, 464009994(0) swapins, 471294576(0) swapouts.
Networks: packets: 13343019/13G in, 7152976/1536M out.
Disks: 26999586/2391G read, 15220326/2118G written.

PID    COMMAND %CPU TIME     #TH #WQ #PORTS MEM  PURG CMPRS PGRP  PPID STATE    BOOSTS   %CPU_ME %CPU_OTHRS UID FAULTS     COW   MSGSENT  MSGRECV SYSBSD    SYSMACH   CSW       PAGEINS IDLEW  POWER INSTRS CYCLES USER #MREGS RPRVT VPRVT VSIZE KPRVT KSHRD
25622  Knime   0.0  02:08:35 105 1   937+   15G+ 20M+ 14G+  25622 1    sleeping *1+[53+] 0.00000 0.00000    501 153266410+ 1088+ 3952176+ 820594+ 40790500+ 42607499+ 68497909+ 39646+  293089 0.0   0      0      mw   N/A    N/A   N/A   N/A   N/A   N/A

Thanks - that’s very useful.

Could I ask you to check what version of our plugins you are currently using too? (You can do this either from the Help menu, via ‘About the KNIME analytics platform’, and clicking on ‘installation details’ and looking in the plugins tab, or be browsing to the plugins directory of your knime installation) It is possible that this was fixed on the version on our current nightly build, which I will be moving to the stable builds with the other updates.

Steve

Here we go

Name Version ID Provider
Actian Dataflow 6.6.0.108 com.actian.dataflow.feature.feature.group Actian
Erlwood Knime Open Source Cheminformatics 3.3.0.v201701271222 org.erlwood.features.cheminformatics.base.feature.group Erlwood
Erlwood Knime Open Source Core 3.3.0.v201701271222 org.erlwood.features.core.base.feature.group Erlwood
KNIME Amazon Cloud Connectors 3.7.0.v201811131712 org.knime.features.cloud.aws.feature.group KNIME AG, Zurich, Switzerland
KNIME Analytics Platform 3.7.1.v201901291056 org.knime.product.desktop null
KNIME Azure Cloud Connectors 3.7.0.v201811131712 org.knime.features.cloud.azure.feature.group KNIME AG, Zurich, Switzerland
KNIME Database (Preview) 3.7.1.v201901281155 org.knime.features.database.feature.group KNIME AG, Zurich, Switzerland
KNIME Expressions 3.7.1.v201901281157 org.knime.features.expressions.feature.group KNIME AG, Zurich, Switzerland
KNIME Extension providing the Chromium Browser 70.0.3538.v201811081450 org.knime.features.ext.chromium.feature.group KNIME AG, Zurich, Switzerland
KNIME External Tool Support (Labs) 3.7.0.v201808081048 org.knime.features.exttool.feature.group KNIME AG, Zurich, Switzerland
KNIME File Handling Nodes 3.7.0.v201811132201 org.knime.features.base.filehandling.feature.group KNIME AG, Zurich, Switzerland
KNIME Git Nodes 3.7.1.v201901291057 org.knime.features.scm.git.feature.group KNIME AG, Zurich, Switzerland
KNIME HTML/PDF Writer 3.7.0.v201808081048 org.knime.features.ext.birt.feature.group KNIME AG, Zurich, Switzerland
KNIME Image Processing 1.7.0.201903130518 org.knime.knip.feature.feature.group University of Konstanz / KNIME
KNIME Indexing and Searching 3.7.0.v201808081048 org.knime.features.ext.lucene.feature.group KNIME AG, Zurich, Switzerland
KNIME JavaScript Views 3.7.1.v201901281201 org.knime.features.js.views.feature.group KNIME AG, Zurich, Switzerland
KNIME JFreeChart 3.7.0.v201808081048 org.knime.features.ext.jfreechart.feature.group KNIME AG, Zurich, Switzerland
KNIME MongoDB Integration 3.7.0.v201808081048 org.knime.features.mongodb.feature.group KNIME AG, Zurich, Switzerland
KNIME Open Street Map Integration 3.7.0.v201808281050 org.knime.features.ext.osm.feature.group KNIME AG, Zurich, Switzerland
KNIME Public Server Access 3.7.0.v201811291502 com.knime.features.enterprise.client.exampleserver.feature.group KNIME AG, Zurich, Switzerland
KNIME Report Designer 3.7.0.v201808081048 com.knime.features.reporting.designer.feature.group KNIME AG, Zurich, Switzerland
KNIME REST Client Extension 3.7.0.v201808081048 org.knime.features.rest.feature.group KNIME AG, Zurich, Switzerland
KNIME Semantic Web 3.7.0.v201808081048 org.knime.features.semanticweb.feature.group KNIME AG, Zurich, Switzerland
KNIME ServerSpace 4.8.1.v201901281201 com.knime.features.explorer.serverspace.feature.group KNIME AG, Zurich, Switzerland
KNIME SVG Support 3.7.0.v201809121043 org.knime.features.ext.svg.feature.group KNIME AG, Zurich, Switzerland
KNIME Tableau Integration - TDE Format 3.7.0.v201811291037 org.knime.features.ext.tableau.feature.group KNIME AG, Zurich, Switzerland
KNIME Textprocessing 3.7.1.v201901281201 org.knime.features.ext.textprocessing.feature.group KNIME AG, Zurich, Switzerland
KNIME Textprocessing - Deeplearning4J Integration (64bit only) 3.7.0.v201808081048 org.knime.features.ext.textprocessing.dl4j.feature.group KNIME AG, Zurich, Switzerland
KNIME Textprocessing French Language Pack 3.7.0.v201808102137 org.knime.features.ext.textprocessing.language.french.feature.group KNIME AG, Zurich, Switzerland
KNIME Textprocessing German Language Pack 3.7.0.v201808081048 org.knime.features.ext.textprocessing.language.german.feature.group KNIME Gmbh, Konstanz, Germany
KNIME Textprocessing Spanish Language Pack 3.7.0.v201810291013 org.knime.features.ext.textprocessing.language.spanish.feature.group KNIME Gmbh, Konstanz, Germany
KNIME Twitter & Google Connectors 3.7.1.v201901281201 org.knime.features.ext.socialmedia.feature.group KNIME AG, Zurich, Switzerland
KNIME Virtual Nodes 3.7.0.v201808081048 org.knime.features.virtual.feature.group KNIME AG, Zurich, Switzerland
KNIME Web Service Client 3.7.0.v201808081048 org.knime.features.ext.webservice.client.feature.group KNIME AG, Zurich, Switzerland
KNIME Webanalytics 3.7.0.v201808081048 org.knime.features.webanalytics.feature.group KNIME AG, Zurich, Switzerland
KNIME Weka Data Mining Integration (3.7) 3.7.0.v201808130847 org.knime.features.ext.weka_3.7.feature.group KNIME AG, Zurich, Switzerland
Lhasa public plugin 1.1.500.v201711091216 org.lhasalimited.knime.public.feature.feature.group Lhasa Limited (http://www.lhasalimited.org)
Palladian for KNIME 1.7.0.v201807041014 ws.palladian.nodes.feature.feature.group palladian.ws; Philipp Katz, Klemens Muthmann, David Urbansky.
Source for Lhasa public plugin 1.1.500.v201711091216 org.lhasalimited.knime.public.source.feature.feature.group Lhasa Limited (http://www.lhasalimited.org)
Vernalis KNIME Nodes 1.18.1.v201812201431 com.vernalis.knime.feature.feature.group Vernalis

Thanks - I think this was fixed in v1.18.3, which is only available on the nightly build at present. However, as I am making other changes right now, I will see if I can make it more robust too, as this is a potential danger area as we rely on the OS configuration, regional code page, and all sorts of other potential pitfalls, for that particular value.

Will let you know when the current version is updated, and will also be migrating that over to the 3.7 stable build at the same time or very shortly afterwards.

Steve

I am happy to aid you in conducting tests on OS X if you like.

Thanks! The node has now been updated on the nightly build, and will shortly be released on the 3.7 stable branch. See

for further details and announcements.

Be good to know if it is now working on Mac OS for you!

Steve

I can confirm it’s working now. Much appreciate your blazing fast and superior support! Thanks a lot Steve.

1 Like

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.