4.2 Update: Off-Heap Column Store activation

This enhancement caught my attention:

AP-14161: Preference Page for Off-Heap Column Store activation

Didn’t read anything else about this in the release. Is this still something “secret” or experimental? Would be interesting to know more as it would be extremely cool if KNIME stored the data in an apache arrow format so that R, Python etc. can all directly read from it without serialization.

2 Likes

:slight_smile: give us a little bit more time… but what you describe sounds somehow familiar…

4 Likes

Yeah i can imagine this is pretty complex. No worry. It’s great to know it will come at some point.

1 Like

btw I guess you’ve seen https://www.knime.com/blog/improved-performance-with-new-table-backend. This is the first iteration of many to follow of what we’re working on.

3 Likes

Indeed I did. Great news.

2 Likes

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.