Polars library and DuckDB in Knime

Hi!

I am currently investigating the possibilities and features offered by both

  • DuckDB: sort of sqlite for analytics (
  • polars: library written in Rust, with a python API and based on Arrow to process dataframes much faster than with pandas
    At first sight, it looks like it could be a good fit for a tighter integration in Knime. Any plans for that on Knime’s side. In the meanwhile, I will keep investigating using the new Python nodes and JDBC drivers.

I have built and example using DuckDB. Question is what would be the benefits over SQLite and H2?

1 Like