I am currently investigating the possibilities and features offered by both
- DuckDB: sort of sqlite for analytics (
polars: library written in Rust, with a python API and based on Arrow to process dataframes much faster than with pandas
At first sight, it looks like it could be a good fit for a tighter integration in Knime. Any plans for that on Knime’s side. In the meanwhile, I will keep investigating using the new Python nodes and JDBC drivers.