I have a table which has 2 million rows and 110 odd columns. I just want 25 of those columns but i don’t want to write a sql query naming every single one of those 25 columns.
Since the data is big, its taking a lot of time and i can’t do column filter later on. Is there a select fields within database type facility like alteryx which can make the workflow a bit more efficient?
Just like Alteryx has In-db tools KNIME has the db nodes that will generate the SQL for you.
You’re looking for the DB Column Filter node that allows you to filter the columns before extracting data.
It also has nodes for filtering and so on.
You can read about the DB bodes here, KNIME Database Extension Guide