Best Practice for to read Larger Datasets in KNIME.

[mlauber71]

@kotlapullareddy you could think about doing this in chunks or with the help of streaming. Do you have any IDs that you could use to do this in steps.

Transferring data between databases – tobias.koetter

Copy data from mysql to postgresql

@mgiammarco here is an example. You would have to change the DB nodes. Your initial database is in the H2 DB with some data in: “data_insert_types”. Based on this table an empty table “data_insert_types_transfer” is being created in the Postgres DB. Then this empty table gets adapted so that it will automatically produce an additional column called “my_uuid_column” with this command: ALTER TABLE "public"."data_insert_types_transfer" ADD COLUMN my_uuid_column UUID DEFAULT (uuid_generate_v4()); …

For large file in general and resuming loops I can offer up this article:

KNIME Snippets (1): Collect and Restore — or how to handle many large files...