Micrrcosoft Access Connector doesn't stop loading

[mlauber71]

@rastasanu

Seeing that with Access the loading time takes forever I will follow your suggestion to store the data in a Parquet.

Parquet is very useful. It doe a good job at compressing data and you can also use it with chunks to handle separately and they will then form a single file.

knime assign failed, request status: data overflow incoming data too big

@RVC2023 one way to get data from and to R is to use Parquet files. You can use them in one go or you can use chunks which is especially useful if you have large data. [image] The large file can be split into smaller parts. If they have the same structure you could also write them in a loop and later import them back as one file: [image]

More on handling large large datasets you can find here:

KNIME Snippets (1): Collect and Restore — or how to handle many large files...