How to specify filename in Spark to csv node

KNIME Extensions Big Data
1

Hi all,

In the settings, it seems that you can only set up to the folder,
but is there a way I don’t know about?

Result I expected :

image
image1886×517 117 KB

Result :

image
image1866×585 128 KB

2

Hi @jjlee,

Spark writes every partition in parallel, and creates an output directory with one file per partition.

If you have only a small amount of data:

  • You can limit the partition count on the Partitions tab in the dialog, this creates only one output file.
  • You can use the Spark to Table and CSV Writer node.

Cheers,
Sascha

1 Like