Splitting Rows into Several CSV Files

KNIME Analytics Platform
1

I am using KNIME 5.5 and want to split 10 000 rows into seven CSV files with balanced sizes. I have spent several hours searching for a solution but have not found a correct approach. Please help

2

spent several hours searching for a solution

I heavily doubt that…

if this is a completely static environment, simply use 6 partitioning nodes and write to csv (using 1/7, 1/6, 1/5, 1/4, 1/3, 1/2 percentages).

or use a chunk loop and determine your chunk size using the table dimensions

4

Hi,

I’m still unable to figure it out, so I’ve attached a sample of the workflow to provide a clearer understanding of my issue. I’m new to KNIME and would really appreciate any guidance from the experts here. The dataset contains 500 records, and I need to split it into groups of 100 records each, resulting in five separate CSV files.

Split Data.knwf (95.5 KB)

sample_500_records.csv (23.5 KB)

5

Try this. It uses loop iteration number to name consecutive csv files.

workflow
workflow1089Ă—467 38 KB

1 Like
6

Hi Rfeigel

The workflow partially works for me, the records are correctly arranged in sequence, Thank you very much…

But I still need to rename the output files manually. Could you please advise if there’s any adjustment required in the CSV Writer node to automate the file naming process? I’ve attached a screenshot for your reference.

Split Data_OutputProblem.knwf (167.1 KB)

image
image1599Ă—864 130 KB

image
image1048Ă—504 49.9 KB

7

Hi guys,

Chunk loop node will solve the problem because the node can use a number of rows OR a percent/group limits. So you can set how you can work throw.

Inside the loop, you can create as the print before, a name for the files usim expression column node to create it and use a current interetion to build a index process for the name as exemplo_1, example_2….

Don’t forget to use the string to path node to use it as a workflow variable to apply to csv writer.

Seeya, Denis

1 Like
8

Hi all,

Could someone kindly provide step-by-step instructions on how to accomplish this?

9

Try this. You can use the String Manipulation node to create any file name you want,

workflow
workflow1721Ă—484 65.8 KB

Files
Files1083Ă—284 78.7 KB

10

Could you please share the settings required for the String Manipulation node? I’m new to KNIME and would appreciate your guidance.

11

Open the node and look at the settings. That’s all you need.

12

Hi,

have you heared about the “Free self-paced courses” KNIME offers? I think it’s a good start to get familiar with KNIME:
L1-AP Data Literacy with KNIME - Basics

1 Like
13

Did my second workflow meet your needs? If so, please mark solved. If not please elaborate.

1 Like