Hello and good time
I have a csv file with 100 million records
I want to read one million، one million records of the file
Thank you for your guidance through Flow variables - Limit rows
Hi @qasemiiii1400,
I think you can use the options in the CSV Reader node to limit the number of rows read at a time. There’s an option in the Limit Rows tab of the node configuration that allows you to specify the number of rows to read.
If you want to control this dynamically using a flow variable, you can configure the Flow Variables tab in the CSV Reader node. There, you can assign a flow variable to the Row Limit parameter, as shown in this screenshot.
Feel free to reach out if you have further questions!
Thanks, I did this with node variable creator
How to set the loop cycle so that the automatic work is done until the end of the csv file?
Its not completely clear what you’re trying to do. Why do you want to read groups of 1M rows? You could try the Chunk Loop Start node.
1 Like
