How does KNIME process multi files?

KNIME Analytics Platform
1

hi Gurus,
I will need to process multi files following the same work flow? How does KNIME process this mode? How does I transfer the file name variable into KNIME workflow？These static files was located in the different sub-directory and had different name.
Thanks in advance.

2

Have a look at the List Files node.

1 Like
3

Thank you for your advice.
I’ll try it asap.

4

If I process one file each time, but there are many files, how do I process them parallel use the same work flow?

5

I usually just loop so sequential. But keep in mind many nodes that can use multiple threads will use multiple threads and others that don’t or can’t are often IO bound so doing it in parallel will in many use cases not offer all that much of a benefit.

6

Thanks. I will analyze the heat-supply system data of different residential block, so the core work flow is same, but the source is different.

7

Hi @picoman,

If the “core workflow” has been designed to only work with one input file, you can also combine a List Files node with a Parallel Chunk Loop of chunk size 1.

This also sounds like a use-case where a Call Workflow (Table Based) could be useful to run the core workflow with different input data…

Best,
Stefan

3 Likes
8

Hi Stelfrich,
Thanks. I will try it asap.

9

Hi stelfrich,
I solved it by nodes: “Table Row to Variable Loop Start” and “Variable Loop END”.
Thanks.

2 Likes
10

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.