Thank you very much for your help!
Here I’m using the column expressions, I choose the function “equals” , and I it seems not the right one :
what do you think ?.
Br.
Thank you very much for your help!
Here I’m using the column expressions, I choose the function “equals” , and I it seems not the right one :
what do you think ?.
Br.
You can use column(0) which is the first column and column(1) which is the second column and calculate difference with minus operator.
that’s what I have tried too but the expressions seems not the right one !!!
:’(
And how the names of columns will changes for each iteration with loop ( Row0,Row1,Row3,…) even I’m not using in this node the flow variable ?!!
@ipazin , Please help : (
Br.
As I said you should use column(0) and column(1)…
Ivan
heey @ipazin,
I could solve the probleme thank you !
now I have a problème in the Loop End, and the error is the console is :
may be the probleme is in the second rule Engine node that I configurate in that way :
thank you .
BR.
Have you used column filter node to leave only column result?
This error means you have different column types in different iterations…
Ivan
ooh yes sorry I forget it !!
In fact The loop End stop in the seconde iteration, and the error now is :
is that du to the seconde Role Engine Node because I have not configurate the flow variable in it , how to do that ?
Thank you VERY MUCH !
This error means you have different column types in different iterations…
Go iteration by iteration and see what is result from first iteration and what from second one.
Don’t think so it is due to second Rule engine.
Ivan
Hi @ipazin,
Thank you very much for your help.and i’m very grateful for you !
In fact ,In the beginning I had 996233 rows , with transpose node the loop have to treat then 996233 column to get if there a repeated value. And that taked a lot of time (more than 2 days).
Is there any Solution for make that more fast, because I have to work a lot with this workflow ! and present the result in a report data.
Thank you again.
Bests Regards
I wish you a very good day !
Hi @TIZIZ!
You are welcome I’m glad you made it.
Some of these operations do last a bit longer. Not sure there is a faster way but more then two days is a bit long! Can you share a workflow for me to check? How many column do you have?
For execution time you have Timer Info node which will give you execution for each node so you will see node execution time so you can optimize.
Br,
Ivan
Hii !
My data are Confidentiel !.
Thank you !
Br.
Hi!
Then don’t give me your data. Just export workflow and I will add some random data to it. Here is how to export workflow:
https://www.knime.com/knime-introductory-course/chapter1/import-export-workflows
How many column you have?
Br,
Ivan
Ok !
I have 99623 Column.
this a link to get my workflow !
https://framadrop.org/r/8S2vnsCQEl#9vz6JsZ1H6wlrJHhLaeTLvOfaPpROkUCWFKdmZlH0cw=
Please Tell me when you download it !
Thank youu !
I mean how many columns the original table has? It has 996233 rows and columns?
There is no more workflow…
Ivan
https://framadrop.org/r/XtEk-jzaAZ#0ql6U02dRDdap+HaAXLzTa7Zt0r/bfJzbk11VzbVkiM=
here is the right link
Yes I have 99623 column and 231 rows after the transpose node.
Br.
Hi!
I got it. Still don’t understand why it takes so much time. I tried with 1000 rows and 30 columns and it was around 2 minutes so not sure. Which part takes the longest? Use Timer Info node
Couple of observations:
Br,
Ivan
Hii !
1 - in the Missing value node I do that !
, that’s mean remove row were the value is missing not ?!Br.
Br,
Ivan
1-Yes I have only strings.
3- I should wait that the loop finish his execution to link the appender culomn with the timer info node ?!
here I wait the end of the execution( but It take a lot of time to finish the 99623 column :(.)
I try to link it to the timer info node and does not work !
I exécute it without link it and it this is the result :
PS : probabely I will separat data and concatenate it after ( that will be make it faster or not ?!)
1 - then you can do it on default tab for every string data type remove row if missing. Otherwise you have to use flow variable which is ok as well if you wish.
not sure about separating and then concatenating to be faster. You can try it.
Here is a blog about optimazing knime workflow. Maybe you can find something.
https://www.knime.com/blog/optimizing-knime-workflows-for-performance
Br,
Ivan