Good morning,
I am new to KNIME. I have imported an excel file with no problems and I want to normalize the predictors (n = 367) using the Normalizer node, but a warning signs appears in the node and no variables can be selected. Can you please provide some help?
Thank you,
Marc!
Hi @MarcB and welcome to the forum.
Here’s your screenshot, for the benefit of others:
My best guess is that the Normalizer node doesn’t see any numbers to work with because your columns are currently defined as strings. Can you check the configuration of your Excel Reader node, and make sure that you’re reading in the headers properly, and especially that your output fields in the preview pane are classified as numbers?
Thank you, Scott. My columns after file import with the the Excel Reader node are all defined as “S” (strings). I used the “String to Number” node to convert them to double (all but one column -that defines the class- are numbers with two decimal places, i.e. 1,68, 2,95, etc.). However, an error is produced (se attached image) and the Console seems to say that there are missing values in all columns, which is not true. Any suggestions?
Thank you,
Marc
Without seeing the data coming out of the Excel Reader node, or the configuration of the node, it’s difficult to say what’s going on.
Can you share the workflow and/or some data? Troubleshooting while blind is usually frustrating for everyone involved.
Thanks, screenshots can work, but they tend to only show what the poster thinks is important, and key troubleshooting information is usually not included. Having the knwf/knar file and data would be ideal.
For example, what does the table coming out of the Excel Reader node look like? None of the screenshots actually provide this information.
The screenshot of the configuration of your Excel Reader node is helpful, but it raises some questions. All the columns in view are either Integer or Double, but in a previous reply you said:
My columns after file import with the the Excel Reader node are all defined as “S” (strings).
None of this is really adding up. Did you make any changes after your previous reply?
Hi Elsamuel, and thanks for your interest. It seems to be solved now.
Initially, the variables were imported from excel as “S” even though the first row was marked as the row containing predictor names and all other values in cells were numbers. The use of the String to numbers to convert “S” to “D” generated an error. However, now the variables appear as “D” after the Excel Reader node and I could use the Normalize node without the need of converting the variables to “D” (see screenshots attached). I really do not know what happened, maybe my computer was too slow to incorporate the changes.
Current flow:
Dataset scaled and centered:
In any case, thanks for your help and if you need more explanations to see what happened, please let me know and I will provide the information the best I can.
Best,
Marc
Bug:
Seeing unexpected results in Normalizer node. I selected Z-Score Normalization. But after running the node I see some values are > 1… I thought the range is -1 > 0 > 1
Input file: https://drive.google.com/file/d/1XL-8IjIb5Cyf13GVafGDsPCpT4-tpmRX/view?usp=sharing
Hello @DemandEngineer,
to my understanding normalization based on z score transforms data to follow Normal (Gaussian) distribution with parameters 0 (mean) and 1 (standard deviation). Data following Normal distribution with mentioned parameters can have values under -1 and over 1. Maybe you want/need Min-Max normalization?
Br,
Ivan
Thanks for the explanation. I didn’t understand the notation. I have a lot to learn… as a marketer learning data science.
This topic was automatically closed 182 days after the last reply. New replies are no longer allowed.
