i am working on an assignment which i am supposed to handle missing values but i’m not sure how to put the Missing Value Node to good use. Could anyone tell me what does the previous value*, next value* in the configuration settings means? Can i also ask anyone if like know how to use the String to Number and Rule Engine node? need guidance on it
was given these instructions for my labsheet but not sure what these configure instructions means.
The previous and Next value options in the Missing Values node can be used to populate nulls with either the next or the previous value is that encountered that is not null. It basically analyses all the subsequent or previous rows one by one and stops when it finds a not null value. This is then copied to the current row.
Have a look here:
This demonstrates the previous value option.
The String to Number node is as simple as it implies. You can use it when you have values that are represented as data type string. Tip: the current data type is always indicated by a symbol. You can view this if you right click on a executed node and use the data preview option which is always at the very end of the list. Example:
With the String to Number node, you can convert them to data type Double, Integer or Long and apply some customization.