I have a KNIME flow that does segmentation and calculations on data from a number of retail clients. The data is uniform and the flow (which is actually 4 separate flows) works really well. The average data set is about 4 million rows per day. The problem I have is to calculate product category total per customer (about 100’000) when each client has a different product category and sub-categories.
Currently, I have Math nodes that do long addition sums to calculate the totals, but it is not sustainable. Is there possible a way for me to define which columns to SUM so that I only need to maintain a table for each client?
What I would like to do is create a table the category and sub-category columns and use the list to do the math instead of trying to maintain long sum sentences. using the list of columns I would end up with either 2 maths nodes or a column expression node
with an expression that looked something like …
column(“Chicken”)+column(“Beef”)+column(“Pork”)+column(“Lamb”)+column(“Ostrich”) …
tC/.