Solutions to “Just KNIME It!” Challenge 30 - Season 4

:sun_with_face: Happy Wednesday, folks! The last “Just KNIME It!” challenge of the season is out now! :sun_with_face:

Thank you so much to all who participated! And if you still haven’t experienced our weekly series of data puzzles, no problem: consider this email as a last call for the season.

:soap: After cleaning and preparing your office equipment data, it’s finally time to put it to use. The management team now wants a dashboard to explore product options, compare prices, and uncover insights from customer reviews — all in one place. :chart_with_upwards_trend: You should build a product intelligence and review analytics data app in KNIME. Starting from data on products and reviews, create an interactive experience where users can browse categories, find similar products by price and rating, visualize review trends over time, extract key phrases from customer feedback, and even map review activity by country. :bar_chart:

Here is the challenge. Let’s use this thread to post our solutions to it, which should be uploaded to your public KNIME Hub spaces with tag JKISeason4-30 .

:sos: Need help with tags? To add tag JKISeason4-30 to your workflow, go to the description panel in KNIME Analytics Platform, click the pencil to edit it, and you will see the option for adding tags right there. :blush: Let us know if you have any problems!

1 Like

Huhh, this was a big one. :smiley:

My solution:

As I do not have much time I prepared what I could (I assumed what the challange will be, sadly there were really lot of things I have prepared but I had to delete, but that’s life :slight_smile: )

So for the visualization. It has several parts, I try to logically group that:

  • Comparison of brands
    • Review score and count by brand
      • In that view I have prepared a heatmap, where we can see the brands and the count of the review of differenc scores (5,4,3,2,1). So we can see what were the distribution of the scores in one brand
    • Average price by brand
      • We can see which brands are the most expensive (in average the Duramont, the Nouhaus and DFLIVE (I would have guessed else brands…))
    • Transaction count by brand
      • In this view we can see how many transactions were there by brand in our scraped down dataset
  • Similarity analytics
    • In that view we can after selectiong a product what is the two most similar recommended product (by price and rating (normalized))
  • Geo and review analysis
    • Geo analysis
      • In the Geo analysis I put the countries to the map (colored by review count) and it has a table with the data on the map
      • There is option to filter the data put onto the map, you can select your filters on the left side, then click refresh and the whole map refreshes (it is really good in theory but it’s really slow, rendering the map) :slight_smile:
    • Review analysis
      • Review analysis is using text analysis tools to create a bigrams with the most frequented word with the selection
      • It has all the same filter capabilities than the Geo analysis
  • Trend of brands
    • In this visual and text I tried with some ML (linear regression so not a model you should throw you hat away :smiley: ) saying if the brand is going up, or down, based on month coefficient

My whole workflow (with everything from the previous two challenges in it)

My visualization component:

So that was the visualization part. Then the reporting. I sadly noticed that the filter visualizations couldn’t be put into a pdf. So I changed them to texts. I just prepared the PDF to trend analysis. As with all the filtering it would create a pdf with 867 432 pages long (all the combinations of the filters) and I didn’t feel if that is the scope for now :smiley:

Altogether I really really enjoyed this season. I think I could really sharpen my visualization skills in KNIME (with nearly all challanges), I get a grasp of network mining, deeped dive into ML models I didn’t know before. So all in all it was a really great and thank you for everyone. I really enjoy Just KNIME It! :slight_smile:

7 Likes

And I think you are already playing in a league of your own when it comes to neat and appealing data apps / reports in KNIME :grinning_face_with_smiling_eyes::+1:

6 Likes

Brilliant! Just brilliant

2 Likes

Find herewith my Submission: so the challenges re exhaustive ones at end… Ending up the season which is the 4th one consecutive with participation in more then 125 + challenges .. Every challenge and season creates more curiosity to keep pushing and need to learn more to brush up in the vast area.. Kudos to Knime team who really tries their best to bring the new flavour to the challenge and season. JKISeason4-30 – KNIME Community Hub

5 Likes

Really Awesome @berti093 .. :clap:

3 Likes

Did not have the time to run all the activities. Ran a similarity of the products so that the final recommendation presents the pareto ranked best choice and the most similar product based on the product description.

3 Likes

Greetings KNIMERs,

Here is my solution to this week’s and final challenge for Just KNIMT It Season 4.
JKISeason4-30

This challenge is bringing all topics that we have learned from each of the previous challenges in Season 4. I tried to address the objectives in this challenge and if not, it was educational and fun to at least try.

I leveraged the data preparation and transformation we had done in challenge 28 and 29 so that part of the work was straightforward to leverage in this challenge.

Building the interactive dashboard as pre-scribed in this challenge was a challenge for me and luckily I had the L4-DA Data Analytics and Visualization 03 workflow to leverage.

I was able to build the category selection where the end user can also see the product ID (or ASIN).

With the ASIN, the end user can now view similar products and can also view a line chart for product reviews over time and a tag cloud based on the reviews for the similar products.

Adding the geospatial context for the Review Country aspect of the similar products required me to think about how to integrate into the dashboard.
I initially tried downloading the spatial data but that was a massive dataset so abandoned that idea.

Luckily, KNIME provides the OSM Boundary Map node that will give you the geospatial data for a given OSM location (even country). By integrating the Table Row to Variable node I was able to link to the OSM Boundary Map node based on the selection for each product so that the geospatial data changes.

Here is also the PDF report of the dashboard based on the selections the end-users makes.
the only drawback of the PDF report is that the geospatial view is not supported.

Report_JKIChallenge30.pdf (163.0 KB)

What a great way to end the season and I learned so much from all the participants and how they solved these challenges.
Cheers, Happy Holidays and Happy New Year.

3 Likes

Thank you Martin, you are really kind. :slight_smile: But I doubt that: I saw visualizations here and in game of nodes, that motivates me to push further :smiley:

1 Like

Difficult one for me…I did not succeed with the pdf, both the tag cloud and geospatial view do not show up. You can find my workflow here. I will certainly participate again in the next season. Kudos to everyone :slight_smile: .

3 Likes

Hi all,

My solution here: JKISeason 4-30 - Turn your Office Equipment Data into an Interactive Data App – KNIME Community Hub

Nice last challenge of the season! Love it as it combines your previous work.

I haven’t had a lot of time to spend on this one - therefore, a BIG thanks to @berti093 and @AnilKS for the inspiration :slight_smile:

See you all next season!

Thanks KNIME Team, the Authors of the challenges and the Participants!

Cheers

Jerome

3 Likes

Good One Jerome (@trj ) ..your consistency & commitment truly elevated the spirit of the JKI journey.

1 Like