Spark SQL meets Hive SQL

This workflow builds a line plot of the age distribution for men and women in Maine (US) over the last 5 years. In particular, women's data is processed via Hive SQL, and men's data via Spark SQL. Will they blend? The whole data set is initially read from a Hadoop Hive installation. .... and yes, Spark SQL and Hive SQL do blend!


This is a companion discussion topic for the original entry at https://kni.me/w/uqIcFkCqZBungEaC