In this hands-on tutorial presented at Code for San Francisco we'll look at how to use Apache Spark to analyze datasets published by the City of San Francisco, through SF Open Data.
The workshop will focus on how to use Spark SQL and DataFrames to retrieve insights and visualizations from fire service calls made to the San Francisco Fire Department on July 4th of this year. The demos and labs are targeted for an audience with some general programming or SQL query experience, but little to no experience with Spark.
We'll begin with some brief theory and lecture on Spark, before diving into several demos where we'll perform visualizations and analysis on the data.
- Sign-up for Databricks Community Edition (free)
- Download the labs
- Login to Databricks CE, and import the labs
To follow along, view the static HTML version of the material covered.
To dive deeper into Apache Spark, check out ProTech's upcoming public classes, and private training courses, delivered onsite for your team.