May 17, 2021 Spark Programming guide
This section of the course provides a quick introduction to using Spark, starting with Spark's interactive shell (with Python or Scala) to introduce its API. When demonstrating how to write separate programs in Java, Scala, and Python, see the full reference in the Programming Guide.
Follow this guide and first download a Spark distribution package from the Spark website. Because we don't use HDFS, you can download any Hadoop version of the package.