This is a Intellij template for developing Apache Spark 2.3.x applications.
NOTE: This repo is only for teaching purposes only :)
Requirements
Install scala and sbt (or maybe Java as well)
macOS:
brew update brew install scala brew install sbt
Ubuntu:
echo "deb https://dl.bintray.com/sbt/debian /" | sudo tee -a /etc/apt/sources.list.d/sbt.list sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv 2EE0EA64E40A89B84B2DF73499E82A75642AC823 sudo apt-get update sudo apt-get install sbt sudo apt-get install scala
In any case, please make sure you have JAVA and it is up to date:
Evaluation
You should fork this repository, commit your changes and push them into your own GitHub account.
IntelliJ IDEA
Please download the community version of IntelliJ IDEA from here: