• Chriss Santi - Docker and Environment setup
• Jarvin Mutatiina - PySpark

This project is water usage prediction pipeline using Apache Spark and Docker

• Apache Spark

• Hadoop HDFS

• Cassandra

• Hue

• Flask
• Html

• Local: Docker Compose (StandAlone for Hadoop and Spark)
• Cloud: Docker Swarm or Another technology: yet to be define

• First run the docker-compose file located in /docker/compose
• your app files must be located in the directory app
• build your submit image by running ./buildSubmit.sh located in /docker/scripts
• run the submit image by runnnig the script ./submitJob.sh located in /docker/scripts

Well manage the environments variables:
(docker/scripts)