Created lightweight container cluster.
-Managed cluster using Kubernetes. -Created Docker images for Spark master, worker and driver. -Deployed spark components as pod controlled by Kubernetes. -Deployed Apache Spark Driver in cluster. -Dynamically scaled Workers and Cluster nodes.