apache-spark Calling scala jobs from pyspark
Introduction
This document will show you how to call Scala jobs from a pyspark application.
This approach can be useful when the Python API is missing some existing features from the Scala API or even to cope with performance issues using python.
In some use cases, using Python is inevitable e.g you are building models with scikit-learn.
