Calling API services from inside a Spark context is a bad practice One way to address this would be to have a Spark process which shuffles and divides the data itself, and as part of the enrichment ...