pyspark.SparkContext.setJobDescription¶

SparkContext.setJobDescription(value)[source]¶

Set a human readable description of the current job.

Notes

If you run jobs in parallel, use pyspark.InheritableThread for thread local inheritance, and preventing resource leak.