pyspark.SparkContext.setJobDescription

SparkContext.setJobDescription(value)

Set a human readable description of the current job.

New in version 2.3.0.

Parameters

valuestr

The job description to set.

Notes

If you run jobs in parallel, use pyspark.InheritableThread for thread local inheritance.