pyspark.SparkContext.removeJobTag¶

SparkContext.removeJobTag(tag: str) → None[source]¶

Remove a tag previously added to be assigned to all the jobs started by this thread. Noop if such a tag was not added earlier.

New in version 3.5.0.

Parameters

tagstr: The tag to be removed. Cannot contain ‘,’ (comma) character.

See also

SparkContext.addJobTag()
SparkContext.getJobTags()
SparkContext.clearJobTags()
SparkContext.cancelJobsWithTag()
SparkContext.setInterruptOnCancel()

Examples

>>> sc.addJobTag("job_to_cancel1")
>>> sc.addJobTag("job_to_cancel2")
>>> sc.getJobTags()
{'job_to_cancel1', 'job_to_cancel2'}
>>> sc.removeJobTag("job_to_cancel1")
>>> sc.getJobTags()
{'job_to_cancel2'}
>>> sc.clearJobTags()

pyspark.SparkContext.resources

pyspark.SparkContext.runJob