pyspark.RDD.getResourceProfile

RDD.getResourceProfile() → Optional[pyspark.resource.profile.ResourceProfile][source]

Get the pyspark.resource.ResourceProfile specified with this RDD or None if it wasn’t specified.

New in version 3.1.0.

Returns
class:pyspark.resource.ResourceProfile

The user specified profile or None if none were specified

Notes

This API is experimental