pyspark.resource.ResourceProfile¶
-
class
pyspark.resource.ResourceProfile(_java_resource_profile=None, _exec_req=None, _task_req=None)[source]¶ Resource profile to associate with an RDD. A
pyspark.resource.ResourceProfileallows the user to specify executor and task requirements for an RDD that will get applied during a stage. This allows the user to change the resource requirements between stages. This is meant to be immutable so user cannot change it after building.New in version 3.1.0.
Notes
This API is evolving.
Attributes
executorResourcesidtaskResources