|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
Object org.apache.spark.scheduler.StageInfo
public class StageInfo
:: DeveloperApi :: Stores information about a stage to pass from the scheduler to SparkListeners.
Constructor Summary | |
---|---|
StageInfo(int stageId,
int attemptId,
String name,
int numTasks,
scala.collection.Seq<RDDInfo> rddInfos,
scala.collection.Seq<Object> parentIds,
String details)
|
Method Summary | |
---|---|
scala.collection.mutable.HashMap<Object,AccumulableInfo> |
accumulables()
Terminal values of accumulables updated during this stage. |
int |
attemptId()
|
scala.Option<Object> |
completionTime()
Time when all tasks in the stage completed or when the stage was cancelled. |
String |
details()
|
scala.Option<String> |
failureReason()
If the stage failed, the reason why. |
static StageInfo |
fromStage(org.apache.spark.scheduler.Stage stage,
scala.Option<Object> numTasks)
Construct a StageInfo from a Stage. |
String |
name()
|
int |
numTasks()
|
scala.collection.Seq<Object> |
parentIds()
|
scala.collection.Seq<RDDInfo> |
rddInfos()
|
void |
stageFailed(String reason)
|
int |
stageId()
|
scala.Option<Object> |
submissionTime()
When this stage was submitted from the DAGScheduler to a TaskScheduler. |
Methods inherited from class Object |
---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public StageInfo(int stageId, int attemptId, String name, int numTasks, scala.collection.Seq<RDDInfo> rddInfos, scala.collection.Seq<Object> parentIds, String details)
Method Detail |
---|
public static StageInfo fromStage(org.apache.spark.scheduler.Stage stage, scala.Option<Object> numTasks)
Each Stage is associated with one or many RDDs, with the boundary of a Stage marked by shuffle dependencies. Therefore, all ancestor RDDs related to this Stage's RDD through a sequence of narrow dependencies should also be associated with this Stage.
stage
- (undocumented)numTasks
- (undocumented)
public int stageId()
public int attemptId()
public String name()
public int numTasks()
public scala.collection.Seq<RDDInfo> rddInfos()
public scala.collection.Seq<Object> parentIds()
public String details()
public scala.Option<Object> submissionTime()
public scala.Option<Object> completionTime()
public scala.Option<String> failureReason()
public scala.collection.mutable.HashMap<Object,AccumulableInfo> accumulables()
public void stageFailed(String reason)
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |