|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
Object org.apache.spark.JavaSparkListener
public class JavaSparkListener
Java clients should extend this class instead of implementing SparkListener directly. This is to prevent java clients from breaking when new events are added to the SparkListener trait. This is a concrete class instead of abstract to enforce new events get added to both the SparkListener and this adapter in lockstep.
Constructor Summary | |
---|---|
JavaSparkListener()
|
Method Summary | |
---|---|
void |
onApplicationEnd(SparkListenerApplicationEnd applicationEnd)
Called when the application ends |
void |
onApplicationStart(SparkListenerApplicationStart applicationStart)
Called when the application starts |
void |
onBlockManagerAdded(SparkListenerBlockManagerAdded blockManagerAdded)
Called when a new block manager has joined |
void |
onBlockManagerRemoved(SparkListenerBlockManagerRemoved blockManagerRemoved)
Called when an existing block manager has been removed |
void |
onEnvironmentUpdate(SparkListenerEnvironmentUpdate environmentUpdate)
Called when environment properties have been updated |
void |
onExecutorAdded(SparkListenerExecutorAdded executorAdded)
Called when the driver registers a new executor. |
void |
onExecutorMetricsUpdate(SparkListenerExecutorMetricsUpdate executorMetricsUpdate)
Called when the driver receives task metrics from an executor in a heartbeat. |
void |
onExecutorRemoved(SparkListenerExecutorRemoved executorRemoved)
Called when the driver removes an executor. |
void |
onJobEnd(SparkListenerJobEnd jobEnd)
Called when a job ends |
void |
onJobStart(SparkListenerJobStart jobStart)
Called when a job starts |
void |
onStageCompleted(SparkListenerStageCompleted stageCompleted)
Called when a stage completes successfully or fails, with information on the completed stage. |
void |
onStageSubmitted(SparkListenerStageSubmitted stageSubmitted)
Called when a stage is submitted |
void |
onTaskEnd(SparkListenerTaskEnd taskEnd)
Called when a task ends |
void |
onTaskGettingResult(SparkListenerTaskGettingResult taskGettingResult)
Called when a task begins remotely fetching its result (will not be called for tasks that do not need to fetch the result remotely). |
void |
onTaskStart(SparkListenerTaskStart taskStart)
Called when a task starts |
void |
onUnpersistRDD(SparkListenerUnpersistRDD unpersistRDD)
Called when an RDD is manually unpersisted by the application |
Methods inherited from class Object |
---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public JavaSparkListener()
Method Detail |
---|
public void onStageCompleted(SparkListenerStageCompleted stageCompleted)
SparkListener
onStageCompleted
in interface SparkListener
stageCompleted
- (undocumented)public void onStageSubmitted(SparkListenerStageSubmitted stageSubmitted)
SparkListener
onStageSubmitted
in interface SparkListener
stageSubmitted
- (undocumented)public void onTaskStart(SparkListenerTaskStart taskStart)
SparkListener
onTaskStart
in interface SparkListener
taskStart
- (undocumented)public void onTaskGettingResult(SparkListenerTaskGettingResult taskGettingResult)
SparkListener
onTaskGettingResult
in interface SparkListener
taskGettingResult
- (undocumented)public void onTaskEnd(SparkListenerTaskEnd taskEnd)
SparkListener
onTaskEnd
in interface SparkListener
taskEnd
- (undocumented)public void onJobStart(SparkListenerJobStart jobStart)
SparkListener
onJobStart
in interface SparkListener
jobStart
- (undocumented)public void onJobEnd(SparkListenerJobEnd jobEnd)
SparkListener
onJobEnd
in interface SparkListener
jobEnd
- (undocumented)public void onEnvironmentUpdate(SparkListenerEnvironmentUpdate environmentUpdate)
SparkListener
onEnvironmentUpdate
in interface SparkListener
environmentUpdate
- (undocumented)public void onBlockManagerAdded(SparkListenerBlockManagerAdded blockManagerAdded)
SparkListener
onBlockManagerAdded
in interface SparkListener
blockManagerAdded
- (undocumented)public void onBlockManagerRemoved(SparkListenerBlockManagerRemoved blockManagerRemoved)
SparkListener
onBlockManagerRemoved
in interface SparkListener
blockManagerRemoved
- (undocumented)public void onUnpersistRDD(SparkListenerUnpersistRDD unpersistRDD)
SparkListener
onUnpersistRDD
in interface SparkListener
unpersistRDD
- (undocumented)public void onApplicationStart(SparkListenerApplicationStart applicationStart)
SparkListener
onApplicationStart
in interface SparkListener
applicationStart
- (undocumented)public void onApplicationEnd(SparkListenerApplicationEnd applicationEnd)
SparkListener
onApplicationEnd
in interface SparkListener
applicationEnd
- (undocumented)public void onExecutorMetricsUpdate(SparkListenerExecutorMetricsUpdate executorMetricsUpdate)
SparkListener
onExecutorMetricsUpdate
in interface SparkListener
executorMetricsUpdate
- (undocumented)public void onExecutorAdded(SparkListenerExecutorAdded executorAdded)
SparkListener
onExecutorAdded
in interface SparkListener
executorAdded
- (undocumented)public void onExecutorRemoved(SparkListenerExecutorRemoved executorRemoved)
SparkListener
onExecutorRemoved
in interface SparkListener
executorRemoved
- (undocumented)
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |