Package org.apache.spark.scheduler

Class AccumulableInfo

Object

org.apache.spark.scheduler.AccumulableInfo

All Implemented Interfaces:

Serializable, scala.Equals, scala.Product, scala.Serializable

public class AccumulableInfo
extends Object
implements scala.Product, scala.Serializable

:: DeveloperApi :: Information about an AccumulatorV2 modified during a task or stage.

param: id accumulator ID param: name accumulator name param: update partial value from a task, may be None if used on driver to describe a stage param: value total accumulated value so far, maybe None if used on executors to describe a task param: internal whether this accumulator was internal param: countFailedValues whether to count this accumulator's partial value if the task failed param: metadata internal metadata associated with this accumulator, if any

See Also:

• Serialized Form

Note:

Once this is JSON serialized the types of update and value will be lost and be cast to strings. This is because the user can define an accumulator of any type and it will be difficult to preserve the type in consumers of the event log. This does not apply to internal accumulators that represent task level metrics.

Method Summary

Modifier and Type	Method	Description
abstract static R	apply(T1 v1, T2 v2, T3 v3, T4 v4, T5 v5, T6 v6, T7 v7)
long	id()
scala.Option<String>	name()
static String	toString()
scala.Option<Object>	update()
scala.Option<Object>	value()

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Method Details

apply

public abstract static R apply(T1 v1,
 T2 v2,
 T3 v3,
 T4 v4,
 T5 v5,
 T6 v6,
 T7 v7)

toString

public static String toString()

id

public long id()

name

public scala.Option<String> name()

update

public scala.Option<Object> update()

value

public scala.Option<Object> value()