KeyType - Class of the keyValueType - Class of the valueStateType - Class of the state dataMappedType - Class of the mapped datapublic abstract class MapWithStateDStream<KeyType,ValueType,StateType,MappedType> extends DStream<MappedType>
mapWithState operation on a
pair DStream.
Additionally, it also gives access to the stream of state snapshots, that is, the state data of
all keys after a batch has updated them.
| Constructor and Description |
|---|
MapWithStateDStream(StreamingContext ssc,
scala.reflect.ClassTag<MappedType> evidence$1) |
| Modifier and Type | Method and Description |
|---|---|
abstract DStream<scala.Tuple2<KeyType,StateType>> |
stateSnapshots()
Return a pair DStream where each RDD is the snapshot of the state of all the keys.
|
cache, checkpoint, compute, context, count, countByValue, countByValueAndWindow, countByWindow, dependencies, filter, flatMap, foreachRDD, foreachRDD, glom, map, mapPartitions, persist, persist, print, print, reduce, reduceByWindow, reduceByWindow, repartition, saveAsObjectFiles, saveAsTextFiles, slice, slice, slideDuration, toPairDStreamFunctions, transform, transform, transformWith, transformWith, union, window, windowequals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait$init$, initializeForcefully, initializeLogIfNecessary, initializeLogIfNecessary, initializeLogIfNecessary$default$2, initLock, isTraceEnabled, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, org$apache$spark$internal$Logging$$log__$eq, org$apache$spark$internal$Logging$$log_, uninitializepublic MapWithStateDStream(StreamingContext ssc, scala.reflect.ClassTag<MappedType> evidence$1)