Package org.apache.spark.sql.streaming
Class StateOperatorProgress
Object
org.apache.spark.sql.streaming.StateOperatorProgress
- All Implemented Interfaces:
Serializable
,scala.Serializable
Information about updates made to stateful operators in a
StreamingQuery
during a trigger.- See Also:
-
Method Details
-
operatorName
-
numRowsTotal
public long numRowsTotal() -
numRowsUpdated
public long numRowsUpdated() -
allUpdatesTimeMs
public long allUpdatesTimeMs() -
numRowsRemoved
public long numRowsRemoved() -
allRemovalsTimeMs
public long allRemovalsTimeMs() -
commitTimeMs
public long commitTimeMs() -
memoryUsedBytes
public long memoryUsedBytes() -
numRowsDroppedByWatermark
public long numRowsDroppedByWatermark() -
numShufflePartitions
public long numShufflePartitions() -
numStateStoreInstances
public long numStateStoreInstances() -
customMetrics
-
json
The compact JSON representation of this progress. -
prettyJson
The pretty (i.e. indented) JSON representation of this progress. -
toString
-