Class StateOperatorProgress

Object
org.apache.spark.sql.streaming.StateOperatorProgress
All Implemented Interfaces:
Serializable, scala.Serializable

public class StateOperatorProgress extends Object implements scala.Serializable
Information about updates made to stateful operators in a StreamingQuery during a trigger.
See Also:
  • Method Details

    • operatorName

      public String operatorName()
    • numRowsTotal

      public long numRowsTotal()
    • numRowsUpdated

      public long numRowsUpdated()
    • allUpdatesTimeMs

      public long allUpdatesTimeMs()
    • numRowsRemoved

      public long numRowsRemoved()
    • allRemovalsTimeMs

      public long allRemovalsTimeMs()
    • commitTimeMs

      public long commitTimeMs()
    • memoryUsedBytes

      public long memoryUsedBytes()
    • numRowsDroppedByWatermark

      public long numRowsDroppedByWatermark()
    • numShufflePartitions

      public long numShufflePartitions()
    • numStateStoreInstances

      public long numStateStoreInstances()
    • customMetrics

      public Map<String,Long> customMetrics()
    • json

      public String json()
      The compact JSON representation of this progress.
    • prettyJson

      public String prettyJson()
      The pretty (i.e. indented) JSON representation of this progress.
    • toString

      public String toString()
      Overrides:
      toString in class Object