case class BatchInfo(batchTime: Time, streamIdToInputInfo: Map[Int, StreamInputInfo], submissionTime: Long, processingStartTime: Option[Long], processingEndTime: Option[Long], outputOperationInfos: Map[Int, OutputOperationInfo]) extends Product with Serializable
:: DeveloperApi :: Class having information on completed batches.
- batchTime
Time of the batch
- streamIdToInputInfo
A map of input stream id to its input info
- submissionTime
Clock time of when jobs of this batch was submitted to the streaming scheduler queue
- processingStartTime
Clock time of when the first job of this batch started processing
- processingEndTime
Clock time of when the last job of this batch finished processing
- outputOperationInfos
The output operations in this batch
- Annotations
- @DeveloperApi()
- Source
- BatchInfo.scala
- Alphabetic
- By Inheritance
- BatchInfo
- Serializable
- Product
- Equals
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
- new BatchInfo(batchTime: Time, streamIdToInputInfo: Map[Int, StreamInputInfo], submissionTime: Long, processingStartTime: Option[Long], processingEndTime: Option[Long], outputOperationInfos: Map[Int, OutputOperationInfo])
- batchTime
Time of the batch
- streamIdToInputInfo
A map of input stream id to its input info
- submissionTime
Clock time of when jobs of this batch was submitted to the streaming scheduler queue
- processingStartTime
Clock time of when the first job of this batch started processing
- processingEndTime
Clock time of when the last job of this batch finished processing
- outputOperationInfos
The output operations in this batch
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- val batchTime: Time
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- def numRecords: Long
The number of recorders received by the receivers in this batch.
- val outputOperationInfos: Map[Int, OutputOperationInfo]
- def processingDelay: Option[Long]
Time taken for the all jobs of this batch to finish processing from the time they started processing.
Time taken for the all jobs of this batch to finish processing from the time they started processing. Essentially, it is
processingEndTime-processingStartTime. - val processingEndTime: Option[Long]
- val processingStartTime: Option[Long]
- def productElementNames: Iterator[String]
- Definition Classes
- Product
- def schedulingDelay: Option[Long]
Time taken for the first job of this batch to start processing from the time this batch was submitted to the streaming scheduler.
Time taken for the first job of this batch to start processing from the time this batch was submitted to the streaming scheduler. Essentially, it is
processingStartTime-submissionTime. - val streamIdToInputInfo: Map[Int, StreamInputInfo]
- val submissionTime: Long
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def totalDelay: Option[Long]
Time taken for all the jobs of this batch to finish processing from the time they were submitted.
Time taken for all the jobs of this batch to finish processing from the time they were submitted. Essentially, it is
processingDelay+schedulingDelay. - final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated
(Since version 9)