Interface ContinuousPartitionReader<T>

All Superinterfaces:
AutoCloseable, Closeable, PartitionReader<T>

@Evolving public interface ContinuousPartitionReader<T> extends PartitionReader<T>
A variation on PartitionReader for use with continuous streaming processing.
  • Method Details

    • getOffset

      PartitionOffset getOffset()
      Get the offset of the current record, or the start offset if no records have been read.

      The execution engine will call this method along with get() to keep track of the current offset. When an epoch ends, the offset of the previous record in each partition will be saved as a restart checkpoint.