@InterfaceStability.Evolving
public abstract class Offset
extends org.apache.spark.sql.execution.streaming.Offset
MicroBatchReader
or
ContinuousReader
.
During execution, offsets provided by the data source implementation will be logged and used as
restart checkpoints. Each source should provide an offset implementation which the source can use
to reconstruct a position in the stream up to which data has been seen/processed.
Note: This class currently extends Offset
to
maintain compatibility with DataSource V1 APIs. This extension will be removed once we
get rid of V1 completely.Constructor and Description |
---|
Offset() |
Modifier and Type | Method and Description |
---|---|
boolean |
equals(Object obj)
Equality based on JSON string representation.
|
int |
hashCode() |
abstract String |
json()
A JSON-serialized representation of an Offset that is
used for saving offsets to the offset log.
|
String |
toString() |
public abstract String json()
json
in class org.apache.spark.sql.execution.streaming.Offset
public boolean equals(Object obj)
equals
in class org.apache.spark.sql.execution.streaming.Offset
public int hashCode()
hashCode
in class org.apache.spark.sql.execution.streaming.Offset
public String toString()
toString
in class org.apache.spark.sql.execution.streaming.Offset