Package org.apache.spark.sql.streaming

Interface Summary

Interface	Description
GroupState<S>	:: Experimental ::
PythonStreamingQueryListener	Py4J allows a pure interface so this proxy is required.
StreamingQuery	A handle to a query that is executing continuously in the background as new data arrives.
StreamingQueryListener.Event	Base type of StreamingQueryListener events
TestGroupState<S>	:: Experimental ::

Class Summary

Class	Description
DataStreamReader	Interface used to load a streaming Dataset from external storage systems (e.g.
DataStreamWriter<T>	Interface used to write a streaming Dataset to external storage systems (e.g.
GroupStateTimeout	Represents the type of timeouts possible for the Dataset operations mapGroupsWithState and flatMapGroupsWithState.
OutputMode	OutputMode describes what data will be written to a streaming sink when there is new data available in a streaming DataFrame/Dataset.
SafeJsonSerializer
SinkProgress	Information about progress made for a sink in the execution of a StreamingQuery during a trigger.
SourceProgress	Information about progress made for a source in the execution of a StreamingQuery during a trigger.
StateOperatorProgress	Information about updates made to stateful operators in a StreamingQuery during a trigger.
StreamingQueryListener	Interface for listening to events related to StreamingQueries.
StreamingQueryListener.QueryIdleEvent	Event representing that query is idle and waiting for new data to process.
StreamingQueryListener.QueryProgressEvent	Event representing any progress updates in a query.
StreamingQueryListener.QueryStartedEvent	Event representing the start of a query param: id A unique query id that persists across restarts.
StreamingQueryListener.QueryTerminatedEvent	Event representing that termination of a query.
StreamingQueryManager	A class to manage all the StreamingQuery active in a SparkSession.
StreamingQueryProgress	Information about progress made in the execution of a StreamingQuery during a trigger.
StreamingQueryStatus	Reports information about the instantaneous status of a streaming query.
Trigger	Policy used to indicate how often results should be produced by a [[StreamingQuery]].

Exception Summary

Exception	Description
StreamingQueryException	Exception that stopped a StreamingQuery.