Package org.apache.spark.sql.streaming
package org.apache.spark.sql.streaming
-
ClassDescriptionInterface used to load a streaming
Datasetfrom external storage systems (e.g.Interface used to write a streamingDatasetto external storage systems (e.g.Class used to provide access to expired timer's expiry time.GroupState<S>:: Experimental ::Represents the type of timeouts possible for the Dataset operationsmapGroupsWithStateandflatMapGroupsWithState.ListState<S>Interface used for arbitrary stateful operations with the v2 API to capture list value state.MapState<K,V> Interface used for arbitrary stateful operations with the v2 API to capture map value state.OutputMode describes what data will be written to a streaming sink when there is new data available in a streaming DataFrame/Dataset.Py4J allows a pure interface so this proxy is required.Represents the query info provided to the stateful processor used in the arbitrary state API v2 to easily identify task retries on the same partition.Information about progress made for a sink in the execution of aStreamingQueryduring a trigger.Information about progress made for a source in the execution of aStreamingQueryduring a trigger.Represents the operation handle provided to the stateful processor used in the arbitrary state API v2.Information about updates made to stateful operators in aStreamingQueryduring a trigger.A handle to a query that is executing continuously in the background as new data arrives.Exception that stopped aStreamingQuery.Interface for listening to events related toStreamingQueries.Base type ofStreamingQueryListenereventsEvent representing that query is idle and waiting for new data to process.Event representing any progress updates in a query.Event representing the start of a query param: id A unique query id that persists across restarts.Event representing that termination of a query.A class to manage all theStreamingQueryactive in aSparkSession.Information about progress made in the execution of aStreamingQueryduring a trigger.Reports information about the instantaneous status of a streaming query.:: Experimental ::Represents the time modes (used for specifying timers and ttl) possible for the Dataset operationstransformWithState.Class used to provide access to timer values for processing and event time populated before method invocations using the arbitrary state API v2.Policy used to indicate how often results should be produced by a [[StreamingQuery]].TTL Configuration for state variable.ValueState<S>Interface used for arbitrary stateful operations with the v2 API to capture single value state.