Interface used to load a streaming Dataset from external storage systems (e.g.
:: Experimental :: Interface used to write a streaming Dataset to external storage systems (e.g.
:: Experimental :: Interface used to write a streaming Dataset to external storage systems (e.g. file systems, key-value stores, etc). Use Dataset.writeStream to access this.
2.0.0
:: Experimental :: A trigger that runs a query periodically based on the processing time.
:: Experimental ::
A trigger that runs a query periodically based on the processing time. If interval
is 0,
the query will run as fast as possible.
Scala Example:
df.write.trigger(ProcessingTime("10 seconds")) import scala.concurrent.duration._ df.write.trigger(ProcessingTime(10.seconds))
Java Example:
df.write.trigger(ProcessingTime.create("10 seconds")) import java.util.concurrent.TimeUnit df.write.trigger(ProcessingTime.create(10, TimeUnit.SECONDS))
2.0.0
:: Experimental :: Status and metrics of a streaming Sink.
:: Experimental :: Status and metrics of a streaming Sink.
2.0.0
:: Experimental :: Status and metrics of a streaming Source.
:: Experimental :: Status and metrics of a streaming Source.
2.0.0
:: Experimental :: A handle to a query that is executing continuously in the background as new data arrives.
:: Experimental :: A handle to a query that is executing continuously in the background as new data arrives. All these methods are thread-safe.
2.0.0
:: Experimental :: Exception that stopped a StreamingQuery.
:: Experimental :: Exception that stopped a StreamingQuery.
2.0.0
:: Experimental :: A class used to report information about the progress of a StreamingQuery.
:: Experimental :: A class used to report information about the progress of a StreamingQuery.
:: Experimental :: Interface for listening to events related to StreamingQueries.
:: Experimental :: Interface for listening to events related to StreamingQueries.
2.0.0
The methods are not thread-safe as they may be called from different threads.
:: Experimental :: A class to manage all the StreamingQuery active on a SparkSession.
:: Experimental :: A class to manage all the StreamingQuery active on a SparkSession.
2.0.0
:: Experimental :: Used to indicate how often results should be produced by a StreamingQuery.
:: Experimental :: Used to indicate how often results should be produced by a StreamingQuery.
2.0.0
:: Experimental :: Used to create ProcessingTime triggers for StreamingQuerys.
:: Experimental :: Used to create ProcessingTime triggers for StreamingQuerys.
2.0.0
:: Experimental :: Companion object of StreamingQueryListener that defines the listener events.
:: Experimental :: Companion object of StreamingQueryListener that defines the listener events.
2.0.0
Interface used to load a streaming Dataset from external storage systems (e.g. file systems, key-value stores, etc). Use SparkSession.readStream to access this.
2.0.0