Package org.apache.spark.sql.pipelines.graph

Class UnresolvedFlow

Object
org.apache.spark.sql.pipelines.graph.UnresolvedFlow
All Implemented Interfaces:
Serializable, org.apache.spark.internal.Logging, Flow, GraphElement, scala.Equals, scala.Product
public class UnresolvedFlow extends Object implements Flow, scala.Product, Serializable
A Flow whose output schema and dependencies aren't known.
See Also:

  • Nested Class Summary

    Nested classes/interfaces inherited from interface org.apache.spark.internal.Logging

    org.apache.spark.internal.Logging.LogStringContext, org.apache.spark.internal.Logging.SparkShellLoggingFilter

  • Constructor Summary

    Constructors
    Constructor
    Description
    UnresolvedFlow(org.apache.spark.sql.catalyst.TableIdentifier identifier, org.apache.spark.sql.catalyst.TableIdentifier destinationIdentifier, FlowFunction func, QueryContext queryContext, scala.collection.immutable.Map<String,String> sqlConf, scala.Option<String> comment, boolean once, QueryOrigin origin)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    abstract static R
    apply(T1 v1, T2 v2, T3 v3, T4 v4, T5 v5, T6 v6, T7 v7, T8 v8)
     
    scala.Option<String>
    comment()
    The comment associated with this flow
    org.apache.spark.sql.catalyst.TableIdentifier
    destinationIdentifier()
    The dataset that this Flow represents a write to.
    FlowFunction
    func()
    The FlowFunction containing the user's query.
    org.apache.spark.sql.catalyst.TableIdentifier
    identifier()
    Returns the unique identifier for this GraphElement.
    boolean
    once()
    Whether this is a ONCE flow.
    QueryOrigin
    origin()
    Contains provenance to tie back this GraphElement to the user code that defined it.
    QueryContext
    queryContext()
    The current query context (catalog and database) when the query is defined.
    scala.collection.immutable.Map<String,String>
    sqlConf()
     
    static String
    toString()
     

    Methods inherited from class java.lang.Object

    equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface scala.Equals

    canEqual, equals

    Methods inherited from interface org.apache.spark.sql.pipelines.graph.GraphElement

    displayName, spark

    Methods inherited from interface org.apache.spark.internal.Logging

    initializeForcefully, initializeLogIfNecessary, initializeLogIfNecessary, initializeLogIfNecessary$default$2, isTraceEnabled, log, logBasedOnLevel, logDebug, logDebug, logDebug, logDebug, logError, logError, logError, logError, logInfo, logInfo, logInfo, logInfo, logName, LogStringContext, logTrace, logTrace, logTrace, logTrace, logWarning, logWarning, logWarning, logWarning, org$apache$spark$internal$Logging$$log_, org$apache$spark$internal$Logging$$log__$eq, withLogContext

    Methods inherited from interface scala.Product

    productArity, productElement, productElementName, productElementNames, productIterator, productPrefix

  • Constructor Details

    • UnresolvedFlow

      public UnresolvedFlow(org.apache.spark.sql.catalyst.TableIdentifier identifier, org.apache.spark.sql.catalyst.TableIdentifier destinationIdentifier, FlowFunction func, QueryContext queryContext, scala.collection.immutable.Map<String,String> sqlConf, scala.Option<String> comment, boolean once, QueryOrigin origin)

  • Method Details

    • apply

      public abstract static R apply(T1 v1, T2 v2, T3 v3, T4 v4, T5 v5, T6 v6, T7 v7, T8 v8)

    • toString

      public static String toString()

    • identifier

      public org.apache.spark.sql.catalyst.TableIdentifier identifier()
      Description copied from interface: GraphElement
      Returns the unique identifier for this GraphElement.
      Specified by:
      identifier in interface Flow
      Specified by:
      identifier in interface GraphElement

    • destinationIdentifier

      public org.apache.spark.sql.catalyst.TableIdentifier destinationIdentifier()
      Description copied from interface: Flow
      The dataset that this Flow represents a write to.
      Specified by:
      destinationIdentifier in interface Flow
      Returns:
      (undocumented)

    • func

      public FlowFunction func()
      Description copied from interface: Flow
      The FlowFunction containing the user's query.
      Specified by:
      func in interface Flow

    • queryContext

      public QueryContext queryContext()
      Description copied from interface: Flow
      The current query context (catalog and database) when the query is defined.
      Specified by:
      queryContext in interface Flow

    • sqlConf

      public scala.collection.immutable.Map<String,String> sqlConf()
      Specified by:
      sqlConf in interface Flow

    • comment

      public scala.Option<String> comment()
      Description copied from interface: Flow
      The comment associated with this flow
      Specified by:
      comment in interface Flow

    • once

      public boolean once()
      Description copied from interface: Flow
      Whether this is a ONCE flow. ONCE flows should run only once per full refresh.
      Specified by:
      once in interface Flow
      Returns:
      (undocumented)

    • origin

      public QueryOrigin origin()
      Description copied from interface: GraphElement
      Contains provenance to tie back this GraphElement to the user code that defined it.

      This must be set when a GraphElement is directly created by some user code. Subsequently, this initial origin must be propagated as is without modification. If this GraphElement is copied or converted to a different type, then this origin must be copied as is.

      Specified by:
      origin in interface GraphElement
      Returns:
      (undocumented)