ReadOnlySparkConf

trait ReadOnlySparkConf extends AnyRef

Source: SparkConf.scala

Linear Supertypes

AnyRef, Any

Known Subclasses

SparkConf

Ordering

Alphabetic
By Inheritance

Inherited

ReadOnlySparkConf
AnyRef
Any

Hide All
Show All

Visibility

Public
Protected

Abstract Value Members

abstract def contains(key: String): Boolean
Does the configuration contain a given parameter?
abstract def getAll: Array[(String, String)]
Get all parameters as a list of pairs
abstract def getOption(key: String): Option[String]
Get a parameter as an Option

Concrete Value Members

final def !=(arg0: Any): Boolean
Definition Classes
AnyRef → Any
final def ##: Int
Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean
Definition Classes
AnyRef → Any
final def asInstanceOf[T0]: T0
Definition Classes
Any
def catchIllegalValue[T](key: String)(getValue: => T): T
Wrapper method for get() methods which require some specific value format.
Wrapper method for get() methods which require some specific value format. This catches any NumberFormatException or IllegalArgumentException and re-raises it with the incorrectly configured key in the exception message.
Attributes
protected
def clone(): AnyRef
Attributes
protected[lang]
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
def contains(entry: ConfigEntry[_]): Boolean
Does the configuration have the typed config entry?
final def eq(arg0: AnyRef): Boolean
Definition Classes
AnyRef
def equals(arg0: AnyRef): Boolean
Definition Classes
AnyRef → Any
def get(key: String, defaultValue: String): String
Get a parameter, falling back to a default if not set
def get(key: String): String
Get a parameter; throws a NoSuchElementException if it's not set
def getBoolean(key: String, defaultValue: Boolean): Boolean
Get a parameter as a boolean, falling back to a default if not set
Get a parameter as a boolean, falling back to a default if not set
Exceptions thrown
IllegalArgumentException If the value cannot be interpreted as a boolean
final def getClass(): Class[_ <: AnyRef]
Definition Classes
AnyRef → Any
Annotations
@IntrinsicCandidate() @native()
def getDouble(key: String, defaultValue: Double): Double
Get a parameter as a double, falling back to a default if not ste
Get a parameter as a double, falling back to a default if not ste
Exceptions thrown
NumberFormatException If the value cannot be interpreted as a double
def getInt(key: String, defaultValue: Int): Int
Get a parameter as an integer, falling back to a default if not set
Get a parameter as an integer, falling back to a default if not set
Exceptions thrown
NumberFormatException If the value cannot be interpreted as an integer
def getLong(key: String, defaultValue: Long): Long
Get a parameter as a long, falling back to a default if not set
Get a parameter as a long, falling back to a default if not set
Exceptions thrown
NumberFormatException If the value cannot be interpreted as a long
def getSizeAsBytes(key: String, defaultValue: Long): Long
Get a size parameter as bytes, falling back to a default if not set.
Get a size parameter as bytes, falling back to a default if not set.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as bytes
def getSizeAsBytes(key: String, defaultValue: String): Long
Get a size parameter as bytes, falling back to a default if not set.
Get a size parameter as bytes, falling back to a default if not set. If no suffix is provided then bytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as bytes
def getSizeAsBytes(key: String): Long
Get a size parameter as bytes; throws a NoSuchElementException if it's not set.
Get a size parameter as bytes; throws a NoSuchElementException if it's not set. If no suffix is provided then bytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as bytes
java.util.NoSuchElementException If the size parameter is not set
def getSizeAsGb(key: String, defaultValue: String): Long
Get a size parameter as Gibibytes, falling back to a default if not set.
Get a size parameter as Gibibytes, falling back to a default if not set. If no suffix is provided then Gibibytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as Gibibytes
def getSizeAsGb(key: String): Long
Get a size parameter as Gibibytes; throws a NoSuchElementException if it's not set.
Get a size parameter as Gibibytes; throws a NoSuchElementException if it's not set. If no suffix is provided then Gibibytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as Gibibytes
java.util.NoSuchElementException If the size parameter is not set
def getSizeAsKb(key: String, defaultValue: String): Long
Get a size parameter as Kibibytes, falling back to a default if not set.
Get a size parameter as Kibibytes, falling back to a default if not set. If no suffix is provided then Kibibytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as Kibibytes
def getSizeAsKb(key: String): Long
Get a size parameter as Kibibytes; throws a NoSuchElementException if it's not set.
Get a size parameter as Kibibytes; throws a NoSuchElementException if it's not set. If no suffix is provided then Kibibytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as Kibibytes
java.util.NoSuchElementException If the size parameter is not set
def getSizeAsMb(key: String, defaultValue: String): Long
Get a size parameter as Mebibytes, falling back to a default if not set.
Get a size parameter as Mebibytes, falling back to a default if not set. If no suffix is provided then Mebibytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as Mebibytes
def getSizeAsMb(key: String): Long
Get a size parameter as Mebibytes; throws a NoSuchElementException if it's not set.
Get a size parameter as Mebibytes; throws a NoSuchElementException if it's not set. If no suffix is provided then Mebibytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as Mebibytes
java.util.NoSuchElementException If the size parameter is not set
def getTimeAsMs(key: String, defaultValue: String): Long
Get a time parameter as milliseconds, falling back to a default if not set.
Get a time parameter as milliseconds, falling back to a default if not set. If no suffix is provided then milliseconds are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as milliseconds
def getTimeAsMs(key: String): Long
Get a time parameter as milliseconds; throws a NoSuchElementException if it's not set.
Get a time parameter as milliseconds; throws a NoSuchElementException if it's not set. If no suffix is provided then milliseconds are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as milliseconds
java.util.NoSuchElementException If the time parameter is not set
def getTimeAsSeconds(key: String, defaultValue: String): Long
Get a time parameter as seconds, falling back to a default if not set.
Get a time parameter as seconds, falling back to a default if not set. If no suffix is provided then seconds are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as seconds
def getTimeAsSeconds(key: String): Long
Get a time parameter as seconds; throws a NoSuchElementException if it's not set.
Get a time parameter as seconds; throws a NoSuchElementException if it's not set. If no suffix is provided then seconds are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as seconds
java.util.NoSuchElementException If the time parameter is not set
def hashCode(): Int
Definition Classes
AnyRef → Any
Annotations
@IntrinsicCandidate() @native()
final def isInstanceOf[T0]: Boolean
Definition Classes
Any
final def ne(arg0: AnyRef): Boolean
Definition Classes
AnyRef
final def notify(): Unit
Definition Classes
AnyRef
Annotations
@IntrinsicCandidate() @native()
final def notifyAll(): Unit
Definition Classes
AnyRef
Annotations
@IntrinsicCandidate() @native()
final def synchronized[T0](arg0: => T0): T0
Definition Classes
AnyRef
def toString(): String
Definition Classes
AnyRef → Any
final def wait(arg0: Long, arg1: Int): Unit
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.InterruptedException])
final def wait(arg0: Long): Unit
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.InterruptedException]) @native()
final def wait(): Unit
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.InterruptedException])

Deprecated Value Members

def finalize(): Unit
Attributes
protected[lang]
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.Throwable]) @Deprecated
Deprecated
(Since version 9)

Ungrouped

abstract def contains(key: String): Boolean
Does the configuration contain a given parameter?
abstract def getAll: Array[(String, String)]
Get all parameters as a list of pairs
abstract def getOption(key: String): Option[String]
Get a parameter as an Option
final def !=(arg0: Any): Boolean
Definition Classes
AnyRef → Any
final def ##: Int
Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean
Definition Classes
AnyRef → Any
final def asInstanceOf[T0]: T0
Definition Classes
Any
def catchIllegalValue[T](key: String)(getValue: => T): T
Wrapper method for get() methods which require some specific value format.
Wrapper method for get() methods which require some specific value format. This catches any NumberFormatException or IllegalArgumentException and re-raises it with the incorrectly configured key in the exception message.
Attributes
protected
def clone(): AnyRef
Attributes
protected[lang]
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
def contains(entry: ConfigEntry[_]): Boolean
Does the configuration have the typed config entry?
final def eq(arg0: AnyRef): Boolean
Definition Classes
AnyRef
def equals(arg0: AnyRef): Boolean
Definition Classes
AnyRef → Any
def get(key: String, defaultValue: String): String
Get a parameter, falling back to a default if not set
def get(key: String): String
Get a parameter; throws a NoSuchElementException if it's not set
def getBoolean(key: String, defaultValue: Boolean): Boolean
Get a parameter as a boolean, falling back to a default if not set
Get a parameter as a boolean, falling back to a default if not set
Exceptions thrown
IllegalArgumentException If the value cannot be interpreted as a boolean
final def getClass(): Class[_ <: AnyRef]
Definition Classes
AnyRef → Any
Annotations
@IntrinsicCandidate() @native()
def getDouble(key: String, defaultValue: Double): Double
Get a parameter as a double, falling back to a default if not ste
Get a parameter as a double, falling back to a default if not ste
Exceptions thrown
NumberFormatException If the value cannot be interpreted as a double
def getInt(key: String, defaultValue: Int): Int
Get a parameter as an integer, falling back to a default if not set
Get a parameter as an integer, falling back to a default if not set
Exceptions thrown
NumberFormatException If the value cannot be interpreted as an integer
def getLong(key: String, defaultValue: Long): Long
Get a parameter as a long, falling back to a default if not set
Get a parameter as a long, falling back to a default if not set
Exceptions thrown
NumberFormatException If the value cannot be interpreted as a long
def getSizeAsBytes(key: String, defaultValue: Long): Long
Get a size parameter as bytes, falling back to a default if not set.
Get a size parameter as bytes, falling back to a default if not set.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as bytes
def getSizeAsBytes(key: String, defaultValue: String): Long
Get a size parameter as bytes, falling back to a default if not set.
Get a size parameter as bytes, falling back to a default if not set. If no suffix is provided then bytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as bytes
def getSizeAsBytes(key: String): Long
Get a size parameter as bytes; throws a NoSuchElementException if it's not set.
Get a size parameter as bytes; throws a NoSuchElementException if it's not set. If no suffix is provided then bytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as bytes
java.util.NoSuchElementException If the size parameter is not set
def getSizeAsGb(key: String, defaultValue: String): Long
Get a size parameter as Gibibytes, falling back to a default if not set.
Get a size parameter as Gibibytes, falling back to a default if not set. If no suffix is provided then Gibibytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as Gibibytes
def getSizeAsGb(key: String): Long
Get a size parameter as Gibibytes; throws a NoSuchElementException if it's not set.
Get a size parameter as Gibibytes; throws a NoSuchElementException if it's not set. If no suffix is provided then Gibibytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as Gibibytes
java.util.NoSuchElementException If the size parameter is not set
def getSizeAsKb(key: String, defaultValue: String): Long
Get a size parameter as Kibibytes, falling back to a default if not set.
Get a size parameter as Kibibytes, falling back to a default if not set. If no suffix is provided then Kibibytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as Kibibytes
def getSizeAsKb(key: String): Long
Get a size parameter as Kibibytes; throws a NoSuchElementException if it's not set.
Get a size parameter as Kibibytes; throws a NoSuchElementException if it's not set. If no suffix is provided then Kibibytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as Kibibytes
java.util.NoSuchElementException If the size parameter is not set
def getSizeAsMb(key: String, defaultValue: String): Long
Get a size parameter as Mebibytes, falling back to a default if not set.
Get a size parameter as Mebibytes, falling back to a default if not set. If no suffix is provided then Mebibytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as Mebibytes
def getSizeAsMb(key: String): Long
Get a size parameter as Mebibytes; throws a NoSuchElementException if it's not set.
Get a size parameter as Mebibytes; throws a NoSuchElementException if it's not set. If no suffix is provided then Mebibytes are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as Mebibytes
java.util.NoSuchElementException If the size parameter is not set
def getTimeAsMs(key: String, defaultValue: String): Long
Get a time parameter as milliseconds, falling back to a default if not set.
Get a time parameter as milliseconds, falling back to a default if not set. If no suffix is provided then milliseconds are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as milliseconds
def getTimeAsMs(key: String): Long
Get a time parameter as milliseconds; throws a NoSuchElementException if it's not set.
Get a time parameter as milliseconds; throws a NoSuchElementException if it's not set. If no suffix is provided then milliseconds are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as milliseconds
java.util.NoSuchElementException If the time parameter is not set
def getTimeAsSeconds(key: String, defaultValue: String): Long
Get a time parameter as seconds, falling back to a default if not set.
Get a time parameter as seconds, falling back to a default if not set. If no suffix is provided then seconds are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as seconds
def getTimeAsSeconds(key: String): Long
Get a time parameter as seconds; throws a NoSuchElementException if it's not set.
Get a time parameter as seconds; throws a NoSuchElementException if it's not set. If no suffix is provided then seconds are assumed.
Exceptions thrown
NumberFormatException If the value cannot be interpreted as seconds
java.util.NoSuchElementException If the time parameter is not set
def hashCode(): Int
Definition Classes
AnyRef → Any
Annotations
@IntrinsicCandidate() @native()
final def isInstanceOf[T0]: Boolean
Definition Classes
Any
final def ne(arg0: AnyRef): Boolean
Definition Classes
AnyRef
final def notify(): Unit
Definition Classes
AnyRef
Annotations
@IntrinsicCandidate() @native()
final def notifyAll(): Unit
Definition Classes
AnyRef
Annotations
@IntrinsicCandidate() @native()
final def synchronized[T0](arg0: => T0): T0
Definition Classes
AnyRef
def toString(): String
Definition Classes
AnyRef → Any
final def wait(arg0: Long, arg1: Int): Unit
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.InterruptedException])
final def wait(arg0: Long): Unit
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.InterruptedException]) @native()
final def wait(): Unit
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.InterruptedException])
def finalize(): Unit
Attributes
protected[lang]
Definition Classes
AnyRef
Annotations
@throws(classOf[java.lang.Throwable]) @Deprecated
Deprecated
(Since version 9)

Packages

ReadOnlySparkConf

trait ReadOnlySparkConf extends AnyRef

Abstract Value Members

Concrete Value Members

Deprecated Value Members

Inherited from AnyRef

Value Members

Inherited from Any

Value Members

Ungrouped

Packages

ReadOnlySparkConf

trait ReadOnlySparkConf extends AnyRef

Abstract Value Members

Concrete Value Members

Deprecated Value Members

Inherited from AnyRef

Value Members

Inherited from Any

Value Members

Ungrouped

ReadOnlySparkConf