Package org.apache.spark.sql

Class SQLImplicits

Object

org.apache.spark.sql.SQLImplicits

All Implemented Interfaces:

Serializable, EncoderImplicits, LowPrioritySQLImplicits

public abstract class SQLImplicits
extends Object
implements EncoderImplicits, Serializable

A collection of implicit methods for converting common Scala objects into Datasets.

Since:

1.6.0

See Also:

• Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
class	SQLImplicits.StringToColumn	Converts $"col name" into a Column.

Constructor Summary

Constructors

Constructor	Description
SQLImplicits()

Method Summary

Modifier and Type	Method	Description
abstract <T> DatasetHolder<T>	localSeqToDatasetHolder(scala.collection.immutable.Seq<T> s, Encoder<T> evidence$1)	Creates a Dataset from a local Seq.
Encoder<boolean[]>	newBooleanArrayEncoder()
Encoder<scala.collection.immutable.Seq<Object>>	newBooleanSeqEncoder()	Deprecated. Use newSequenceEncoder instead.
Encoder<byte[]>	newByteArrayEncoder()
Encoder<scala.collection.immutable.Seq<Object>>	newByteSeqEncoder()	Deprecated. Use newSequenceEncoder instead.
Encoder<double[]>	newDoubleArrayEncoder()
Encoder<scala.collection.immutable.Seq<Object>>	newDoubleSeqEncoder()	Deprecated. Use newSequenceEncoder instead.
Encoder<float[]>	newFloatArrayEncoder()
Encoder<scala.collection.immutable.Seq<Object>>	newFloatSeqEncoder()	Deprecated. Use newSequenceEncoder instead.
Encoder<int[]>	newIntArrayEncoder()
Encoder<scala.collection.immutable.Seq<Object>>	newIntSeqEncoder()	Deprecated. Use newSequenceEncoder instead.
Encoder<long[]>	newLongArrayEncoder()
Encoder<scala.collection.immutable.Seq<Object>>	newLongSeqEncoder()	Deprecated. Use newSequenceEncoder instead.
Encoder<short[]>	newShortArrayEncoder()
Encoder<scala.collection.immutable.Seq<Object>>	newShortSeqEncoder()	Deprecated. Use newSequenceEncoder instead.
Encoder<String[]>	newStringArrayEncoder()
Encoder<scala.collection.immutable.Seq<String>>	newStringSeqEncoder()	Deprecated. Use newSequenceEncoder instead.
abstract <T> DatasetHolder<T>	rddToDatasetHolder(RDD<T> rdd, Encoder<T> evidence$2)	Creates a Dataset from an RDD.
ColumnName	symbolToColumn(scala.Symbol s)	An implicit conversion that turns a Scala Symbol into a Column.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.EncoderImplicits

newArrayEncoder, newBooleanEncoder, newBoxedBooleanEncoder, newBoxedByteEncoder, newBoxedDoubleEncoder, newBoxedFloatEncoder, newBoxedIntEncoder, newBoxedLongEncoder, newBoxedShortEncoder, newByteEncoder, newDateEncoder, newDoubleEncoder, newDurationEncoder, newFloatEncoder, newInstantEncoder, newIntEncoder, newJavaDecimalEncoder, newJavaEnumEncoder, newLocalDateEncoder, newLocalDateTimeEncoder, newLocalTimeEncoder, newLongEncoder, newMapEncoder, newPeriodEncoder, newProductArrayEncoder, newProductSeqEncoder, newScalaDecimalEncoder, newSeqEncoder, newSequenceEncoder, newSetEncoder, newShortEncoder, newStringEncoder, newTimeStampEncoder

Methods inherited from interface org.apache.spark.sql.LowPrioritySQLImplicits

newProductEncoder

Constructor Details

SQLImplicits

public SQLImplicits()

Method Details

localSeqToDatasetHolder

public abstract <T> DatasetHolder<T> localSeqToDatasetHolder(scala.collection.immutable.Seq<T> s,
 Encoder<T> evidence$1)

Creates a Dataset from a local Seq.

Parameters:

s - (undocumented)

evidence$1 - (undocumented)

Returns:

(undocumented)

Since:

1.6.0

newBooleanArrayEncoder

public Encoder<boolean[]> newBooleanArrayEncoder()

Specified by:

newBooleanArrayEncoder in interface EncoderImplicits

newBooleanSeqEncoder

public Encoder<scala.collection.immutable.Seq<Object>> newBooleanSeqEncoder()

Deprecated.

Use newSequenceEncoder instead. Since 2.2.0.

Specified by:

newBooleanSeqEncoder in interface EncoderImplicits

Returns:

(undocumented)

newByteArrayEncoder

public Encoder<byte[]> newByteArrayEncoder()

Specified by:

newByteArrayEncoder in interface EncoderImplicits

newByteSeqEncoder

public Encoder<scala.collection.immutable.Seq<Object>> newByteSeqEncoder()

Deprecated.

Use newSequenceEncoder instead. Since 2.2.0.

Specified by:

newByteSeqEncoder in interface EncoderImplicits

Returns:

(undocumented)

newDoubleArrayEncoder

public Encoder<double[]> newDoubleArrayEncoder()

Specified by:

newDoubleArrayEncoder in interface EncoderImplicits

newDoubleSeqEncoder

public Encoder<scala.collection.immutable.Seq<Object>> newDoubleSeqEncoder()

Deprecated.

Use newSequenceEncoder instead. Since 2.2.0.

Specified by:

newDoubleSeqEncoder in interface EncoderImplicits

Returns:

(undocumented)

newFloatArrayEncoder

public Encoder<float[]> newFloatArrayEncoder()

Specified by:

newFloatArrayEncoder in interface EncoderImplicits

newFloatSeqEncoder

public Encoder<scala.collection.immutable.Seq<Object>> newFloatSeqEncoder()

Deprecated.

Use newSequenceEncoder instead. Since 2.2.0.

Specified by:

newFloatSeqEncoder in interface EncoderImplicits

Returns:

(undocumented)

newIntArrayEncoder

public Encoder<int[]> newIntArrayEncoder()

Specified by:

newIntArrayEncoder in interface EncoderImplicits

newIntSeqEncoder

public Encoder<scala.collection.immutable.Seq<Object>> newIntSeqEncoder()

Deprecated.

Use newSequenceEncoder instead. Since 2.2.0.

Specified by:

newIntSeqEncoder in interface EncoderImplicits

Returns:

(undocumented)

newLongArrayEncoder

public Encoder<long[]> newLongArrayEncoder()

Specified by:

newLongArrayEncoder in interface EncoderImplicits

newLongSeqEncoder

public Encoder<scala.collection.immutable.Seq<Object>> newLongSeqEncoder()

Deprecated.

Use newSequenceEncoder instead. Since 2.2.0.

Specified by:

newLongSeqEncoder in interface EncoderImplicits

Returns:

(undocumented)

newShortArrayEncoder

public Encoder<short[]> newShortArrayEncoder()

Specified by:

newShortArrayEncoder in interface EncoderImplicits

newShortSeqEncoder

public Encoder<scala.collection.immutable.Seq<Object>> newShortSeqEncoder()

Deprecated.

Use newSequenceEncoder instead. Since 2.2.0.

Specified by:

newShortSeqEncoder in interface EncoderImplicits

Returns:

(undocumented)

newStringArrayEncoder

public Encoder<String[]> newStringArrayEncoder()

Specified by:

newStringArrayEncoder in interface EncoderImplicits

newStringSeqEncoder

public Encoder<scala.collection.immutable.Seq<String>> newStringSeqEncoder()

Deprecated.

Use newSequenceEncoder instead. Since 2.2.0.

Specified by:

newStringSeqEncoder in interface EncoderImplicits

Returns:

(undocumented)

rddToDatasetHolder

public abstract <T> DatasetHolder<T> rddToDatasetHolder(RDD<T> rdd,
 Encoder<T> evidence$2)

Creates a Dataset from an RDD.

Parameters:

rdd - (undocumented)

evidence$2 - (undocumented)

Returns:

(undocumented)

Since:

1.6.0

symbolToColumn

public ColumnName symbolToColumn(scala.Symbol s)

An implicit conversion that turns a Scala Symbol into a Column.

Parameters:

s - (undocumented)

Returns:

(undocumented)

Since:

1.3.0