org.apache.spark.broadcast

Interface BroadcastFactory

public interface BroadcastFactory

An interface for all the broadcast implementations in Spark (to allow multiple broadcast implementations). SparkContext uses a BroadcastFactory implementation to instantiate a particular broadcast for the entire Spark job.

Method Summary

Modifier and Type	Method and Description
void	initialize(boolean isDriver, SparkConf conf)
<T> Broadcast<T>	newBroadcast(T value, boolean isLocal, long id, boolean serializedOnly, scala.reflect.ClassTag<T> evidence$1) Creates a new broadcast variable.
void	stop()
void	unbroadcast(long id, boolean removeFromDriver, boolean blocking)

Method Detail

initialize

void initialize(boolean isDriver,
                SparkConf conf)

newBroadcast

<T> Broadcast<T> newBroadcast(T value,
                              boolean isLocal,
                              long id,
                              boolean serializedOnly,
                              scala.reflect.ClassTag<T> evidence$1)

Creates a new broadcast variable.

Parameters:

value - value to broadcast

isLocal - whether we are in local mode (single JVM process)

id - unique id representing this broadcast variable

serializedOnly - if true, do not cache the unserialized value on the driver

evidence$1 - (undocumented)

Returns:

Broadcast object, a read-only variable cached on each machine

stop

void stop()

unbroadcast

void unbroadcast(long id,
                 boolean removeFromDriver,
                 boolean blocking)