|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
Object org.apache.spark.rdd.RDD<T> org.apache.spark.rdd.UnionRDD<T>
public class UnionRDD<T>
Constructor Summary | |
---|---|
UnionRDD(SparkContext sc,
scala.collection.Seq<RDD<T>> rdds,
scala.reflect.ClassTag<T> evidence$2)
|
Method Summary | |
---|---|
void |
clearDependencies()
Clears the dependencies of this RDD. |
scala.collection.Iterator<T> |
compute(Partition s,
TaskContext context)
:: DeveloperApi :: Implemented by subclasses to compute a given partition. |
scala.collection.Seq<Dependency<?>> |
getDependencies()
Implemented by subclasses to return how this RDD depends on parent RDDs. |
Partition[] |
getPartitions()
Implemented by subclasses to return the set of partitions in this RDD. |
scala.collection.Seq<String> |
getPreferredLocations(Partition s)
Optionally overridden by subclasses to specify placement preferences. |
scala.collection.Seq<RDD<T>> |
rdds()
|
Methods inherited from class Object |
---|
equals, getClass, hashCode, notify, notifyAll, wait, wait, wait |
Methods inherited from interface org.apache.spark.Logging |
---|
initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning |
Constructor Detail |
---|
public UnionRDD(SparkContext sc, scala.collection.Seq<RDD<T>> rdds, scala.reflect.ClassTag<T> evidence$2)
Method Detail |
---|
public scala.collection.Seq<RDD<T>> rdds()
public Partition[] getPartitions()
RDD
public scala.collection.Seq<Dependency<?>> getDependencies()
RDD
public scala.collection.Iterator<T> compute(Partition s, TaskContext context)
RDD
compute
in class RDD<T>
s
- (undocumented)context
- (undocumented)
public scala.collection.Seq<String> getPreferredLocations(Partition s)
RDD
s
- (undocumented)
public void clearDependencies()
RDD
UnionRDD
for an example.
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |