org.apache.spark.sql.sources

Interface PrunedFilteredScan

public interface PrunedFilteredScan

A BaseRelation that can eliminate unneeded columns and filter using selected predicates before producing an RDD containing all matching tuples as Row objects.

The actual filter should be the conjunction of all filters, i.e. they should be "and" together.

The pushed down filters are currently purely an optimization as they will all be evaluated again. This means it is safe to use them with methods that produce false positives such as filtering partitions based on a bloom filter.

Since:

1.3.0

Method Summary

Modifier and Type	Method and Description
RDD<Row>	buildScan(String[] requiredColumns, Filter[] filters)

Method Detail

buildScan

RDD<Row> buildScan(String[] requiredColumns,
                   Filter[] filters)