@InterfaceStability.Evolving public interface SupportsPushDownFilters extends DataSourceReader
DataSourceReader
. Data source readers can implement this
interface to push down filters to the data source and reduce the size of the data to be read.
Note that, if data source readers implement both this interface and
SupportsPushDownCatalystFilters
, Spark will ignore this interface and only process
SupportsPushDownCatalystFilters
.Modifier and Type | Method and Description |
---|---|
Filter[] |
pushedFilters()
Returns the filters that are pushed in
pushFilters(Filter[]) . |
Filter[] |
pushFilters(Filter[] filters)
Pushes down filters, and returns filters that need to be evaluated after scanning.
|
createDataReaderFactories, readSchema
Filter[] pushFilters(Filter[] filters)
Filter[] pushedFilters()
pushFilters(Filter[])
.
It's possible that there is no filters in the query and pushFilters(Filter[])
is never called, empty array should be returned for this case.