|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
Object org.apache.spark.ml.PipelineStage org.apache.spark.ml.Estimator<IDFModel> org.apache.spark.ml.feature.IDF
public final class IDF
:: Experimental :: Compute the Inverse Document Frequency (IDF) given a collection of documents.
Constructor Summary | |
---|---|
IDF()
|
|
IDF(String uid)
|
Method Summary | |
---|---|
IDF |
copy(ParamMap extra)
Creates a copy of this instance with the same UID and some extra params. |
IDFModel |
fit(DataFrame dataset)
Fits a model to the input data. |
int |
getMinDocFreq()
|
IntParam |
minDocFreq()
The minimum of documents in which a term should appear. |
IDF |
setInputCol(String value)
|
IDF |
setMinDocFreq(int value)
|
IDF |
setOutputCol(String value)
|
StructType |
transformSchema(StructType schema)
:: DeveloperApi :: |
String |
uid()
|
StructType |
validateAndTransformSchema(StructType schema)
Validate and transform the input schema. |
Methods inherited from class org.apache.spark.ml.Estimator |
---|
fit, fit, fit, fit |
Methods inherited from class Object |
---|
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Methods inherited from interface org.apache.spark.ml.param.Params |
---|
clear, copyValues, defaultCopy, defaultParamMap, explainParam, explainParams, extractParamMap, extractParamMap, get, getDefault, getOrDefault, getParam, hasDefault, hasParam, isDefined, isSet, paramMap, params, set, set, set, setDefault, setDefault, setDefault, shouldOwn, validateParams |
Methods inherited from interface org.apache.spark.Logging |
---|
initializeIfNecessary, initializeLogging, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning |
Constructor Detail |
---|
public IDF(String uid)
public IDF()
Method Detail |
---|
public String uid()
public IDF setInputCol(String value)
public IDF setOutputCol(String value)
public IDF setMinDocFreq(int value)
public IDFModel fit(DataFrame dataset)
Estimator
fit
in class Estimator<IDFModel>
dataset
- (undocumented)
public StructType transformSchema(StructType schema)
PipelineStage
Derives the output schema from the input schema.
transformSchema
in class PipelineStage
schema
- (undocumented)
public IDF copy(ParamMap extra)
Params
copy
in interface Params
copy
in class Estimator<IDFModel>
extra
- (undocumented)
defaultCopy()
public IntParam minDocFreq()
public int getMinDocFreq()
public StructType validateAndTransformSchema(StructType schema)
schema
- (undocumented)
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |