org.apache.spark.mllib.stat.correlation

Class SpearmanCorrelation

Object

org.apache.spark.mllib.stat.correlation.SpearmanCorrelation

public class SpearmanCorrelation
extends Object

Compute Spearman's correlation for two RDDs of the type RDD[Double] or the correlation matrix for an RDD of the type RDD[Vector].

Definition of Spearman's correlation can be found at http://en.wikipedia.org/wiki/Spearman's_rank_correlation_coefficient

Constructor Summary

Constructors

Constructor and Description
SpearmanCorrelation()

Method Summary

Modifier and Type	Method and Description
static double	computeCorrelation(RDD<Object> x, RDD<Object> y) Compute Spearman's correlation for two datasets.
static Matrix	computeCorrelationMatrix(RDD<Vector> X) Compute Spearman's correlation matrix S, for the input matrix, where S(i, j) is the correlation between column i and j.
static double	computeCorrelationWithMatrixImpl(RDD<Object> x, RDD<Object> y)
static void	org$apache$spark$internal$Logging$$log__$eq(org.slf4j.Logger x$1)
static org.slf4j.Logger	org$apache$spark$internal$Logging$$log_()

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SpearmanCorrelation

public SpearmanCorrelation()

Method Detail

computeCorrelation

public static double computeCorrelation(RDD<Object> x,
                                        RDD<Object> y)

Compute Spearman's correlation for two datasets.

Parameters:

x - (undocumented)

y - (undocumented)

Returns:

(undocumented)

computeCorrelationMatrix

public static Matrix computeCorrelationMatrix(RDD<Vector> X)

Compute Spearman's correlation matrix S, for the input matrix, where S(i, j) is the correlation between column i and j.

Parameters:

X - (undocumented)

Returns:

(undocumented)

computeCorrelationWithMatrixImpl

public static double computeCorrelationWithMatrixImpl(RDD<Object> x,
                                                      RDD<Object> y)

org$apache$spark$internal$Logging$$log_

public static org.slf4j.Logger org$apache$spark$internal$Logging$$log_()

org$apache$spark$internal$Logging$$log__$eq

public static void org$apache$spark$internal$Logging$$log__$eq(org.slf4j.Logger x$1)