Package org.apache.spark.mllib.stat.test

Interface StreamingTestMethod

All Superinterfaces:
Serializable
public interface StreamingTestMethod extends Serializable
Significance testing methods for StreamingTest. New 2-sample statistical significance tests should extend StreamingTestMethod and introduce a new entry in StreamingTestMethod.TEST_NAME_TO_OBJECT

  • Method Summary

    Modifier and Type
    Method
    Description
    DStream<org.apache.spark.mllib.stat.test.StreamingTestResult>
    doTest(DStream<scala.Tuple2<StatCounter,StatCounter>> sampleSummaries)
    Perform streaming 2-sample statistical significance testing.
    String
    methodName()
     
    String
    nullHypothesis()
     
    org.apache.commons.math3.stat.descriptive.StatisticalSummaryValues
    toApacheCommonsStats(StatCounter summaryStats)
    Implicit adapter to convert between streaming summary statistics type and the type required by the t-testing libraries.

  • Method Details

    • methodName

      String methodName()

    • nullHypothesis

      String nullHypothesis()

    • doTest

      DStream<org.apache.spark.mllib.stat.test.StreamingTestResult> doTest(DStream<scala.Tuple2<StatCounter,StatCounter>> sampleSummaries)
      Perform streaming 2-sample statistical significance testing.

      Parameters:
      sampleSummaries - stream pairs of summary statistics for the 2 samples
      Returns:
      stream of rest results

    • toApacheCommonsStats

      org.apache.commons.math3.stat.descriptive.StatisticalSummaryValues toApacheCommonsStats(StatCounter summaryStats)
      Implicit adapter to convert between streaming summary statistics type and the type required by the t-testing libraries.
      Parameters:
      summaryStats - (undocumented)
      Returns:
      (undocumented)