Interface | Description |
---|---|
HasOffsetRanges |
:: Experimental ::
Represents any object that has a collection of
OffsetRange s. |
Class | Description |
---|---|
Broker |
:: Experimental ::
Represent the host and port info for a Kafka broker.
|
DirectKafkaInputDStream<K,V,U extends kafka.serializer.Decoder<K>,T extends kafka.serializer.Decoder<V>,R> |
A stream of
KafkaRDD where
each given Kafka topic/partition corresponds to an RDD partition. |
KafkaCluster |
Convenience methods for interacting with a Kafka cluster.
|
KafkaCluster.LeaderOffset | |
KafkaCluster.LeaderOffset$ | |
KafkaCluster.SimpleConsumerConfig |
High-level kafka consumers connect to ZK.
|
KafkaCluster.SimpleConsumerConfig$ | |
KafkaInputDStream<K,V,U extends kafka.serializer.Decoder<?>,T extends kafka.serializer.Decoder<?>> |
Input stream that pulls messages from a Kafka Broker.
|
KafkaRDD<K,V,U extends kafka.serializer.Decoder<?>,T extends kafka.serializer.Decoder<?>,R> |
A batch-oriented interface for consuming from Kafka.
|
KafkaRDDPartition | |
KafkaReceiver<K,V,U extends kafka.serializer.Decoder<?>,T extends kafka.serializer.Decoder<?>> | |
KafkaUtils | |
KafkaUtilsPythonHelper |
This is a helper class that wraps the KafkaUtils.createStream() into more
Python-friendly class and function so that it can be easily
instantiated and called from Python's KafkaUtils (see SPARK-6027).
|
OffsetRange |
:: Experimental ::
Represents a range of offsets from a single Kafka TopicAndPartition.
|
ReliableKafkaReceiver<K,V,U extends kafka.serializer.Decoder<?>,T extends kafka.serializer.Decoder<?>> |
ReliableKafkaReceiver offers the ability to reliably store data into BlockManager without loss.
|