Create an input stream that pulls messages from a Kafka Broker.
Create an input stream that pulls messages from a Kafka Broker.
Map of kafka configuration paramaters. See: http://kafka.apache.org/configuration.html
Map of (topic_name -> numPartitions) to consume. Each partition is consumed in its own thread.
Storage level to use for storing the received objects
Create an input stream that pulls messages from a Kafka Broker.
Create an input stream that pulls messages from a Kafka Broker.
Zookeper quorum (hostname:port,hostname:port,..).
The group id for this consumer.
Map of (topic_name -> numPartitions) to consume. Each partition is consumed in its own thread.
Storage level to use for storing the received objects (default: StorageLevel.MEMORY_AND_DISK_SER_2)
A wrapper around StreamingContext for exposing Kafka functions. This is done in a separate class so that programs that don't use Kafka don't need to link against it. In Scala, an implicit conversion in StreamingContext allows one to call these functions.