smallnest / Kafka Example In Scala

kafka producer and consumer example in scala and java

you can test with local server.

start zookeeper

if you have installed zookeeper, start it, or run the command:

bin/zookeeper-server-start.sh config/zookeeper.properties

start kafka with default configuration

> bin/kafka-server-start.sh config/server.properties

create a topic

> bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 10 --topic test_topic

package this example

mvn clean package

it will package compiled classes and its dependencies into a jar.

Run the Producer

This example also contains two producers written in Java and in scala. you can run this for java:

java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ProducerExample 10000 test_topic localhost:9092

or this for scala

java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ScalaProducerExample 10000 test_topic localhost:9092

Run the Consumer

This example contains two consumers written in Java and in scala. You can run this for java:

java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ConsumerExample localhost:9092 group1 test_topic 10 0

or this for scala:

java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ScalaConsumerExample localhost:9092 group1 test_topic 10 0