I published post on the allegro.tech blog, how to integrate Spark Streaming and Kafka. In the blog post you will find how to avoid java.io.NotSerializableException exception when Kafka producer is used for publishing results of the Spark Streaming processing.

http://allegro.tech/spark-kafka-integration.html

You could be also interested in the following part of this blog post where I presented complete library for sending Spark Streaming processing results to Kafka.

Happy reading :-)

Updated:

Comments