Skip to content Skip to sidebar Skip to footer
Showing posts with the label Apache Kafka
Spark Streaming: Read Csv String From Kafka, Write To Parquet

Spark Streaming: Read Csv String From Kafka, Write To Parquet

Post a Comment
There are lots of online examples of reading json from Kafka (to write to parquet) - but I cannot f… Read more Spark Streaming: Read Csv String From Kafka, Write To Parquet
Why Kafka-python Fails To Connect To Bluemix Message Hub Service?

Why Kafka-python Fails To Connect To Bluemix Message Hub Service?

Post a Comment
I'm trying to connect to a Bluemix Message Hub instance on http://bluemix.net. This simple scri… Read more Why Kafka-python Fails To Connect To Bluemix Message Hub Service?
Adding Custom Jars To Pyspark In Jupyter Notebook

Adding Custom Jars To Pyspark In Jupyter Notebook

Post a Comment
I am using the Jupyter notebook with Pyspark with the following docker image: Jupyter all-spark-not… Read more Adding Custom Jars To Pyspark In Jupyter Notebook