As part of this topic, let us validate streaming data pipeline built using Kafka Connect, Kafka, Spark Structured Streaming and HBase on multi node cluster. We will ship fat jar on to gateway node of the cluster and then run using spark-submit command and validate whether data is flowing from web server logs into HBase Table.
If you need environment to practice this kind of scenarios, you can sign up by going to [ Ссылка ]
Connect with me or follow me at
[ Ссылка ]
[ Ссылка ]
[ Ссылка ]
[ Ссылка ]
[ Ссылка ]
