Question
2
Replies
66
Views
GM Onstar
Posted: September 20, 2019
Last activity: September 30, 2019
Closed
Real time dataflow with Kafka not distributed
Realtime data flow does not get distributed to all real time nodes .
Starting Kafka Data set has Partitions set
scoringPartitionKey is set in the topic message the real time data flow is listening to.
{....."scoringPartitionKey":107...........}
appreciate if someone could share details of how to set up the data flow to run on all Realtime nodes.
***Edited by Moderator: Lochan to update platform capability tags***
***Edited by Moderator Marissa to update SR Details***
Posted: 1 year ago
Kevin, nice from hear from you. The number of partitions was only 1 . we increased to 50 and now the load gets distributed to all 12 nodes . Thank you
Sree,
How many partitions are there in your external kafka topic? Looks like only 1. Can you confirm?