Close popover
Adrien Miller (AdrienM3)

AdrienM3 Member since 2019 12 posts
Posted: January 24, 2020
Last activity: January 24, 2020

kafka in clustering env


We are setting up a pega cluster for the first time (we are starting on a fresh pega env (bdd, 2 jboss nodes).

Kafka won't run on more than one node (we see the starting failures in the logs).

A search in the knowledge base / pega community explains that we have to change the borker id in the prconfig.xml : one different broker id on each jboss pega node.

After that, both kafka instances go up (a ps -ef shows the process). See "jboss et kafka.jpg" attatchment)

In the logs (logs.txt) though, on linux2, we see that it's trying to access kafka 1 / linux1.
Is that normal ? (it can't manage because the start wasn't finished)

Is the normal behaviour : every pega instance access every kafka instance ?
or does every pega instance should have it's own kafka instance ?
is there a system to replicate the content of a kafka instance on another one in case of a crash ?

Best regards

***Edited by Moderator Marissa to update platform capability tags****

System Administration