Question
Help configuring Kafka Instance
I am trying to create a new Kafka instance with username and password authentication. I have the JVM argument Djava.security.auth.login.config pointing to my jaas config file. When I test connectivity, I get the message:
Connection Failed Error connecting to Kafka. Timeout expired while fetching topic metadata
There is nothing in the PegaRULES or ALERT logs to indicate what the issue is.
On which classes can DEBUG be enabled to get a better idea what is failing?
Thanks for the response Kevin.
Does Pega 8.4.0 support sasl.mechanism=PLAIN security.protocol=SASL_SSL?
Which version of Pega are you using?
Is it external Kafka Queue that part of your enterprise implementation or is it one created pega OOTB as part of Stream node configuration?
Based on Kevin's response it appears you are configuring an external Kafka using open source version. As part of POC effort I have tried in v8.1 version Pega OOTB had success in trying protocol SASL_PLAINTEXT. It supports SCRAM-SHA-256 and Kerberos but not try it.
Opened a Feature to add "SCRAM-SHA-512" Not sure if that is available yet.
We are using Pega 8.4.0 trying to connect to external Kafka using username and password authentication with protocol SASL_SSL and mechanism PLAIN.
Not aware of any, unfortunately. However, since 8.4.2, we have provided an enhancement to allow you load standard kafka client properties files when configuring kafka connection instead of using jvm argument. An example is like this - the idea is that you can test connectivity outside pega using the same file to confirm connectivity as a way of troubleshooting - suggest upgrade to the latest (8.4.3) if not already.
sasl.mechanism=PLAIN security.protocol=SASL_PLAINTEXT sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule required \ username="kafka" \ password="kafka";