After starting the Cassandra JVM, the Pega Platform tries to connect on local Cassandra JMX port (default 7199) to control the instance.
With WebLogic default security configuration, despite Cassandra JVM being correctly started and the JMX port being open and reachable (note it is local and bound to localhost), the Platform will indefinitely wait for connection to the JMX port to successfully complete.
In the WebLogic managed server log, the following message will show every second:
Note that the class java.rmi.server.RemoteObject is the one shown in the log message.
Similarly, after starting the Kafka JVM, the Pega Platform tries to connect on local Kafka JMX port (default 9999) to control the instance. In this case, add the following to the Pega Platform JVM parameters:
Thank you for this ..This solved the problem and saved my day !
After applying WLS patch : Patch 30675853: WLS PATCH SET UPDATE 22.214.171.124.191217(ID:191217.1425) | Release Date : 14-Jan-2020
Cassandra and Kafka process took ages to startup, the node kept crashing on start up was showing up with warning in the Weblogic console with stuck threads
Admin studio was not showing the nodes that were assinged DDS, ADM, Stream, Search in Running state
Dev studio it was either showing as Joining / Joining Failed for DDS , ADM, Stream .
WebUser nodes were failing with the below error as well
'com.pega.dsm.dnode.impl.cassandra.DdsLoggingHelper$UpdateQueryLoggersJob' was unable to be completed. (com.hazelcast.spi.exception.RetryableHazelcastException) HazelcastInstance[[IP]:PORT] is not active!
(.PresenceLifeCycleEventManager) ERROR <hostname>|<ip> operatorid - Failed to update session state for requestor with ID: <Requestor ID>
com.hazelcast.core.HazelcastInstanceNotActiveException: State: SHUT_DOWN Operation: class com.hazelcast.map.impl.query.QueryPartitionOperation
After adding the 2 JVM arguments mentioned above to all nodes it worked like a charm. Thanks again.
Might help if the SA-88049 could be amended to reflect the same , missing out on java.rmi.server.RemoteObjectInvocationHandler