Question
3
Replies
264
Views
X
Sun Life Financial Company
Posted: 10 months ago
Last activity: 10 months 2 weeks ago
org.apache.kafka.common.errors.InterruptException in logs
Hi,
We are seeing lot of kafka exceptions in the log even though we are not using Kafka broker. Does it affect the system? How can it be suppressed?
BrokerSession[brokerId=1047,broker=Broker[endpoints=PLAINTEXT://159.208.196.160:1090,jmxPort=1092,rack=null,version=4],startTime=1566404266237,lastSeen=1566576587280,prpcNode=1c8d9f67b38cf47d7e997388979e6f60]BrokerSession[brokerId=1046,broker=Broker[endpoints=PLAINTEXT://159.208.196.159:1190,jmxPort=1192,rack=null,version=4],startTime=1566532851976,lastSeen=1566576578292,prpcNode=df8e69d3ba0e660dac458184e4f12564]BrokerSession[brokerId=1045,broker=Broker[endpoints=PLAINTEXT://159.208.196.159:1090,jmxPort=1092,rack=null,version=4],startTime=1566418645832,lastSeen=1566576580343,prpcNode=47bd5bcb5d4cfd54214b202b6ff24d2a]BrokerSession[brokerId=1042,broker=Broker[endpoints=PLAINTEXT://159.208.196.18:7010,jmxPort=7030,rack=null,version=4],startTime=1566317575507,lastSeen=1566576584022,prpcNode=aadfc5717fb3d7eade65be28f187b33f]BrokerSession[brokerId=1044,broker=Broker[endpoints=PLAINTEXT://159.208.196.18:8010,jmxPort=8030,rack=null,version=4],startTime=1566505764889,lastSeen=1566576582165,prpcNode=22fbb468ae8fae964110a730a819bdde]]org.apache.kafka.common.errors.InterruptException: java.lang.InterruptedExceptionat org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.maybeThrowInterruptException(ConsumerNetworkClient.java:428) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:248) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:208) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:199) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.awaitMetadataUpdate(ConsumerNetworkClient.java:134) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.Fetcher.retrieveOffsetsByTimes(Fetcher.java:470) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.Fetcher.beginningOrEndOffset(Fetcher.java:500) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.internals.Fetcher.endOffsets(Fetcher.java:485) ~[kafka-clients-0.11.0.3.jar:?]at org.apache.kafka.clients.consumer.KafkaConsumer.endOffsets(KafkaConsumer.java:1536) ~[kafka-clients-0.11.0.3.jar:?]at com.pega.dsm.dnode.impl.dataset.kafka.features.KafkaResumableFeature$KafkaLagDetector.compute(KafkaResumableFeature.java:184) ~[d-node-8.2.2-354.jar:?]at com.pega.dsm.dnode.impl.dataset.kafka.features.KafkaResumableFeature$KafkaLagDetector.compute(KafkaResumableFeature.java:153) ~[d-node-8.2.2-354.jar:?]at com.pega.dsm.dnode.impl.dataflow.asyncexecutor.QueueProcessorDataSetOperationsImpl.getLag(QueueProcessorDataSetOperationsImpl.java:266) ~[d-node-8.2.2-354.jar:?]at com.pega.platform.executor.queueprocessor.internal.QueueProcessorManagementOperationsImpl$LagCalculator.execute(QueueProcessorManagementOperationsImpl.java:279) ~[pega-executor.jar:?]at com.pega.platform.executor.queueprocessor.internal.BatchTask.lambda$executeInBorrowedRequestor$0(BatchTask.java:69) ~[pega-executor.jar:?]at com.pega.platform.executor.queueprocessor.internal.BatchTask$$Lambda$2017.0000000068732A00.run(Unknown Source) ~[?:?]at com.pega.pegarules.session.internal.PRSessionProviderImpl.performTargetActionWithLock(PRSessionProviderImpl.java:1371) ~[prprivate.jar:?]at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:1114) ~[prprivate.jar:?]at com.pega.pegarules.session.internal.PRSessionProviderImpl.doWithRequestorLocked(PRSessionProviderImpl.java:995) ~[prprivate.jar:?]at com.pega.pegarules.session.internal.PRSessionProviderImplForModules.doWithRequestorLocked(PRSessionProviderImplForModules.java:55) ~[prprivate.jar:?]at com.pega.platform.executor.queueprocessor.internal.BatchTask.executeInBorrowedRequestor(BatchTask.java:65) ~[pega-executor.jar:?]at com.pega.platform.executor.queueprocessor.internal.BatchTask.run(BatchTask.java:40) ~[pega-executor.jar:?]at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:522) ~[?:1.8.0]at java.util.concurrent.FutureTask.run(FutureTask.java:277) ~[?:1.8.0]at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160) [?:1.8.0]at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:1.8.0]at java.lang.Thread.run(Thread.java:811) [?:2.9 (07-31-2018)]Caused by: java.lang.InterruptedException... 26 more
Posted: 10 months ago
Pega OOTB uses kafka (hosted on stream nodes, i.e., nodetype of Stream) for queue processing in pega 8.x (you are running 8.2.2?), see this link
https://community.pega.com/knowledgebase/queue-processor-faq.
We recommend specific node type for different nodes (i.e., for Foreground node, use -DNodeType=WebUser).
What exactly is your NodeType? Are you using 'Universal' node type?
Posted: 10 months ago
KevinZheng_GCS It's not set. And this is the development environment and has one node only. Won't setting up a node type to "WebUser" suppress BackgroundProcessing queue processors (since there is only one node)?
Posted: 10 months ago
It would. You can set -DNodeType=WebUser,BackgroundProcessing,Stream. In Pega Infinity, Stream is required for queue processing. What is your exact version (including patch version)? If this is happening consistently, please attach the entire log file.