Bhushan Patil (BHUSHANPATIL)
Cognizant Technology Solutions
Bhushan Patil
Cognizant Technology Solutions
BHUSHANPATIL Member since 2008 49 posts
Cognizant Technology Solutions
Posted: May 26, 2020
Last activity: March 15, 2021
Posted: 26 May 2020 12:27 EDT
Last activity: 15 Mar 2021 9:20 EDT

Queue processor stream are duplicating reprocessing of kafka stream at retention

We are using Queue processor methodology - dedicated queue for real time event push to reporting system. We didn't had duplciate issue with lagecy "connect queue" agent processing, but queue processor kafka we are seeing issue "same message is coming to processing again after couple of hours [even it had processed prior] ". Please help to resolve this duplicate execution every day we are seeing ~ 250 messages; looks like it happen at retention cleanup time.( I think so)

it hard to trace queue processor in 1.2 -1.5 million event and pattern i am seeing after 8 -12 hours at might duplication  

Pega Platform System Administration Healthcare and Life Sciences Lead System Architect