Question
2
Replies
186
Views
Hitachi, Ltd.
Posted: November 5, 2018
Last activity: September 30, 2019
Closed
How to make listeners in two nodes process a single file in a S3 bucket only once?
Hello,
We have a requirement to listen to files in a S3 bucket. We are using PRPC 7.4. The listeners are waiting for the same file in the bucket. We need the files to be processed only once, by either of the nodes. I understand that enabling locks in the files would achieve the desired effect, but the nature of S3 does not allow for that, as far as I know. Is there a way to process the files only once?
If both the nodes belong to the same Pega cluster, only one thread of a given file listener across the cluster will process a single file. The processing thread holds a cluster level lock inside Pega (not the file lock) to ensure that only one file listener is processing a given file.