RogelioG2918 Member since 2017 4 posts
Hitachi, Ltd.
Posted: 1 year ago
Last activity: 11 months 3 weeks ago

How to make listeners in two nodes process a single file in a S3 bucket only once?


We have a requirement to listen to files in a S3 bucket. We are using PRPC 7.4. The listeners are waiting for the same file in the bucket. We need the files to be processed only once, by either of the nodes. I understand that enabling locks in the files would achieve the desired effect, but the nature of S3 does not allow for that, as far as I know. Is there a way to process the files only once?

Data Integration
Share this page LinkedIn