Question

2
Replies
186
Views
Close popover
Rogelio Isaac Garza Villarreal (RogelioG2918)
Hitachi, Ltd.

Hitachi, Ltd.
JP
RogelioG2918 Member since 2017 4 posts
Hitachi, Ltd.
Posted: November 5, 2018
Last activity: September 30, 2019
Closed

How to make listeners in two nodes process a single file in a S3 bucket only once?

Hello,

We have a requirement to listen to files in a S3 bucket. We are using PRPC 7.4. The listeners are waiting for the same file in the bucket. We need the files to be processed only once, by either of the nodes. I understand that enabling locks in the files would achieve the desired effect, but the nature of S3 does not allow for that, as far as I know. Is there a way to process the files only once?

Data Integration
Moderation Team has archived post