Question

2
Replies
133
Views
BraamCLSA Member since 2012 90 posts
PEGA
Posted: 2 years ago
Last activity: 2 years 8 months ago
Closed

When does a BIX extract sequence number reset?

We are doing our first tests of BIX 7.3.1 on Pega Cloud. At the moment we are running a CSV extract from Designer Studio by running the pxExtractDataWithArgs activity. The CSV files are packaged in a ZIP file and available via SFTP. The ZIP files are named according to the convention:

BIX_[AppliesToClassOfExtractRule]_[ExtractRuleName]_[SequenceNumber].zip

... where [SequenceNumber] appears to be intended to represent the n'th time that Extract rule has been run, so as to assure uniqueness of the output.

We've run a few sets of extracts on each of three different days, and have noticed that the sequence number resets back to 1 on each day. My guess at the moment is:

* Sequence numbers may be reset each day; AND/OR

* Sequence numbers may be reset when the environment is restarted

... either of which would be an explanation.

The data in the CSV files is not impacted as the pxExtractDateTime field is sufficiently unique. Resetting sequence numbers however is a bad outcome as the filename of the ZIP (and the files it contains) may be duplicated with one produced before the 'reset' event but not yet consumed by the downstream ETL. This would result in data loss as the downstream ETL has no visibility of the file set that was overwritten.

I have workarounds in mind, but would like confirmation of the expected behaviour of the sequence numbering.

***Edited by Moderator Marissa to add SR Details***

Data Integration SR Exists
Moderation Team has archived post
Share this page LinkedIn