Question

10
Replies
1783
Views
MartinS7 Member since 2012 1 post
Vodafone GmbH
Posted: 5 years ago
Last activity: 4 years 11 months ago
Closed
Solved

Is there a way to control either the number of items stored on a data page or its total size on the clipboard?

Hi,

we would like to use a parameterized node scope data page to act as a cache of frequently used static data read from the DB but also be in control of the number of items being put on the clipboard. Size of entries read from DB is about 2 - 6 MB each and their number may grow in the future. So in order to not have all memory used up by this data page we would like to at least restrict the number of items stored on it or ideally even check on the the actual size of the data page on the clipboard (given that this is not hitting performance too much).

Would it be possible to use "Post load processing" activity on the data page in order to have it check the current item count (or total clipboard size) on the data page after each load operation and if a given threshold is crossed, have, for example, the oldest item removed from it? Are there any concurrency considerations to be taken into account when trying to remove an entry this way? Has this been put in place already by someone in this way or another?

Kind regards,

Martin

***Updated by moderator: Lochan to add Categories***

Data Integration User Interface
Moderation Team has archived post
Share this page LinkedIn