Question

9
Replies
673
Views
Premkumar Aravamuthu (PARAVAMU)
American Express Technologies

American Express Technologies
US
PARAVAMU Member since 2012 4 posts
American Express Technologies
Posted: August 16, 2017
Last activity: October 16, 2018
Posted: 16 Aug 2017 10:51 EDT
Last activity: 16 Oct 2018 12:03 EDT
Closed
Solved

Hazelcast / Pega and (Too many open files error) - Few clarifications ...

Config : Pega 7.1.7 , RHEL , WAS 7.x , ORACLE


Issue - Our QA environment reporting Too Many open files ( Auto restart of JVM's)


General recommendations found : Increase ULIMIT value for open files to 65000


Observation : Even after ulimit increase we noticed that open files was increasing (lsof command) .


When checked it was found that hazelcast was having 19 members in the cluster but QA environment had only 8 members altogether.


Other members were from an environment we created long time back with a DB copy of our QA environment. Status nodes table had old dates but had entries. Even after removing the entry from Status node we noticed it was still 19 members.


Action taken : We cleared status nodes table on both environments and DB cache we were able to service restore .



Question :


1) Where is Pega storing the hazelcast cluster information ?


2) How hazelcast identifies the members for its cluster during startup - is there a pega linkage here or it is purely hazelcast framework ?


3) In case of clearing the cluster members for whatever reason - Any other steps we can follow instead of clearing DB Cache tables/ Status nodes ?


4) Is hazelcast continued feature in all latest versions of Pega ?



Thank you,


Prem.



Show More

Config : Pega 7.1.7 , RHEL , WAS 7.x , ORACLE

Issue - Our QA environment reporting Too Many open files ( Auto restart of JVM's)

General recommendations found : Increase ULIMIT value for open files to 65000

Observation : Even after ulimit increase we noticed that open files was increasing (lsof command) .

When checked it was found that hazelcast was having 19 members in the cluster but QA environment had only 8 members altogether.

Other members were from an environment we created long time back with a DB copy of our QA environment. Status nodes table had old dates but had entries. Even after removing the entry from Status node we noticed it was still 19 members.

Action taken : We cleared status nodes table on both environments and DB cache we were able to service restore .

Question :

1) Where is Pega storing the hazelcast cluster information ?

2) How hazelcast identifies the members for its cluster during startup - is there a pega linkage here or it is purely hazelcast framework ?

3) In case of clearing the cluster members for whatever reason - Any other steps we can follow instead of clearing DB Cache tables/ Status nodes ?

4) Is hazelcast continued feature in all latest versions of Pega ?

Thank you,

Prem.

**Moderation Team has archived post**

This post has been archived for educational purposes. Contents and links will no longer be updated. If you have the same/similar question, please write a new post.

Show Less
System Administration
Moderation Team has archived post, This thread is closed to future replies. Content and links will no longer be updated. If you have the same/similar Question, please write a new Question.