Question
Increasing Thread Count in Stream Node and Custom Node
Is it safe to increase the thread count of a stream node or a custom node? How does it impact performance of the platform ? how to increase the number of threads and what should be the max limit for each queue processor?
Hi Brett,
Thank you for your response.
I had a follow up question. How do we increase the thread count for a custom node or a stream node?
Thanks.
You set the "number of threads per node" on the Queue Processor rule form. But keep in mind that this is the maximum number per node for this queue processor and only 20 total threads across the cluster can process messages.
More information is available here: https://community.pega.com/knowledgebase/articles/system-administration/queue-processor-faq
Hi Brett,
Thank you for the information. I understand that the maximum thread count of a cluster should not be more than 20. Howvever, I do have a question around changing the value in Admin Studio. How do we permanently change the thread count for pyProcessNotification and pyFTSIncrementalIndexer? I can only see a private edit option while trying to increase the thread count (Screenshot Attached).
Thanks.
Hi Brett,
We are looking at adding a permanent DSS setting may be that helps increasing the thread count.
The idea is to make a permanent change.
Thanks.
You can save a copy of the OOTB pyFTSIncrementalIndexer rule into an application ruleset with an increased number of threads. Then go to Configure -> General -> System Runtime Context. Add your application to the list. Then after the node restarts, it will use the customized rule.
The maximum number of threads per Queue Processor is 20. More threads will require more CPU and heap, so you should monitor resources on the host server to determine if it can handle the load.