Discussion
Work index reindex process take a long time
We have many work objects in our system (more that 1000000). So the reindex process take a long time (Work index size about 24 GB). So please detail for me follow questions:
1. How to increase re-indexing Work index speed?
2. Can we somehow optimize search?
***Updated by moderator: Lochan to update Categories***
2. Can we somehow optimize search? -> Actually the default mechanism which Pega uses is the most optimized one and their is no other way to optimize it further, because huge data = huge index file size = huge space = more time.
Try with the following indexing DSS values to start with and tune accordingly (increase) based on the servers hardware resources (CPU cores and Threads)
indexing/distributed/queue/maxrecords value: 5000
indexing/distributed/batch/numworkers value: 5
indexing/distributed/batch/workqueuesize value: 20000
indexing/distributed/batch/requestbatchsize value: 1000
Thank you for information, I will try change these settings.
And did you had any increase of performance?
No, we will try to use SSD disk for index storage.
Thanks, we also have problems with our index, our index is only a bit bigger 173GB, more then 15.000.000 work objects.
A reindex takes now about 2 weeks time.
Hello,
As the re-index purely depends on the data how much you are trying to re-index, as you are having the huge data it will take the time and i don't see any way to increase the speed of the re-index process.
Regards
Mahesh