Discussion
Work index reindex process take a long time
We have many work objects in our system (more that 1000000). So the reindex process take a long time (Work index size about 24 GB). So please detail for me follow questions:
1. How to increase re-indexing Work index speed?
2. Can we somehow optimize search?
***Updated by moderator: Lochan to update Categories***
2. Can we somehow optimize search? -> Actually the default mechanism which Pega uses is the most optimized one and their is no other way to optimize it further, because huge data = huge index file size = huge space = more time.
Try with the following indexing DSS values to start with and tune accordingly (increase) based on the servers hardware resources (CPU cores and Threads)
indexing/distributed/queue/maxrecords value: 5000
indexing/distributed/batch/numworkers value: 5
indexing/distributed/batch/workqueuesize value: 20000
indexing/distributed/batch/requestbatchsize value: 1000
Thanks, we also have problems with our index, our index is only a bit bigger 173GB, more then 15.000.000 work objects.
A reindex takes now about 2 weeks time.
Hello,
As the re-index purely depends on the data how much you are trying to re-index, as you are having the huge data it will take the time and i don't see any way to increase the speed of the re-index process.
Regards
Mahesh