Posted: 10 Oct 2018 8:15 EDT Last activity: 20 Nov 2018 13:44 EST
Big volume of data processing Real-time in Pega
If we need to handle big volume of data in Pega, what is the best way to do that? Requirement like, need to record all incoming/outgoing calls for customer of a mobile network. There we will have a huge volume of data, what would be the best way to handle, process and store that?
Will it be easy to use some external systems like BigData, Amazon services? If you suggest that, then why? Why can't Pega does that using Data set. Data flow?
While Pega is not a general purpose BigData store nor a Data Warehouse, there are some business use cases for which we have the technology and experience working with BigData and with high volume event streams.
One of the primary use cases has to do with processing incoming streams of data (such as call information in this case) in order to extract important information that can be immediately used for Next Best Action with regards to the customer in question. You can look at Event Strategy Manager and Stream DataSet in Pega 7.4+ for some of building blocks.
Again, this is not about feeding events to Pega in order to just store them. The most useful principle here is to quickly process incoming events and aggregate most useful information real time into an analytical view of the customer. The pattern is to compress the event stream into actioanable information - not to keep data in Pega as a system of record.
Subsequent decisions related to that customer are made using the regular Customer Decision Hub Technology in Pega: Data Flows, Decision Strategies etc.
If your use cases are close to Pega Marketing and/or Customer Decision Hub, I am confident we can provide necessary functionality to work with your event streams.
I should also mention that PegaCloud is a good hosting option for this kind of processing.