Posted: 18 Mar 2020 6:32 EDT Last activity: 19 Mar 2020 6:27 EDT
Exporting Realtime Interaction History
My client wants to export Interaction History to their Data Lake, and for consumption by peer systems preferably in near real-time. Traditionally I would endorse BIX or an ETL solution, but this typically introduces significant latency into the delivery of the data. ETL solutions often also limit the scope of the data - being unable to include Proposition, Customer, or Strategy Result properties without first modifying the IH schema.
Can I extend the response handling logic to stream IH responses for external consumption? Is the Data Flow rule DF_ProcessResponse and appropriate customisation point? Where else might changes be required e.g. Delayed Learning.
With Pega 8.3, we introduced a new feature called data migration to get cutomer, IH and ADM data from the production environment into the simulation environment. I agree that the feature might not fit the near real-time solution that you are looking for. But I feel it is worth exploring given that you also have a requirement to move customer data.