Question

3
Replies
158
Views
Close popover
Ratan Balaji (Ratan)
Areteans
Lead Consultant
Areteans
AU
Ratan Member since 2015 59 posts
Areteans
Posted: April 27, 2020
Last activity: May 10, 2020

Data flow Partitions

How does the system derive the number of partitions to execute a data flow? Say I have a node (10 cores) configured as a dataflow node. Say the thread count is set up to 1 when we create a Batch processing data flow work object. How many partitions would be the system create? Does that depend on the data? If so, how would the data affect the partitions created by the data flow?

Assume that we are processing 100 records with partition keys distributed across 0 to 9.

***Edited by Moderator: Pallavi to change content type from Discussion to Question***  

Pega Marketing 8.3 Decision Management Communications and Media Lead System Architect Decisioning Consultant