Ratan Member since 2015 59 posts
Posted: 6 months ago
Last activity: 5 months 2 weeks ago

Data flow Partitions

How does the system derive the number of partitions to execute a data flow? Say I have a node (10 cores) configured as a dataflow node. Say the thread count is set up to 1 when we create a Batch processing data flow work object. How many partitions would be the system create? Does that depend on the data? If so, how would the data affect the partitions created by the data flow?

Assume that we are processing 100 records with partition keys distributed across 0 to 9.

***Edited by Moderator: Pallavi to change content type from Discussion to Question***  

Pega Marketing 8.3 Decision Management Communications and Media Lead System Architect Decisioning Consultant
Share this page LinkedIn