We have a huge data loaded into DDS table and from that source another DF is reading it. We have configured 20 Threads for the Data flow and have 2 Batch Nodes with created 80 Partitions. But issue is when the DF is processing its processing all the records in single partition which is taking time to process all the records.
Can some one please help on how to distribute the data across all the partitions during the DF processing when the source is DDS. If the source is Database Table mapped dataset then we can configure the partition key but not having that option for the DDS.