Posted: 23 Jul 2020 10:56 EDT Last activity: 27 Aug 2020 21:47 EDT
Set the pyFilePath for a File Dataset
Can anyone suggest how to set the pyFilePath for a file Dataset programatically? It doesn't seem to support the GRS syntax. The following article suggests we can create unique filenames (by including a formatted timestamp).
I need to be able to read the file path from a Dynamic System Setting as it varies within our environments. Currently I am proposing to write out to a 'temp' folder and move the file as part of Data Flow post-processing.
Yes, looks like, File Dataset doesn't support GRS support for dynamically pyFilePath setup. And this looks to be a Product enhancement idea.
By referring your solution : ' to write out to a 'temp' folder and move the file as part of Data Flow post-processing'
if I decode properly (please correct me if I am wrong):
Dataset should defaulted to 'defaultstore' repository so that system can write the DF results to temp directory.
Post-processing activity of DF will do a Connect-FTP kind of a operation referring the location mentioned in DSS to move from temp.
Cleanup of temp directory.
It looks to be a bit overhead job(3 step process) to me as I can assume system has access to the DSS location. So if that path mentioned in Dataset which is a 1-step job . I would like to know more about your actual usecase you want to achieve here.
The issue is that we have agreed a file location in the FTP server with an external system, that includes an environment-specific path. We are keen to keep this as it protects us against mistakes (running the wrong test scripts against the wrong endpoint). The path we are using is the repository location (using the Pega Cloud repository folder mount pattern).
We are now plannig to move the file in post-processing, but just wondered if there was a clever way to override the pyFilePath at runtime.
Given that we have a limitation with Dynamic Resource Path within repository rule, we can create a Linux/Mac Soft Link in every environment. This link may have different values across multiple environments as they will be defined at server level. Define the Soft Link as the resource path within Repository rule.