We are trying to use Run Pega Scenario Test step in Deployment manager and using CrossBrowserTesting as the service provider. If we run the Test Suite manually from Dev studio it fails (as some of the test cases are failing and Pass percentage is not 100%) but when we are running the same test suite from deployment manager its passing everytime. Also, the test suite is running in CrossBrowser Testing tool but returning a Pass result always. We are expecting it to fail when the test cases included in the suite don't pass and result is not 100%. So, we are not getting correct results for run Pega Scenario test when used in Deployment manager. Can anyone help with this please.
Thanks for the detailed info, we are able to reproduce this issue in our internal systems. We are actively working on this and the fix will be available in upcoming version (1.3) of PegaTestAutomationKit.
The tentative release date for next release is July 2nd week and it will be available at below link.