Question

1
Replies
223
Views
Moritaka Kanai (kanam)
ServiceNow
Platform Solution Consultant
ServiceNow
JP
kanam Member since 2012 58 posts
ServiceNow
Posted: May 1, 2017
Last activity: May 5, 2017
Posted: 1 May 2017 2:48 EDT
Last activity: 5 May 2017 7:58 EDT
Closed

Guidelines or Tips for Crawling the Internet Web Sites

Hi. Do we have any guidelines or tips for crawling the Internet Web sites with Pega Robotics?

For example, Yahoo Web site's search function seems to restrict robot's access in a row. As far as I tested, it returns the warning page after accessing it approximately 50 times consecutively. But it worked fine after I put 10-second think times between each iterations.

One of our customers is concerned on the robustness of our Automation executions in this perspective. Can we say something on this subject?

Robotic Process Automation
Moderation Team has archived post, This thread is closed to future replies. Content and links will no longer be updated. If you have the same/similar Question, please write a new Question.