Question
Running BIX extract concurrently on multiple servers
Currently in our company, BIX script run on single Linux server every day but It taking 5 to 6 hours to run. Because of poor performance, We decided to divide our BIX script to run parallel on multiple server at same time. In production we have 25 BIX extract rules so we are planning to divide these 25 BIX extract rules across multiple servers. Our concerns are 1. Is BIX designed to run on only one server or Is it possible to run on multiple servers at a time? 2. Pega database is on single node so even if we divide BIX extract rules on multiple server still all Extract will point to same database. Is there any serious contention if we run long queries simultaneously against the one db/table?
***Updated by moderator: Lochan to update Categories; add SR Exists group tag***
Hi Harijinder,
Further to above comment,
Based on the load on the database and the application server, it is good to have this scheduled when the load is less as data is extracted from the source database.
The scripts for BIX can modified to run multiple extracts. Please note that the information on which rulebase to connect to comes from the prconfig.xml file in the BIX command line scripts directory. You can use a single BIX command line to extract data from multiple PRPC installations provided, if you can change the required information about the extract rule to run and the database configurations settings. Generally though, users tend to create copies of the extraction scripts for each PRPC installation.
Note that you can run all of these in parallel.
Hi Harjinder,
I came across the below BIX FAQs link, which may give answer for your query.
https://pdn.pega.com/business-intelligence-exchange-bix-version-21-frequently-asked-questions/business-intelligence#Q16
Can I extract data concurrently from multiple Process Commander databases?
You cannot concurrently extract from multiple Process Commander databases or even different database instances on the same machine. Each extraction can have only a single data source. A single extraction may reference multiple extract rules within the same Process Commander database instance. A single extraction can, however, extract to different target or destination databases or files as defined in the extract rules. You can also have different extractions running concurrently as separate BIX processes that extract from multiple Process Commander databases.
Thanks