Hi Nick,

I have 3 physical servers and deployed ignite on all 3 of them . So there are 3 instances of ignite servers across multiple servers. Below is the prconfig.xml for ignite

<?xml version="1.0" encoding="UTF-8"?>

<pegarules>

        <!-- This is a minimum format prconfig.xml file.  Only the settings which are required to access settings in the database are included.

        All other settings which were formerly located only in this file are now Data-Admin-System-Settings.      -->

        <env name="initialization/settingsource" value="merged" />

        <env name="database/databases/PegaRULES/dataSource" value="java:comp/env/jdbc/PegaRULES"/>

        <env name="database/databases/PegaDATA/dataSource" value="java:comp/env/jdbc/PegaRULES"/>

        <env name="security/urlaccesslog" value="NORMAL" />

        <env name="security/urlaccessmode" value="WARN" />

        <env name="cluster/clientserver/clientmode" value="true" />

        <env name="identification/cluster/protocol" value="ignite" />

</pegarules>

Also I have opened following ports for ignite 47100/tcp, 47500/tcp,49112/tcp,5701/tcp .

What I have noticed is once all the 3 ignite servers starts of, one of them fails due to above exception and exits from the server topology

[14:10:02] (wrn) Failed to resolve IGNITE_HOME automatically for class codebase [class=class o.a.i.i.util.IgniteUtils, e=URI scheme is not "file"]

[14:10:16]    __________  ________________

[14:10:16]   /  _/ ___/ |/ /  _/_  __/ __/

[14:10:16]  _/ // (7 7    // /  / / / _/

[14:10:16] /___/\___/_/|_/___/ /_/ /___/

[14:10:16]

[14:10:16] ver. 1.7.0#20160802-sha1:383273e3

[14:10:16] 2016 Copyright(C) Apache Software Foundation

[14:10:16]

[14:10:16] Ignite documentation: http://ignite.apache.org

[14:10:16]

[14:10:16] Quiet mode.

[14:10:16]   ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat}

[14:10:16]

[14:10:16] OS: Linux 3.10.0-514.26.2.el7.x86_64 amd64

[14:10:16] VM information: Java(TM) SE Runtime Environment 1.8.0_60-b27 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.60-b23

[14:10:17] Initial heap size is 250MB (should be no less than 512MB, use -Xms512m -Xmx512m).

[14:10:30] Configured plugins:

[14:10:30]   ^-- None

[14:10:30]

[14:10:57] Security status [authentication=off, tls/ssl=off]

2017-07-31 14:12:02,839 [                main] [          ] [                    ] [                    ] (internal.ClusterServiceJdbcDAO) INFO    - Updating addresses into the database. Current Timestamp: 04:12:02.839

2017-07-31 14:12:32,461 [-msg-worker-#2%PRPC%] [          ] [                    ] [                    ] (internal.ClusterServiceJdbcDAO) INFO    - Updating addresses into the database. Current Timestamp: 04:12:32.461

[14:12:32] Topology snapshot [ver=2, servers=2, clients=0, CPUs=8, heap=1.8GB]

2017-07-31 14:12:34,430 [-msg-worker-#2%PRPC%] [          ] [                    ] [                    ] (internal.ClusterServiceJdbcDAO) INFO    - Updating addresses into the database. Current Timestamp: 04:12:34.430

[14:12:34] Topology snapshot [ver=3, servers=3, clients=0, CPUs=9, heap=2.7GB]

[14:13:51] Performance suggestions for grid 'PRPC' (fix if possible)

[14:13:51] To disable, set -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true

[14:13:51]   ^-- Disable grid events (remove 'includeEventTypes' from configuration)

[14:13:51]   ^-- Use default binary marshaller (do not set 'marshaller' explicitly)

[14:13:51]

[14:13:51] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat}

[14:13:51]

[14:13:51] Ignite node started OK (id=3ea01093, grid=PRPC)

[14:13:51] Topology snapshot [ver=3, servers=3, clients=0, CPUs=9, heap=2.7GB]

2017-07-31 14:14:02,946 [                main] [          ] [                    ] [                    ] (l.util.IgniteMembershipManager) INFO    - New member joined cluster: Member: [name=pega_clustermgr_dev-01, address=server1/xxxxxx:5701, uuid=3ea01093-3db9-46d6-934b-b5ed57462199, mode=SERVER]

2017-07-31 14:14:04,461 [                main] [          ] [                    ] [                    ] (.util.ClusterMembershipManager) INFO    - Members [3] {

2017-07-31 14:14:04,461 [                main] [          ] [                    ] [                    ] (.util.ClusterMembershipManager) INFO    -    Member: [name=pega_clustermgr_dev-01, address=server2/xxxxxxx:5701, uuid=3ea01093-3db9-46d6-934b-b5ed57462199, mode=SERVER]  <== THIS node <== NEW node

2017-07-31 14:14:04,461 [                main] [          ] [                    ] [                    ] (.util.ClusterMembershipManager) INFO    -    Member: [name=pega_clustermgr_dev-01, address=server3/xxxxxxx:5701, uuid=94fc87d9-943c-4a2a-aabf-1722aef9bad0, mode=SERVER]

2017-07-31 14:14:04,461 [                main] [          ] [                    ] [                    ] (.util.ClusterMembershipManager) INFO    -    Member: [name=pega_clustermgr_dev-01, address=server2/xxxxxxxx:5701, uuid=fbc33447-efa7-49f3-a2e7-7c73bd19bb9f, mode=SERVER]

2017-07-31 14:14:04,461 [                main] [          ] [                    ] [                    ] (.util.ClusterMembershipManager) INFO    - }

2017-07-31 14:14:04,461 [                main] [          ] [                    ] [                    ] (uster.internal.ClusterProvider) INFO    - Successfully joined cluster PRPC as Member: [name=pega_clustermgr_dev-01, address=server1/xxxxxxxxx:5701, uuid=3ea01093-3db9-46d6-934b-b5ed57462199, mode=SERVER].

2017-07-31 14:23:15,114 [der-cleaner-#4%PRPC%] [          ] [                    ] [                    ] (internal.ClusterServiceJdbcDAO) INFO    - Updating addresses into the database. Current Timestamp: 04:23:15.113

2017-07-31 14:24:15,176 [der-cleaner-#4%PRPC%] [          ] [                    ] [                    ] (internal.ClusterServiceJdbcDAO) INFO    - Updating addresses into the database. Current Timestamp: 04:24:15.176

2017-07-31 14:24:15,221 [der-cleaner-#4%PRPC%] [          ] [                    ] [                    ] (internal.ClusterServiceJdbcDAO) ERROR   - Failed to get registered addresses

java.sql.BatchUpdateException: ORA-00001: unique constraint (DATA_SCHEMA.PRPC_IGNITE_SERVER_ADDR_PK) violated

    at oracle.jdbc.driver.OraclePreparedStatement.executeBatch(OraclePreparedStatement.java:11190) ~[ojdbc7.jar:12.1.0.1.0]

    at oracle.jdbc.driver.OracleStatementWrapper.executeBatch(OracleStatementWrapper.java:244) ~[ojdbc7.jar:12.1.0.1.0]

    at com.pega.pegarules.configdbcp.dbcp.DelegatingStatement.executeBatch(DelegatingStatement.java:297) ~[prdbcp-7.3.0-77.jar:7.3.0-77]

    at com.pega.platform.cluster.internal.ClusterServiceJdbcDAO.registerAddresses(ClusterServiceJdbcDAO.java:217) ~[cluster-impl.jar:?]

    at com.pega.platform.cluster.internal.JdbcNodesProvider.registerAddresses(JdbcNodesProvider.java:98) ~[cluster-impl.jar:?]

    at org.apache.ignite.spi.discovery.tcp.ServerImpl$IpFinderCleaner.cleanIpFinder(ServerImpl.java:1800) ~[ignite-core-1.7.0.jar:?]

    at org.apache.ignite.spi.discovery.tcp.ServerImpl$IpFinderCleaner.body(ServerImpl.java:1719) ~[ignite-core-1.7.0.jar:?]

    at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) ~[ignite-core-1.7.0.jar:?]

2017-07-31 14:24:15,221 [der-cleaner-#4%PRPC%] [          ] [                    ] [                    ] (internal.ClusterServiceJdbcDAO) ERROR   - Failed to get registered addresses

java.sql.SQLIntegrityConstraintViolationException: ORA-00001: unique constraint (DATA_SCHEMA.PRPC_IGNITE_SERVER_ADDR_PK) violated