MediaWiki master
|
This class is a delegate to ILBFactory for a given database cluster. More...
Inherited by Wikimedia\Rdbms\ILoadBalancerForOwner.
Public Member Functions | |
explicitTrxActive () | |
Determine whether an explicit transaction is active on any open primary connection. | |
getClusterName () | |
Get the name of the overall cluster of database servers managing the dataset. | |
getConnection ( $i, $groups=[], $domain=false, $flags=0) | |
Get a lazy-connecting database handle for a specific or virtual (DB_PRIMARY/DB_REPLICA) server index. | |
getConnectionInternal ( $i, $groups=[], $domain=false, $flags=0) | |
getConnectionRef ( $i, $groups=[], $domain=false, $flags=0) | |
getLagTimes () | |
Get an estimate of replication lag (in seconds) for each server. | |
getLocalDomainID () | |
Get the local (and default) database domain ID of connection handles. | |
getMaintenanceConnectionRef ( $i, $groups=[], $domain=false, $flags=0) | |
Get a DB handle, suitable for migrations and schema changes, for a server index. | |
getMaxLag () | |
Get the name and lag time of the most-lagged replica server. | |
getPrimaryPos () | |
Get the current primary replication position. | |
getReaderIndex ( $group=false) | |
Get the specific server index of the reader connection for a given group. | |
getReadOnlyReason () | |
getServerAttributes ( $i) | |
Get basic attributes of the server with the specified index without connecting. | |
getServerConnection ( $i, $domain, $flags=0) | |
Get a DB handle for a specific server index. | |
getServerCount () | |
Get the number of servers defined in configuration. | |
getServerInfo ( $i) | |
Return the server configuration map for the server with the specified index. | |
getServerName ( $i) | |
Get the readable name of the server with the specified index. | |
getServerType ( $i) | |
Get the RDBMS type of the server with the specified index (e.g. | |
hasOrMadeRecentPrimaryChanges ( $age=null) | |
Check if this load balancer object had any recent or still pending writes issued against it by this PHP thread. | |
hasPrimaryChanges () | |
Whether there are pending changes or callbacks in a transaction by this thread. | |
hasReplicaServers () | |
Whether there are any replica servers configured. | |
hasStreamingReplicaServers () | |
Whether any replica servers use streaming replication from the primary server. | |
pingAll () | |
resolveDomainID ( $domain) | |
setDomainAliases (array $aliases) | |
Convert certain database domains to alternative ones. | |
setTableAliases (array $aliases) | |
Make certain table names use their own database, schema, and table prefix when passed into SQL queries pre-escaped and without a qualified database name. | |
setTempTablesOnlyMode ( $value, $domain) | |
Indicate whether the tables on this domain are only temporary tables for testing. | |
setTransactionListener ( $name, ?callable $callback=null) | |
Set a callback via IDatabase::setTransactionListener() on all current and future primary connections of this load balancer. | |
waitForPrimaryPos (IDatabase $conn) | |
Wait for a replica DB to reach a specified primary position. | |
Public Attributes | |
const | CONN_SILENCE_ERRORS = 4 |
Yield null on connection failure instead of throwing an exception. | |
const | CONN_TRX_AUTOCOMMIT = 1 |
Yield a tracked autocommit-mode handle (reuse existing ones) | |
const | CONN_UNTRACKED_GAUGE = 2 |
Yield an untracked, low-timeout, autocommit-mode handle (to gauge server health) | |
const | DB_PRIMARY = -2 |
Request a primary, write-enabled DB connection. | |
const | DB_REPLICA = -1 |
Request a replica DB connection. | |
const | DOMAIN_ANY = '' |
Domain specifier when no specific database needs to be selected. | |
const | GROUP_GENERIC = '' |
The generic query group. | |
This class is a delegate to ILBFactory for a given database cluster.
ILoadBalancer tracks the database connections and transactions for a given database cluster. A "cluster" is considered to be the set of database servers that manage a given dataset. Within a given cluster, each database server can have one of the following roles:
Single-datacenter database clusters consist of either:
Multi-datacenter database clusters either consist of either:
The term "primary" refers to the server used by this datacenter for handling writes, whether it is a sole-primary or co-primary.
The "servers" configuration array contains the list of database servers to use for operations originating from the the local datacenter. The first entry must refer to the server to use for write and read-for-write operations (e.g. the "writer server"):
On an infrastructure level, circular replication setups can have more than one database server act as a replication "source" within the same datacenter, provided that no more than one of the servers are writable at any time, namely the "writer server". The other source servers will be treated as replicas by the load balancer, but can be quickly promoted to the "writer server" by the site admin as needed.
Likewise, Galera Cluster setups still require the choice of a single "writer server" for each datacenter. Limiting the number of servers that initiate transactions helps reduce the rate of aborted transactions due to wsrep conflicts.
By default, each DB server uses DBO_DEFAULT for its 'flags' setting, unless explicitly set otherwise in configuration. DBO_DEFAULT behavior depends on whether 'cliMode' is set:
The typical caller will use LoadBalancer::getConnection( DB_* ) to yield a database connection handle. The choice of which DB server to use is based on pre-defined loads for weighted random selection, adjustments thereof by LoadMonitor, and the amount of replication lag on each DB server. Lag checks might cause problems in certain setups, so they should be tuned in the server configuration maps as follows:
If using a SQL proxy service, it would probably be best to have two proxy hosts for the load balancer to talk to. One would be the 'host' of the "writer server" entry and another for the (logical) replica server entry. The proxy could map the load balancer's "replica" DB to any number of physical replica DBs.
Definition at line 113 of file ILoadBalancer.php.
Wikimedia\Rdbms\ILoadBalancer::explicitTrxActive | ( | ) |
Determine whether an explicit transaction is active on any open primary connection.
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::getClusterName | ( | ) |
Get the name of the overall cluster of database servers managing the dataset.
Note that the cluster might contain servers in multiple datacenters. The load balancer instance only needs to be aware of the local replica servers, along with either the sole-primary server or the local co-primary server.
This is useful for identifying a cluster or replicated dataset, even when:
Implemented in Wikimedia\Rdbms\LoadBalancer.
Referenced by Wikimedia\Rdbms\ChronologyProtector\getSessionPrimaryPos(), Wikimedia\Rdbms\ChronologyProtector\getTouched(), and Wikimedia\Rdbms\ChronologyProtector\stageSessionPrimaryPos().
Wikimedia\Rdbms\ILoadBalancer::getConnection | ( | $i, | |
$groups = [], | |||
$domain = false, | |||
$flags = 0 ) |
Get a lazy-connecting database handle for a specific or virtual (DB_PRIMARY/DB_REPLICA) server index.
The server index, $i, can be one of the following:
Handle sharing is very useful when callers get DB_PRIMARY handles that are transaction round aware (the default). All such callers will operate within a single transaction as a consequence. The same applies to DB_REPLICA that are samely query grouped (the default) and transaction round aware (the default).
Use CONN_TRX_AUTOCOMMIT to use a separate pool of only autocommit handles. This flag is ignored for databases with ATTR_DB_LEVEL_LOCKING (e.g. sqlite) in order to avoid deadlocks. getServerAttributes() can be used to check this attribute beforehand. Avoid using begin() and commit() on such handles. If handle methods like startAtomic() and endAtomic() must be used on the handles, callers should at least make sure that the atomic sections are closed on failure via try/catch and cancelAtomic().
Use CONN_UNTRACKED_GAUGE to get a new, untracked, handle, that uses a low connection timeout, a low read timeout, and autocommit mode. This flag is intended for use only be internal callers.
CONN_UNTRACKED_GAUGE and CONN_TRX_AUTOCOMMIT are incompatible.
int | $i | Specific (overrides $groups) or virtual (DB_PRIMARY/DB_REPLICA) server index |
string[] | string | $groups | Query group(s) in preference order; [] for the default group |
string | false | $domain | DB domain ID or false for the local domain |
int | $flags | Bitfield of CONN_* class constants |
Implemented in Wikimedia\Rdbms\LoadBalancer, and Wikimedia\Rdbms\LoadBalancerDisabled.
Referenced by MediaWiki\Installer\NetworkedDatabaseCreator\existsInLoadBalancer().
Wikimedia\Rdbms\ILoadBalancer::getConnectionInternal | ( | $i, | |
$groups = [], | |||
$domain = false, | |||
$flags = 0 ) |
int | $i | Specific (overrides $groups) or virtual (DB_PRIMARY/DB_REPLICA) server index |
string[] | string | $groups | Query group(s) in preference order; [] for the default group |
string | false | $domain | DB domain ID or false for the local domain |
int | $flags | Bitfield of CONN_* class constants (e.g. CONN_TRX_AUTOCOMMIT) |
Implemented in Wikimedia\Rdbms\LoadBalancer, and Wikimedia\Rdbms\LoadBalancerDisabled.
Wikimedia\Rdbms\ILoadBalancer::getConnectionRef | ( | $i, | |
$groups = [], | |||
$domain = false, | |||
$flags = 0 ) |
int | $i | Specific or virtual (DB_PRIMARY/DB_REPLICA) server index |
string[] | string | $groups | Query group(s) in preference order; [] for the default group |
string | false | $domain | DB domain ID or false for the local domain |
int | $flags | Bitfield of CONN_* class constants (e.g. CONN_TRX_AUTOCOMMIT) |
Implemented in Wikimedia\Rdbms\LoadBalancer, and Wikimedia\Rdbms\LoadBalancerDisabled.
Wikimedia\Rdbms\ILoadBalancer::getLagTimes | ( | ) |
Get an estimate of replication lag (in seconds) for each server.
Results are cached for a short time in memcached/process cache
Values may be "false" if replication is too broken to estimate
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::getLocalDomainID | ( | ) |
Get the local (and default) database domain ID of connection handles.
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::getMaintenanceConnectionRef | ( | $i, | |
$groups = [], | |||
$domain = false, | |||
$flags = 0 ) |
Get a DB handle, suitable for migrations and schema changes, for a server index.
The DBConnRef methods simply proxy an underlying IDatabase object which takes care of the actual connection and query logic.
The CONN_TRX_AUTOCOMMIT flag is ignored for databases with ATTR_DB_LEVEL_LOCKING (e.g. sqlite) in order to avoid deadlocks. getServerAttributes() can be used to check such flags beforehand. Avoid the use of begin() or startAtomic() on any CONN_TRX_AUTOCOMMIT connections.
int | $i | Specific or virtual (DB_PRIMARY/DB_REPLICA) server index |
string[] | string | $groups | Query group(s) in preference order; [] for the default group |
string | false | $domain | DB domain ID or false for the local domain |
int | $flags | Bitfield of CONN_* class constants (e.g. CONN_TRX_AUTOCOMMIT) |
Implemented in Wikimedia\Rdbms\LoadBalancer, and Wikimedia\Rdbms\LoadBalancerDisabled.
Wikimedia\Rdbms\ILoadBalancer::getMaxLag | ( | ) |
Get the name and lag time of the most-lagged replica server.
This is useful for maintenance scripts that need to throttle their updates. May attempt to open connections to replica DBs on the default DB. If there is no lag, the maximum lag will be reported as -1.
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::getPrimaryPos | ( | ) |
Get the current primary replication position.
DBError |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Referenced by Wikimedia\Rdbms\ChronologyProtector\stageSessionPrimaryPos().
Wikimedia\Rdbms\ILoadBalancer::getReaderIndex | ( | $group = false | ) |
Get the specific server index of the reader connection for a given group.
This takes into account load ratios and lag times. It should return a consistent index during the life time of the load balancer. This initially checks replica DBs for connectivity to avoid returning an unusable server. This means that connections might be attempted by calling this method (usually one at the most but possibly more). Subsequent calls with the same $group will not need to make new connection attempts since the acquired connection for each group is preserved.
string | false | $group | Query group or false for the generic group |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::getReadOnlyReason | ( | ) |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::getServerAttributes | ( | $i | ) |
Get basic attributes of the server with the specified index without connecting.
int | $i | Specific server index |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::getServerConnection | ( | $i, | |
$domain, | |||
$flags = 0 ) |
Get a DB handle for a specific server index.
This is an internal utility method for methods like LoadBalancer::getConnectionInternal() and DBConnRef to create the underlying connection to a concrete server.
The following is the responsibility of the caller:
int | $i | Specific server index |
string | $domain | Resolved DB domain |
int | $flags | Bitfield of class CONN_* constants |
DBError | If no DB handle could be obtained and CONN_SILENCE_ERRORS is not set |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::getServerCount | ( | ) |
Get the number of servers defined in configuration.
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::getServerInfo | ( | $i | ) |
Return the server configuration map for the server with the specified index.
int | $i | Specific server index |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::getServerName | ( | $i | ) |
Get the readable name of the server with the specified index.
int | $i | Specific server index |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Referenced by Wikimedia\Rdbms\ChronologyProtector\getSessionPrimaryPos(), and Wikimedia\Rdbms\ChronologyProtector\stageSessionPrimaryPos().
Wikimedia\Rdbms\ILoadBalancer::getServerType | ( | $i | ) |
Get the RDBMS type of the server with the specified index (e.g.
"mysql", "sqlite")
int | $i | Specific server index |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::hasOrMadeRecentPrimaryChanges | ( | $age = null | ) |
Check if this load balancer object had any recent or still pending writes issued against it by this PHP thread.
float | null | $age | How many seconds ago is "recent" [defaults to mWaitTimeout] |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Referenced by Wikimedia\Rdbms\ChronologyProtector\stageSessionPrimaryPos().
Wikimedia\Rdbms\ILoadBalancer::hasPrimaryChanges | ( | ) |
Whether there are pending changes or callbacks in a transaction by this thread.
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::hasReplicaServers | ( | ) |
Whether there are any replica servers configured.
This scans the list of servers defined in configuration, checking for:
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::hasStreamingReplicaServers | ( | ) |
Whether any replica servers use streaming replication from the primary server.
This scans the list of servers defined in configuration, checking for:
It is possible for some replicas to be configured with "is static" but not others, though it generally should either be set for all or none of the replicas.
If this returns false, this means that there is generally no reason to execute replication wait logic for session consistency and lag reduction.
Implemented in Wikimedia\Rdbms\LoadBalancer.
Referenced by Wikimedia\Rdbms\ChronologyProtector\stageSessionPrimaryPos().
Wikimedia\Rdbms\ILoadBalancer::pingAll | ( | ) |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::resolveDomainID | ( | $domain | ) |
DatabaseDomain | string | false | $domain | Database domain |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::setDomainAliases | ( | array | $aliases | ) |
Convert certain database domains to alternative ones.
This can be used for backwards compatibility logic.
DatabaseDomain[] | string[] | $aliases | Map of (domain alias => domain) |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Referenced by Wikimedia\Rdbms\LBFactory\initLoadBalancer().
Wikimedia\Rdbms\ILoadBalancer::setTableAliases | ( | array | $aliases | ) |
Make certain table names use their own database, schema, and table prefix when passed into SQL queries pre-escaped and without a qualified database name.
For example, "user" can be converted to "myschema.mydbname.user" for convenience. Appearances like user
, somedb.user, somedb.someschema.user will used literally.
Calling this twice will completely clear any old table aliases. Also, note that callers are responsible for making sure the schemas and databases actually exist.
array[] | $aliases | Map of (table => (dbname, schema, prefix) map) |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Referenced by Wikimedia\Rdbms\LBFactory\initLoadBalancer().
Wikimedia\Rdbms\ILoadBalancer::setTempTablesOnlyMode | ( | $value, | |
$domain ) |
Indicate whether the tables on this domain are only temporary tables for testing.
In "temporary tables mode", the CONN_TRX_AUTOCOMMIT flag is ignored
bool | $value | |
string | $domain |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::setTransactionListener | ( | $name, | |
?callable | $callback = null ) |
Set a callback via IDatabase::setTransactionListener() on all current and future primary connections of this load balancer.
string | $name | Callback name |
callable | null | $callback |
Implemented in Wikimedia\Rdbms\LoadBalancer.
Wikimedia\Rdbms\ILoadBalancer::waitForPrimaryPos | ( | IDatabase | $conn | ) |
Wait for a replica DB to reach a specified primary position.
If $conn is not a replica server connection, then this will return true. Otherwise, if $pos is not provided, this will connect to the primary server to get an accurate position.
IDatabase | $conn | Replica DB |
Implemented in Wikimedia\Rdbms\LoadBalancer.
const Wikimedia\Rdbms\ILoadBalancer::CONN_SILENCE_ERRORS = 4 |
Yield null on connection failure instead of throwing an exception.
Definition at line 141 of file ILoadBalancer.php.
Referenced by Wikimedia\Rdbms\LoadMonitor\computeServerState().
const Wikimedia\Rdbms\ILoadBalancer::CONN_TRX_AUTOCOMMIT = 1 |
Yield a tracked autocommit-mode handle (reuse existing ones)
Definition at line 131 of file ILoadBalancer.php.
Referenced by Wikimedia\Rdbms\LoadBalancerSingle\sanitizeConnectionFlags().
const Wikimedia\Rdbms\ILoadBalancer::CONN_UNTRACKED_GAUGE = 2 |
Yield an untracked, low-timeout, autocommit-mode handle (to gauge server health)
Definition at line 136 of file ILoadBalancer.php.
Referenced by Wikimedia\Rdbms\LoadMonitor\computeServerState().
const Wikimedia\Rdbms\ILoadBalancer::DB_PRIMARY = -2 |
Request a primary, write-enabled DB connection.
Can't be used as a binary flag with bitwise operators!
Definition at line 123 of file ILoadBalancer.php.
Referenced by Wikimedia\Rdbms\DBConnRef\query().
const Wikimedia\Rdbms\ILoadBalancer::DB_REPLICA = -1 |
Request a replica DB connection.
Can't be used as a binary flag with bitwise operators!
Definition at line 117 of file ILoadBalancer.php.
const Wikimedia\Rdbms\ILoadBalancer::DOMAIN_ANY = '' |
Domain specifier when no specific database needs to be selected.
Definition at line 126 of file ILoadBalancer.php.
Referenced by Wikimedia\Rdbms\LoadMonitor\computeServerState().
const Wikimedia\Rdbms\ILoadBalancer::GROUP_GENERIC = '' |
The generic query group.
Definition at line 128 of file ILoadBalancer.php.
Referenced by Wikimedia\Rdbms\LBFactoryMulti\__construct().