Redis-based caching module for redis server >= 2.6.12 and phpredis >= 2.2.4. More...

Inheritance diagram for RedisBagOStuff:

[legend]

Collaboration diagram for RedisBagOStuff:

[legend]

Public Member Functions
	__construct ( $params)
	Construct a RedisBagOStuff object.

	decr ( $key, $value=1, $flags=0)
	Decrease stored value of $key by $value while preserving its TTL.

	doChangeTTLMulti (array $keys, $exptime, $flags=0)

	incr ( $key, $value=1, $flags=0)
	Increase stored value of $key by $value while preserving its TTL.

	logRequest ( $op, $keys, $server, $e=null)
	Send information about a single request to the debug log.

	makeKeyInternal ( $keyspace, $components)
	Make a cache key for the given keyspace and components.

Public Member Functions inherited from MediumSpecificBagOStuff
	__construct (array $params=[])

	add ( $key, $value, $exptime=0, $flags=0)
	Insert an item if it does not already exist.

	addBusyCallback (callable $workCallback)
	Let a callback be run to avoid wasting time on special blocking calls.

	changeTTL ( $key, $exptime=0, $flags=0)
	Change the expiration on a key if it exists.

	changeTTLMulti (array $keys, $exptime, $flags=0)
	Change the expiration of multiple keys that exist.

	clearLastError ()
	Clear the "last error" registry.

	delete ( $key, $flags=0)
	Delete an item.

	deleteMulti (array $keys, $flags=0)
	Batch deletion.

	deleteObjectsExpiringBefore ( $timestamp, callable $progress=null, $limit=INF, string $tag=null)
	Delete all objects expiring before a certain date.

	get ( $key, $flags=0)
	Get an item with the given key.

	getLastError ()
	Get the "last error" registered; clearLastError() should be called manually.

	getMulti (array $keys, $flags=0)
	Get an associative array containing the item for each of the keys that have items.

	getQoS ( $flag)

	getSegmentationSize ()

	getSegmentedValueMaxSize ()

	incrWithInit ( $key, $exptime, $value=1, $init=null, $flags=0)
	Increase the value of the given key (no TTL change) if it exists or create it otherwise.

	lock ( $key, $timeout=6, $exptime=6, $rclass='')

	makeGlobalKey ( $collection,... $components)
	Make a cache key for the default keyspace and given components.

	makeKey ( $collection,... $components)
	Make a cache key for the global keyspace and given components.

	merge ( $key, callable $callback, $exptime=0, $attempts=10, $flags=0)
	Merge changes into the existing cache value (possibly creating a new one)

	set ( $key, $value, $exptime=0, $flags=0)
	Set an item.

	setMulti (array $valueByKey, $exptime=0, $flags=0)
	Batch insertion/replace.

	setNewPreparedValues (array $valueByKey)
	Make a "generic" reversible cache key from the given components.

	unlock ( $key)
	Release an advisory lock on a key string.

Public Member Functions inherited from BagOStuff
	getCurrentTime ()

	getLogger ()

	getScopedLock ( $key, $timeout=6, $expiry=30, $rclass='')
	Get a lightweight exclusive self-unlocking lock.

	getWithSetCallback ( $key, $exptime, $callback, $flags=0)
	Get an item with the given key, regenerating and setting it if not found.

	isKeyGlobal ( $key)
	Check whether a cache key is in the global keyspace.

	registerWrapperInfoForStats (string $prefixComponent, string $statsGroup, callable $collectionCallback)
	Register info about a caching layer class that uses BagOStuff as a backing store.

	setDebug ( $enabled)

	setLogger (LoggerInterface $logger)

	setMockTime (&$time)

Protected Member Functions
	convertGenericKey ( $key)
	Convert a "generic" reversible cache key into one for this cache.

	doAdd ( $key, $value, $expiry=0, $flags=0)
	Insert an item if it does not already exist.

	doChangeTTL ( $key, $exptime, $flags)

	doDelete ( $key, $flags=0)
	Delete an item.

	doDeleteMulti (array $keys, $flags=0)

	doGet ( $key, $flags=0, &$casToken=null)

	doGetMulti (array $keys, $flags=0)
	Get an associative array containing the item for each of the keys that have items.

	doSet ( $key, $value, $exptime=0, $flags=0)
	Set an item.

	doSetMulti (array $data, $exptime=0, $flags=0)

	getConnection ( $key)

	handleException (RedisConnRef $conn, RedisException $e)
	The redis extension throws an exception in response to various read, write and protocol errors.

	logError ( $msg)
	Log a fatal error.

Protected Member Functions inherited from MediumSpecificBagOStuff
	cas ( $casToken, $key, $value, $exptime=0, $flags=0)
	Check and set an item.

	debug ( $text)

	doCas ( $casToken, $key, $value, $exptime=0, $flags=0)
	Check and set an item.

	doLock ( $key, $timeout, $exptime)

	doUnlock ( $key)

	getExpirationAsTimestamp ( $exptime)
	Convert an optionally relative timestamp to an absolute time.

	getExpirationAsTTL ( $exptime)
	Convert an optionally absolute expiry time to a relative time.

	getSerialized ( $value, $key)
	Get the serialized form a value, using any applicable prepared value.

	guessSerialValueSize ( $value, $depth=0, &$loops=0)
	Estimate the size of a variable once serialized.

	isInteger ( $value)
	Check if a value is an integer.

	isRelativeExpiration ( $exptime)

	makeLockKey ( $key)

	makeValueOrSegmentList ( $key, $value, $exptime, $flags)
	Determine the entry (inline or segment list) to store under a key to save the value.

	mergeViaCas ( $key, callable $callback, $exptime, $attempts, $flags)

	resolveSegments ( $key, $mainValue)
	Get and reassemble the chunks of blob at the given key.

	serialize ( $value)

	setLastError ( $err)
	Set the "last error" registry.

	unserialize ( $value)

	updateOpStats (string $op, array $keyInfo)

Protected Member Functions inherited from BagOStuff
	componentsFromGenericKey ( $key)
	Extract the components from a "generic" reversible cache key.

	determineKeyPrefixForStats ( $key)

	fieldHasFlags ( $field, $flags)

	genericKeyFromComponents (... $components)
	At a minimum, there must be a keyspace and collection name component.

	mergeFlagMaps (array $bags)
	Merge the flag maps of one or more BagOStuff objects into a "lowest common denominator" map.

	proxyCall ( $method, $arg0Sig, $resSig, array $genericArgs)
	Call a method on behalf of wrapper BagOStuff instance that uses "generic" keys.

Protected Attributes
bool	$automaticFailover

RedisConnectionPool	$redisPool

array	$servers
	List of server names.

array	$serverTagMap
	Map of (tag => server name)

Protected Attributes inherited from MediumSpecificBagOStuff
callable[]	$busyCallbacks = []

int	$lastError = self::ERR_NONE
	ERR_* class constant.

array< string, array >	$locks = []
	Map of (key => (class, depth, expiry)

array[]	$preparedValues = []
	Map of (key => (PHP variable value, serialized value))

int	$segmentationSize
	Bytes; chunk size of segmented cache values.

int	$segmentedValueMaxSize
	Bytes; maximum total size of a segmented cache value.

int	$syncTimeout
	Seconds.

const	LOCK_DEPTH = 1

const	LOCK_EXPIRY = 3

const	LOCK_RCLASS = 0

const	LOCK_TIME = 2

const	METRIC_OP_ADD = 'add'

const	METRIC_OP_CAS = 'cas'

const	METRIC_OP_CHANGE_TTL = 'change_ttl'

const	METRIC_OP_DECR = 'decr'

const	METRIC_OP_DELETE = 'delete'

const	METRIC_OP_GET = 'get'

const	METRIC_OP_INCR = 'incr'

const	METRIC_OP_SET = 'set'

Protected Attributes inherited from BagOStuff
callable null	$asyncHandler

int[]	$attrMap = []
	Map of (ATTR_* class constant => QOS_* class constant)

bool	$debugMode = true
	Whether to send debug log entries to the SPI logger instance.

string	$keyspace
	Default keyspace; used by makeKey()

LoggerInterface	$logger

StatsdDataFactoryInterface	$stats

array< string, array >	$wrapperInfoByPrefix = []
	Cache key processing callbacks and info for metrics.

Additional Inherited Members
Public Attributes inherited from BagOStuff
const	READ_LATEST = 1
	Bitfield constants for get()/getMulti(); these are only advisory.

const	READ_VERIFIED = 2

const	WRITE_ALLOW_SEGMENTS = 16

const	WRITE_BACKGROUND = 64

const	WRITE_CACHE_ONLY = 8

const	WRITE_PRUNE_SEGMENTS = 32

const	WRITE_SYNC = 4
	Bitfield constants for set()/merge(); these are only advisory.

Public Attributes inherited from Wikimedia\LightweightObjectStore\StorageAwareness
const	ATTR_DURABILITY = 2
	Durability of writes; see QOS_DURABILITY_* (higher means stronger)

const	ATTR_EMULATION = 1
	Emulation/fallback mode; see QOS_EMULATION_*; higher is better.

const	ERR_NO_RESPONSE = 1
	Storage medium failed to yield a response.

const	ERR_NONE = 0
	No storage medium error.

const	ERR_UNEXPECTED = 3
	Storage medium operation failed due to usage limitations or an I/O error.

const	ERR_UNREACHABLE = 2
	Storage medium could not be reached.

const	QOS_DURABILITY_DISK = 4
	Data is saved to disk and writes do not usually block on fsync()

const	QOS_DURABILITY_NONE = 1
	Data is never saved to begin with (blackhole store)

const	QOS_DURABILITY_RDBMS = 5
	Data is saved to disk and writes usually block on fsync(), like a standard RDBMS.

const	QOS_DURABILITY_SCRIPT = 2
	Data is lost at the end of the current web request or CLI script.

const	QOS_DURABILITY_SERVICE = 3
	Data is lost once the service storing the data restarts.

const	QOS_EMULATION_SQL = 1
	Fallback disk-based SQL store.

const	QOS_UNKNOWN = INF
	Generic "unknown" value; useful for comparisons (always "good enough")

Detailed Description

Redis-based caching module for redis server >= 2.6.12 and phpredis >= 2.2.4.

See also: https://github.com/phpredis/phpredis/blob/d310ed7c8/Changelog.md

Note: Avoid use of Redis::MULTI transactions for twemproxy support

Definition at line 33 of file RedisBagOStuff.php.

Constructor & Destructor Documentation

◆ __construct()

RedisBagOStuff::__construct ( $params )

Construct a RedisBagOStuff object.

Parameters are:

servers: An array of server names. A server name may be a hostname, a hostname/port combination or the absolute path of a UNIX socket. If a hostname is specified but no port, the standard port number 6379 will be used. Arrays keys can be used to specify the tag to hash on in place of the host/port. Required.
connectTimeout: The timeout for new connections, in seconds. Optional, default is 1 second.
persistent: Set this to true to allow connections to persist across multiple web requests. False by default.
password: The authentication password, will be sent to Redis in clear text. Optional, if it is unspecified, no AUTH command will be sent.
automaticFailover: If this is false, then each key will be mapped to a single server, and if that server is down, any requests for that key will fail. If this is true, a connection failure will cause the client to immediately try the next server in the list (as determined by a consistent hashing algorithm). True by default. This has the potential to create consistency issues if a server is slow enough to flap, for example if it is in swap death.
Parameters

array $params

Definition at line 71 of file RedisBagOStuff.php.

References Wikimedia\LightweightObjectStore\StorageAwareness\ATTR_DURABILITY, Wikimedia\LightweightObjectStore\StorageAwareness\QOS_DURABILITY_DISK, and RedisConnectionPool\singleton().

Member Function Documentation

◆ convertGenericKey()

RedisBagOStuff::convertGenericKey ( $key )

protected

Convert a "generic" reversible cache key into one for this cache.

See also: BagOStuff::genericKeyFromComponents()

Parameters

string $key Keyspace-prepended list of encoded components as a colon-separated value

Returns: string Keyspace-prepended list of encoded components as a colon-separated value

Reimplemented from MediumSpecificBagOStuff.

Definition at line 592 of file RedisBagOStuff.php.

◆ decr()

RedisBagOStuff::decr	(	$key,
		$value = `1`,
		$flags = `0`
	)

Decrease stored value of $key by $value while preserving its TTL.

Parameters

string	$key
int	$value	Value to subtract from $key (default: 1) [optional]
int	$flags	Bit field of class WRITE_* constants [optional]

Returns: int|bool New value or false on failure

Reimplemented from BagOStuff.

Definition at line 452 of file RedisBagOStuff.php.

References getConnection(), handleException(), logRequest(), and MediumSpecificBagOStuff\updateOpStats().

◆ doAdd()

RedisBagOStuff::doAdd	(	$key,
		$value,
		$exptime = `0`,
		$flags = `0`
	)

protected

Insert an item if it does not already exist.

Parameters

string	$key
mixed	$value
int	$exptime
int	$flags	Bitfield of BagOStuff::WRITE_* constants (since 1.33)

Returns: bool Success

Reimplemented from MediumSpecificBagOStuff.

Definition at line 400 of file RedisBagOStuff.php.

References $serialized, getConnection(), MediumSpecificBagOStuff\getExpirationAsTTL(), MediumSpecificBagOStuff\getSerialized(), handleException(), logRequest(), and MediumSpecificBagOStuff\updateOpStats().

◆ doChangeTTL()

RedisBagOStuff::doChangeTTL	(	$key,
		$exptime,
		$flags
	)

protected

Parameters

string	$key
int	$exptime
int	$flags

Returns: bool

Reimplemented from MediumSpecificBagOStuff.

Definition at line 476 of file RedisBagOStuff.php.

References getConnection(), MediumSpecificBagOStuff\getExpirationAsTimestamp(), MediumSpecificBagOStuff\getExpirationAsTTL(), handleException(), MediumSpecificBagOStuff\isRelativeExpiration(), logRequest(), and MediumSpecificBagOStuff\updateOpStats().

◆ doChangeTTLMulti()

RedisBagOStuff::doChangeTTLMulti	(	array	$keys,
			$exptime,
			$flags = `0`
	)

Parameters

string[]	$keys	List of keys
int	$exptime	TTL or UNIX timestamp
int	$flags	Bitfield of BagOStuff::WRITE_* constants

Returns: bool Success

Reimplemented from MediumSpecificBagOStuff.

Definition at line 343 of file RedisBagOStuff.php.

References $keys, getConnection(), MediumSpecificBagOStuff\getExpirationAsTimestamp(), MediumSpecificBagOStuff\getExpirationAsTTL(), handleException(), MediumSpecificBagOStuff\isRelativeExpiration(), logRequest(), and MediumSpecificBagOStuff\updateOpStats().

◆ doDelete()

RedisBagOStuff::doDelete	(	$key,
		$flags = `0`
	)

protected

Delete an item.

Parameters

string	$key
int	$flags	Bitfield of BagOStuff::WRITE_* constants

Returns: bool True if the item was deleted or not found, false on failure

Reimplemented from MediumSpecificBagOStuff.

Definition at line 151 of file RedisBagOStuff.php.

References getConnection(), handleException(), logRequest(), and MediumSpecificBagOStuff\updateOpStats().

◆ doDeleteMulti()

RedisBagOStuff::doDeleteMulti	(	array	$keys,
			$flags = `0`
	)

protected

Parameters

string[]	$keys	List of keys
int	$flags	Bitfield of BagOStuff::WRITE_* constants

Returns: bool Success

Reimplemented from MediumSpecificBagOStuff.

Definition at line 295 of file RedisBagOStuff.php.

References $keys, getConnection(), handleException(), logRequest(), and MediumSpecificBagOStuff\updateOpStats().

◆ doGet()

RedisBagOStuff::doGet	(		$key,
			$flags = `0`,
		&	$casToken = `null`
	)

protected

Parameters

string	$key
int	$flags	Bitfield of BagOStuff::READ_* constants [optional]
mixed \| null	&$casToken	cas() token if MediumSpecificBagOStuff::PASS_BY_REF [returned]

Returns: mixed Returns false on failure or if the item does not exist

Reimplemented from MediumSpecificBagOStuff.

Definition at line 92 of file RedisBagOStuff.php.

References $blob, getConnection(), handleException(), logRequest(), MediumSpecificBagOStuff\unserialize(), and MediumSpecificBagOStuff\updateOpStats().

◆ doGetMulti()

RedisBagOStuff::doGetMulti	(	array	$keys,
			$flags = `0`
	)

protected

Get an associative array containing the item for each of the keys that have items.

Parameters

string[]	$keys	List of keys
int	$flags	Bitfield; supports READ_LATEST [optional]

Returns: array Map of (key => value) for existing keys; preserves the order of $keys

Reimplemented from MediumSpecificBagOStuff.

Definition at line 173 of file RedisBagOStuff.php.

References $blob, $keys, getConnection(), handleException(), logRequest(), MediumSpecificBagOStuff\unserialize(), and MediumSpecificBagOStuff\updateOpStats().

◆ doSet()

RedisBagOStuff::doSet	(	$key,
		$value,
		$exptime = `0`,
		$flags = `0`
	)

protected

Set an item.

Parameters

string	$key
mixed	$value
int	$exptime	Either an interval in seconds or a unix timestamp for expiry
int	$flags	Bitfield of BagOStuff::WRITE_* constants

Returns: bool Success

Reimplemented from MediumSpecificBagOStuff.

Definition at line 122 of file RedisBagOStuff.php.

References $serialized, getConnection(), MediumSpecificBagOStuff\getExpirationAsTTL(), MediumSpecificBagOStuff\getSerialized(), handleException(), logRequest(), and MediumSpecificBagOStuff\updateOpStats().

◆ doSetMulti()

RedisBagOStuff::doSetMulti	(	array	$data,
			$exptime = `0`,
			$flags = `0`
	)

protected

Parameters

mixed[]	$data	Map of (key => value)
int	$exptime	Either an interval in seconds or a unix timestamp for expiry
int	$flags	Bitfield of BagOStuff::WRITE_* constants

Returns: bool Success

Reimplemented from MediumSpecificBagOStuff.

Definition at line 237 of file RedisBagOStuff.php.

References $serialized, getConnection(), MediumSpecificBagOStuff\getExpirationAsTTL(), MediumSpecificBagOStuff\getSerialized(), handleException(), logRequest(), and MediumSpecificBagOStuff\updateOpStats().

◆ getConnection()

RedisBagOStuff::getConnection ( $key )

protected

Parameters

string $key

Returns: RedisConnRef|Redis|null Redis handle wrapper for the key or null on failure

Definition at line 508 of file RedisBagOStuff.php.

References Wikimedia\LightweightObjectStore\StorageAwareness\ERR_UNREACHABLE, and MediumSpecificBagOStuff\setLastError().

Referenced by decr(), doAdd(), doChangeTTL(), doChangeTTLMulti(), doDelete(), doDeleteMulti(), doGet(), doGetMulti(), doSet(), doSetMulti(), and incr().

◆ handleException()

RedisBagOStuff::handleException	(	RedisConnRef	$conn,
		RedisException	$e
	)

protected

The redis extension throws an exception in response to various read, write and protocol errors.

Sometimes it also closes the connection, sometimes not. The safest response for us is to explicitly destroy the connection object and let it be reopened during the next request.

Parameters

RedisConnRef	$conn
RedisException	$e

Definition at line 572 of file RedisBagOStuff.php.

References Wikimedia\LightweightObjectStore\StorageAwareness\ERR_UNEXPECTED, and MediumSpecificBagOStuff\setLastError().

Referenced by decr(), doAdd(), doChangeTTL(), doChangeTTLMulti(), doDelete(), doDeleteMulti(), doGet(), doGetMulti(), doSet(), doSetMulti(), and incr().

◆ incr()

RedisBagOStuff::incr	(	$key,
		$value = `1`,
		$flags = `0`
	)

Increase stored value of $key by $value while preserving its TTL.

Parameters

string	$key	Key to increase
int	$value	Value to add to $key (default: 1) [optional]
int	$flags	Bit field of class WRITE_* constants [optional]

Returns: int|bool New value or false on failure

Reimplemented from BagOStuff.

Definition at line 428 of file RedisBagOStuff.php.

References getConnection(), handleException(), logRequest(), and MediumSpecificBagOStuff\updateOpStats().

◆ logError()

RedisBagOStuff::logError ( $msg )

protected

Log a fatal error.

Parameters

string $msg

Definition at line 560 of file RedisBagOStuff.php.

◆ logRequest()

RedisBagOStuff::logRequest	(	$op,
		$keys,
		$server,
		$e = `null`
	)

Send information about a single request to the debug log.

Parameters

string	$op
string	$keys
string	$server
Exception \| true \| null	$e

Definition at line 584 of file RedisBagOStuff.php.

References MediumSpecificBagOStuff\debug().

Referenced by decr(), doAdd(), doChangeTTL(), doChangeTTLMulti(), doDelete(), doDeleteMulti(), doGet(), doGetMulti(), doSet(), doSetMulti(), and incr().

◆ makeKeyInternal()

RedisBagOStuff::makeKeyInternal	(	$keyspace,
		$components
	)

Make a cache key for the given keyspace and components.

Long components might be converted to respective hashes due to size constraints. In extreme cases, all of them might be combined into a single hash component.

Access: internal: This method should not be used outside of BagOStuff (since 1.36)

Parameters

string	$keyspace	Keyspace component
string[] \| int[]	$components	Key components (key collection name first)

Returns: string Keyspace-prepended list of encoded components as a colon-separated value

Since: 1.27

Reimplemented from BagOStuff.

Definition at line 588 of file RedisBagOStuff.php.

References BagOStuff\$keyspace, and BagOStuff\genericKeyFromComponents().

Member Data Documentation

◆ $automaticFailover

bool RedisBagOStuff::$automaticFailover

protected

Definition at line 41 of file RedisBagOStuff.php.

◆ $redisPool

RedisConnectionPool RedisBagOStuff::$redisPool

protected

Definition at line 35 of file RedisBagOStuff.php.

◆ $servers

array RedisBagOStuff::$servers

protected

List of server names.

Definition at line 37 of file RedisBagOStuff.php.

◆ $serverTagMap

array RedisBagOStuff::$serverTagMap

protected

Map of (tag => server name)

Definition at line 39 of file RedisBagOStuff.php.

The documentation for this class was generated from the following file:

includes/libs/objectcache/RedisBagOStuff.php

Public Member Functions

Protected Member Functions

Protected Attributes

Additional Inherited Members

Detailed Description

Constructor & Destructor Documentation

◆ __construct()

Member Function Documentation

◆ convertGenericKey()

◆ decr()

◆ doAdd()

◆ doChangeTTL()

◆ doChangeTTLMulti()

◆ doDelete()

◆ doDeleteMulti()

◆ doGet()

◆ doGetMulti()

◆ doSet()

◆ doSetMulti()

◆ getConnection()

◆ handleException()

◆ incr()

◆ logError()

◆ logRequest()

◆ makeKeyInternal()

Member Data Documentation

◆ $automaticFailover

◆ $redisPool

◆ $servers

◆ $serverTagMap