MediaWiki REL1_34
RESTBagOStuff Class Reference

Interface to key-value storage behind an HTTP server. More...

Inheritance diagram for RESTBagOStuff:
Collaboration diagram for RESTBagOStuff:

Public Member Functions

 __construct ( $params)
 
 decr ( $key, $value=1, $flags=0)
 Decrease stored value of $key by $value while preserving its TTL.
 
 incr ( $key, $value=1, $flags=0)
 Increase stored value of $key by $value while preserving its TTL.
 
 setLogger (LoggerInterface $logger)
 
- Public Member Functions inherited from MediumSpecificBagOStuff
 __construct (array $params=[])
 
 add ( $key, $value, $exptime=0, $flags=0)
 Insert an item if it does not already exist.
 
 addBusyCallback (callable $workCallback)
 Let a callback be run to avoid wasting time on special blocking calls.
 
 changeTTL ( $key, $exptime=0, $flags=0)
 Change the expiration on a key if it exists.
 
 changeTTLMulti (array $keys, $exptime, $flags=0)
 Change the expiration of multiple keys that exist.
 
 clearLastError ()
 Clear the "last error" registry.
 
 delete ( $key, $flags=0)
 Delete an item.
 
 deleteMulti (array $keys, $flags=0)
 Batch deletion.
 
 deleteObjectsExpiringBefore ( $timestamp, callable $progress=null, $limit=INF)
 Delete all objects expiring before a certain date.
 
 get ( $key, $flags=0)
 Get an item with the given key.
 
 getLastError ()
 Get the "last error" registered; clearLastError() should be called manually.
 
 getMulti (array $keys, $flags=0)
 Get an associative array containing the item for each of the keys that have items.
 
 getQoS ( $flag)
 
 getSegmentationSize ()
 
 getSegmentedValueMaxSize ()
 
 incrWithInit ( $key, $exptime, $value=1, $init=null, $flags=0)
 Increase the value of the given key (no TTL change) if it exists or create it otherwise.
 
 lock ( $key, $timeout=6, $expiry=6, $rclass='')
 Acquire an advisory lock on a key string.
 
 makeGlobalKey ( $class,... $components)
 Make a global cache key.
 
 makeKey ( $class,... $components)
 Make a cache key, scoped to this instance's keyspace.
 
 makeKeyInternal ( $keyspace, $args)
 Construct a cache key.
 
 merge ( $key, callable $callback, $exptime=0, $attempts=10, $flags=0)
 Merge changes into the existing cache value (possibly creating a new one)
 
 set ( $key, $value, $exptime=0, $flags=0)
 Set an item.
 
 setMulti (array $data, $exptime=0, $flags=0)
 Batch insertion/replace.
 
 unlock ( $key)
 Release an advisory lock on a key string.
 
- Public Member Functions inherited from BagOStuff
 getCurrentTime ()
 
 getScopedLock ( $key, $timeout=6, $expiry=30, $rclass='')
 Get a lightweight exclusive self-unlocking lock.
 
 getWithSetCallback ( $key, $ttl, $callback, $flags=0)
 Get an item with the given key, regenerating and setting it if not found.
 
 setDebug ( $enabled)
 
 setMockTime (&$time)
 

Public Attributes

const DEFAULT_CONN_TIMEOUT = 1.2
 Default connection timeout in seconds.
 
const DEFAULT_REQ_TIMEOUT = 3.0
 Default request timeout.
 
- Public Attributes inherited from BagOStuff
const READ_LATEST = 1
 Bitfield constants for get()/getMulti(); these are only advisory.
 
const READ_VERIFIED = 2
 
const WRITE_ALLOW_SEGMENTS = 16
 
const WRITE_BACKGROUND = 64
 
const WRITE_CACHE_ONLY = 8
 
const WRITE_PRUNE_SEGMENTS = 32
 
const WRITE_SYNC = 4
 Bitfield constants for set()/merge(); these are only advisory.
 
- Public Attributes inherited from IExpiringStore
const ATTR_EMULATION = 1
 
const ATTR_SYNCWRITES = 2
 
const ERR_NO_RESPONSE = 1
 
const ERR_NONE = 0
 
const ERR_UNEXPECTED = 3
 
const ERR_UNREACHABLE = 2
 
const QOS_EMULATION_SQL = 1
 
const QOS_SYNCWRITES_BE = 2
 
const QOS_SYNCWRITES_NONE = 1
 
const QOS_SYNCWRITES_QC = 3
 
const QOS_SYNCWRITES_SS = 4
 
const QOS_UNKNOWN = INF
 
const TTL_DAY = 86400
 
const TTL_HOUR = 3600
 
const TTL_INDEFINITE = 0
 
const TTL_MINUTE = 60
 
const TTL_MONTH = 2592000
 
const TTL_PROC_LONG = 30
 
const TTL_PROC_SHORT = 3
 
const TTL_SECOND = 1
 
const TTL_WEEK = 604800
 
const TTL_YEAR = 31536000
 

Protected Member Functions

 doAdd ( $key, $value, $exptime=0, $flags=0)
 Insert an item if it does not already exist.
 
 doDelete ( $key, $flags=0)
 Delete an item.
 
 doGet ( $key, $flags=0, &$casToken=null)
 
 doSet ( $key, $value, $exptime=0, $flags=0)
 Set an item.
 
 handleError ( $msg, $rcode, $rerr, $rhdrs, $rbody)
 Handle storage error.
 
- Protected Member Functions inherited from MediumSpecificBagOStuff
 cas ( $casToken, $key, $value, $exptime=0, $flags=0)
 Check and set an item.
 
 debug ( $text)
 
 doCas ( $casToken, $key, $value, $exptime=0, $flags=0)
 Check and set an item.
 
 doChangeTTL ( $key, $exptime, $flags)
 
 doDeleteMulti (array $keys, $flags=0)
 
 doGetMulti (array $keys, $flags=0)
 Get an associative array containing the item for each of the keys that have items.
 
 doSetMulti (array $data, $exptime=0, $flags=0)
 
 getExpirationAsTimestamp ( $exptime)
 Convert an optionally relative timestamp to an absolute time.
 
 getExpirationAsTTL ( $exptime)
 Convert an optionally absolute expiry time to a relative time.
 
 isInteger ( $value)
 Check if a value is an integer.
 
 isRelativeExpiration ( $exptime)
 
 makeValueOrSegmentList ( $key, $value, $exptime, $flags)
 Determine the entry (inline or segment list) to store under a key to save the value.
 
 mergeViaCas ( $key, callable $callback, $exptime, $attempts, $flags)
 
 resolveSegments ( $key, $mainValue)
 Get and reassemble the chunks of blob at the given key.
 
 serialize ( $value)
 
 setLastError ( $err)
 Set the "last error" registry.
 
 unserialize ( $value)
 
- Protected Member Functions inherited from BagOStuff
 fieldHasFlags ( $field, $flags)
 
 mergeFlagMaps (array $bags)
 Merge the flag maps of one or more BagOStuff objects into a "lowest common denominator" map.
 

Private Member Functions

 decodeBody ( $body)
 Processes the response body.
 
 encodeBody ( $body)
 Prepares the request body (the "value" portion of our key/value store) for transmission.
 

Private Attributes

MultiHttpClient $client
 
array $extendedErrorBodyFields
 additional body fields to log on error, if possible
 
string $hmacKey
 Optional HMAC Key for protecting the serialized blob.
 
array $httpParams
 http parameters: readHeaders, writeHeaders, deleteHeaders, writeMethod
 
string $serializationType
 Optional serialization type to use.
 
string $url
 REST URL to use for storage.
 

Additional Inherited Members

- Protected Attributes inherited from MediumSpecificBagOStuff
callable[] $busyCallbacks = []
 
string $keyspace = 'local'
 
int $lastError = self::ERR_NONE
 ERR_* class constant.
 
array[] $locks = []
 Lock tracking.
 
int $segmentationSize
 Bytes; chunk size of segmented cache values.
 
int $segmentedValueMaxSize
 Bytes; maximum total size of a segmented cache value.
 
int $syncTimeout
 Seconds.
 
- Protected Attributes inherited from BagOStuff
callable null $asyncHandler
 
int[] $attrMap = []
 Map of (ATTR_* class constant => QOS_* class constant)
 
bool $debugMode = false
 
LoggerInterface $logger
 

Detailed Description

Interface to key-value storage behind an HTTP server.

Uses URL of the form "baseURL/{KEY}" to store, fetch, and delete values.

E.g., when base URL is /sessions/v1, then the store would do:

PUT /sessions/v1/12345758

and fetch would do:

GET /sessions/v1/12345758

delete would do:

DELETE /sessions/v1/12345758

Minimal generic configuration:

$wgObjectCaches['sessions'] = array(
'class' => 'RESTBagOStuff',
'url' => 'http://localhost:7231/wikimedia.org/somepath/'
);
$wgObjectCaches
Advanced object cache configuration.

Configuration for Kask (session storage):

$wgObjectCaches['sessions'] = array(
'class' => 'RESTBagOStuff',
'url' => 'https://kaskhost:1234/sessions/v1/',
'httpParams' => [
'readHeaders' => [],
'writeHeaders' => [ 'content-type' => 'application/octet-stream' ],
'deleteHeaders' => [],
'writeMethod' => 'POST',
],
'serialization_type' => 'JSON',
'extendedErrorBodyFields' => [ 'type', 'title', 'detail', 'instance' ]
);
$wgSessionCacheType = 'sessions';
$wgSessionCacheType
The cache type for storing session data.

Definition at line 48 of file RESTBagOStuff.php.

Constructor & Destructor Documentation

◆ __construct()

RESTBagOStuff::__construct ( $params)

Member Function Documentation

◆ decodeBody()

RESTBagOStuff::decodeBody ( $body)
private

Processes the response body.

Parameters
string$bodyrequest body to process
Returns
mixed|bool the processed body, or false on error

Definition at line 232 of file RESTBagOStuff.php.

References $serialized, and MediumSpecificBagOStuff\unserialize().

Referenced by doGet(), and handleError().

◆ decr()

RESTBagOStuff::decr ( $key,
$value = 1,
$flags = 0 )

Decrease stored value of $key by $value while preserving its TTL.

Parameters
string$key
int$valueValue to subtract from $key (default: 1) [optional]
int$flagsBit field of class WRITE_* constants [optional]
Returns
int|bool New value or false on failure

Reimplemented from BagOStuff.

Definition at line 222 of file RESTBagOStuff.php.

References incr().

◆ doAdd()

RESTBagOStuff::doAdd ( $key,
$value,
$exptime = 0,
$flags = 0 )
protected

Insert an item if it does not already exist.

Parameters
string$key
mixed$value
int$exptime
int$flagsBitfield of BagOStuff::WRITE_* constants (since 1.33)
Returns
bool Success

Reimplemented from MediumSpecificBagOStuff.

Definition at line 186 of file RESTBagOStuff.php.

◆ doDelete()

RESTBagOStuff::doDelete ( $key,
$flags = 0 )
protected

Delete an item.

Parameters
string$key
int$flagsBitfield of BagOStuff::WRITE_* constants
Returns
bool True if the item was deleted or not found, false on failure

Reimplemented from MediumSpecificBagOStuff.

Definition at line 195 of file RESTBagOStuff.php.

References handleError().

◆ doGet()

RESTBagOStuff::doGet ( $key,
$flags = 0,
& $casToken = null )
protected
Parameters
string$key
int$flagsBitfield of BagOStuff::READ_* constants [optional]
mixed | null&$casTokenToken to use for check-and-set comparisons
Returns
mixed Returns false on failure or if the item does not exist

Reimplemented from MediumSpecificBagOStuff.

Definition at line 143 of file RESTBagOStuff.php.

References decodeBody(), and handleError().

◆ doSet()

RESTBagOStuff::doSet ( $key,
$value,
$exptime = 0,
$flags = 0 )
protected

Set an item.

Parameters
string$key
mixed$value
int$exptimeEither an interval in seconds or a unix timestamp for expiry
int$flagsBitfield of BagOStuff::WRITE_* constants
Returns
bool Success

Reimplemented from MediumSpecificBagOStuff.

Definition at line 169 of file RESTBagOStuff.php.

References encodeBody(), and handleError().

◆ encodeBody()

RESTBagOStuff::encodeBody ( $body)
private

Prepares the request body (the "value" portion of our key/value store) for transmission.

Parameters
string$bodyrequest body to prepare
Returns
string the prepared body
Exceptions
LogicException

Definition at line 272 of file RESTBagOStuff.php.

References serialize().

Referenced by doSet().

◆ handleError()

RESTBagOStuff::handleError ( $msg,
$rcode,
$rerr,
$rhdrs,
$rbody )
protected

Handle storage error.

Parameters
string$msgError message
int$rcodeError code from client
string$rerrError message from client
array$rhdrsResponse headers
string$rbodyError body from client (if any)
Returns
false

Definition at line 315 of file RESTBagOStuff.php.

References $context, decodeBody(), IExpiringStore\ERR_UNEXPECTED, and MediumSpecificBagOStuff\setLastError().

Referenced by doDelete(), doGet(), and doSet().

◆ incr()

RESTBagOStuff::incr ( $key,
$value = 1,
$flags = 0 )

Increase stored value of $key by $value while preserving its TTL.

Parameters
string$keyKey to increase
int$valueValue to add to $key (default: 1) [optional]
int$flagsBit field of class WRITE_* constants [optional]
Returns
int|bool New value or false on failure

Reimplemented from BagOStuff.

Definition at line 210 of file RESTBagOStuff.php.

References MediumSpecificBagOStuff\isInteger(), and BagOStuff\READ_LATEST.

Referenced by decr().

◆ setLogger()

RESTBagOStuff::setLogger ( LoggerInterface $logger)
Parameters
LoggerInterface$logger
Returns
void

Reimplemented from BagOStuff.

Definition at line 138 of file RESTBagOStuff.php.

References BagOStuff\$logger.

Member Data Documentation

◆ $client

MultiHttpClient RESTBagOStuff::$client
private

Definition at line 64 of file RESTBagOStuff.php.

◆ $extendedErrorBodyFields

array RESTBagOStuff::$extendedErrorBodyFields
private

additional body fields to log on error, if possible

Definition at line 96 of file RESTBagOStuff.php.

◆ $hmacKey

string RESTBagOStuff::$hmacKey
private

Optional HMAC Key for protecting the serialized blob.

If omitted, or if serializationType is "legacy", then no protection is done

Definition at line 91 of file RESTBagOStuff.php.

◆ $httpParams

array RESTBagOStuff::$httpParams
private

http parameters: readHeaders, writeHeaders, deleteHeaders, writeMethod

Definition at line 75 of file RESTBagOStuff.php.

◆ $serializationType

string RESTBagOStuff::$serializationType
private

Optional serialization type to use.

Allowed values: "PHP", "JSON", or "legacy". "legacy" is PHP serialization with no serialization type tagging or hmac protection.

Deprecated
since 1.34, the "legacy" value will be removed in 1.35. Use either "PHP" or "JSON".

Definition at line 84 of file RESTBagOStuff.php.

◆ $url

string RESTBagOStuff::$url
private

REST URL to use for storage.

Definition at line 70 of file RESTBagOStuff.php.

◆ DEFAULT_CONN_TIMEOUT

const RESTBagOStuff::DEFAULT_CONN_TIMEOUT = 1.2

Default connection timeout in seconds.

The kernel retransmits the SYN packet after 1 second, so 1.2 seconds allows for 1 retransmit without permanent failure.

Definition at line 54 of file RESTBagOStuff.php.

Referenced by __construct().

◆ DEFAULT_REQ_TIMEOUT

const RESTBagOStuff::DEFAULT_REQ_TIMEOUT = 3.0

Default request timeout.

Definition at line 59 of file RESTBagOStuff.php.

Referenced by __construct().


The documentation for this class was generated from the following file: