MediaWiki
1.23.2
|
Base class for all backends using particular storage medium. More...
Public Member Functions | |
__construct (array $config) | |
clearCache (array $paths=null) | |
Invalidate any in-process file stat and property cache. More... | |
concatenate (array $params) | |
Concatenate a list of storage files into a single file system file. More... | |
copyInternal (array $params) | |
Copy a file from one storage path to another in the backend. More... | |
createInternal (array $params) | |
Create a file in the backend with the given contents. More... | |
deleteInternal (array $params) | |
Delete a file at the storage path. More... | |
describeInternal (array $params) | |
Alter metadata for a file at the storage path. More... | |
directoryExists (array $params) | |
Check if a directory exists at a given storage path. More... | |
executeOpHandlesInternal (array $fileOpHandles) | |
Execute a list of FileBackendStoreOpHandle handles in parallel. More... | |
fileExists (array $params) | |
Check if a file exists at a storage path in the backend. More... | |
getDirectoryList (array $params) | |
Get an iterator to list all directories under a storage directory. More... | |
getDirectoryListInternal ( $container, $dir, array $params) | |
Do not call this function from places outside FileBackend. More... | |
getFileContentsMulti (array $params) | |
Like getFileContents() except it takes an array of storage paths and returns a map of storage paths to strings (or null on failure). More... | |
getFileHttpUrl (array $params) | |
getFileList (array $params) | |
Get an iterator to list all stored files under a storage directory. More... | |
getFileListInternal ( $container, $dir, array $params) | |
Do not call this function from places outside FileBackend. More... | |
getFileProps (array $params) | |
Get the properties of the file at a storage path in the backend. More... | |
getFileSha1Base36 (array $params) | |
Get a SHA-1 hash of the file at a storage path in the backend. More... | |
getFileSize (array $params) | |
Get the size (bytes) of a file at a storage path in the backend. More... | |
getFileStat (array $params) | |
Get quick information about a file at a storage path in the backend. More... | |
getFileTimestamp (array $params) | |
Get the last-modified timestamp of the file at a storage path. More... | |
getFileXAttributes (array $params) | |
Get metadata about a file at a storage path in the backend. More... | |
getLocalCopyMulti (array $params) | |
Like getLocalCopy() except it takes an array of storage paths and returns a map of storage paths to TempFSFile objects (or null on failure). More... | |
getLocalReferenceMulti (array $params) | |
Like getLocalReference() except it takes an array of storage paths and returns a map of storage paths to FSFile objects (or null on failure). More... | |
getOperationsInternal (array $ops) | |
Return a list of FileOp objects from a list of operations. More... | |
getPathsToLockForOpsInternal (array $performOps) | |
Get a list of storage paths to lock for a list of operations Returns an array with LockManager::LOCK_UW (shared locks) and LockManager::LOCK_EX (exclusive locks) keys, each corresponding to a list of storage paths to be locked. More... | |
getScopedLocksForOps (array $ops, Status $status) | |
Get an array of scoped locks needed for a batch of file operations. More... | |
isPathUsableInternal ( $storagePath) | |
Check if a file can be created or changed at a given storage path. More... | |
isSingleShardPathInternal ( $storagePath) | |
Check if a storage path maps to a single shard. More... | |
maxFileSizeInternal () | |
Get the maximum allowable file size given backend medium restrictions and basic performance constraints. More... | |
moveInternal (array $params) | |
Move a file from one storage path to another in the backend. More... | |
nullInternal (array $params) | |
No-op file operation that does nothing. More... | |
preloadCache (array $paths) | |
Preload persistent file stat cache and property cache into in-process cache. More... | |
preloadFileStat (array $params) | |
Preload file stat information (concurrently if possible) into in-process cache. More... | |
storeInternal (array $params) | |
Store a file into the backend from a file on disk. More... | |
streamFile (array $params) | |
Stream the file at a storage path in the backend. More... | |
Public Member Functions inherited from FileBackend | |
clean (array $params) | |
Delete a storage directory if it is empty. More... | |
copy (array $params, array $opts=array()) | |
Performs a single copy operation. More... | |
create (array $params, array $opts=array()) | |
Performs a single create operation. More... | |
delete (array $params, array $opts=array()) | |
Performs a single delete operation. More... | |
describe (array $params, array $opts=array()) | |
Performs a single describe operation. More... | |
doOperation (array $op, array $opts=array()) | |
Same as doOperations() except it takes a single operation. More... | |
doOperations (array $ops, array $opts=array()) | |
This is the main entry point into the backend for write operations. More... | |
doQuickOperation (array $op) | |
Same as doQuickOperations() except it takes a single operation. More... | |
doQuickOperations (array $ops, array $opts=array()) | |
Perform a set of independent file operations on some files. More... | |
getContainerStoragePath ( $container) | |
Get the storage path for the given container for this backend. More... | |
getFeatures () | |
Get the a bitfield of extra features supported by the backend medium. More... | |
getFileContents (array $params) | |
Get the contents of a file at a storage path in the backend. More... | |
getJournal () | |
Get the file journal object for this backend. More... | |
getLocalCopy (array $params) | |
Get a local copy on disk of the file at a storage path in the backend. More... | |
getLocalReference (array $params) | |
Returns a file system file, identical to the file at a storage path. More... | |
getName () | |
Get the unique backend name. More... | |
getReadOnlyReason () | |
Get an explanatory message if this backend is read-only. More... | |
getRootStoragePath () | |
Get the root storage path of this backend. More... | |
getScopedFileLocks (array $paths, $type, Status $status) | |
Lock the files at the given storage paths in the backend. More... | |
getTopDirectoryList (array $params) | |
Same as FileBackend::getDirectoryList() except only lists directories that are immediately under the given directory. More... | |
getTopFileList (array $params) | |
Same as FileBackend::getFileList() except only lists files that are immediately under the given directory. More... | |
getWikiId () | |
Get the wiki identifier used for this backend (possibly empty). More... | |
hasFeatures ( $bitfield) | |
Check if the backend medium supports a field of extra features. More... | |
isReadOnly () | |
Check if this backend is read-only. More... | |
lockFiles (array $paths, $type) | |
Lock the files at the given storage paths in the backend. More... | |
move (array $params, array $opts=array()) | |
Performs a single move operation. More... | |
prepare (array $params) | |
Prepare a storage directory for usage. More... | |
publish (array $params) | |
Remove measures to block web access to a storage directory and the container it belongs to. More... | |
quickCopy (array $params) | |
Performs a single quick copy operation. More... | |
quickCreate (array $params) | |
Performs a single quick create operation. More... | |
quickDelete (array $params) | |
Performs a single quick delete operation. More... | |
quickDescribe (array $params) | |
Performs a single quick describe operation. More... | |
quickMove (array $params) | |
Performs a single quick move operation. More... | |
quickStore (array $params) | |
Performs a single quick store operation. More... | |
secure (array $params) | |
Take measures to block web access to a storage directory and the container it belongs to. More... | |
store (array $params, array $opts=array()) | |
Performs a single store operation. More... | |
unlockFiles (array $paths, $type) | |
Unlock the files at the given storage paths in the backend. More... | |
Public Attributes | |
const | CACHE_CHEAP_SIZE = 500 |
const | CACHE_EXPENSIVE_SIZE = 5 |
const | CACHE_TTL = 10 |
Public Attributes inherited from FileBackend | |
const | ATTR_HEADERS = 1 |
Flags for supported features. More... | |
const | ATTR_METADATA = 2 |
Protected Member Functions | |
deleteContainerCache ( $container) | |
Delete the cached info for a container. More... | |
deleteFileCache ( $path) | |
Delete the cached stat info for a file path. More... | |
directoriesAreVirtual () | |
Is this a key/value store where directories are just virtual? Virtual directories exists in so much as files exists that are prefixed with the directory path followed by a forward slash. More... | |
doClean (array $params) | |
doCleanInternal ( $container, $dir, array $params) | |
doClearCache (array $paths=null) | |
Clears any additional stat caches for storage paths. More... | |
doConcatenate (array $params) | |
doCopyInternal (array $params) | |
doCreateInternal (array $params) | |
doDeleteInternal (array $params) | |
doDescribeInternal (array $params) | |
doDirectoryExists ( $container, $dir, array $params) | |
doExecuteOpHandlesInternal (array $fileOpHandles) | |
doGetFileContentsMulti (array $params) | |
doGetFileSha1Base36 (array $params) | |
doGetFileStat (array $params) | |
doGetFileStatMulti (array $params) | |
Get file stat information (concurrently if possible) for several files. More... | |
doGetFileXAttributes (array $params) | |
doGetLocalCopyMulti (array $params) | |
doGetLocalReferenceMulti (array $params) | |
doMoveInternal (array $params) | |
doOperationsInternal (array $ops, array $opts) | |
doPrepare (array $params) | |
doPrepareInternal ( $container, $dir, array $params) | |
doPrimeContainerCache (array $containerInfo) | |
Fill the backend-specific process cache given an array of resolved container names and their corresponding cached info. More... | |
doPublish (array $params) | |
doPublishInternal ( $container, $dir, array $params) | |
doQuickOperationsInternal (array $ops) | |
doSecure (array $params) | |
doSecureInternal ( $container, $dir, array $params) | |
doStoreInternal (array $params) | |
doStreamFile (array $params) | |
fullContainerName ( $container) | |
Get the full container name, including the wiki ID prefix. More... | |
getContainerHashLevels ( $container) | |
Get the sharding config for a container. More... | |
getContainerShard ( $container, $relPath) | |
Get the container name shard suffix for a given path. More... | |
getContainerSuffixes ( $container) | |
Get a list of full container shard suffixes for a container. More... | |
getContentType ( $storagePath, $content, $fsPath) | |
Get the content type to use in HEAD/GET requests for a file. More... | |
primeContainerCache (array $items) | |
Do a batch lookup from cache for container stats for all containers used in a list of container names or storage paths objects. More... | |
primeFileCache (array $items) | |
Do a batch lookup from cache for file stats for all paths used in a list of storage paths or FileOp objects. More... | |
resolveContainerName ( $container) | |
Resolve a container name, checking if it's allowed by the backend. More... | |
resolveContainerPath ( $container, $relStoragePath) | |
Resolve a relative storage path, checking if it's allowed by the backend. More... | |
resolveStoragePath ( $storagePath) | |
Splits a storage path into an internal container name, an internal relative file name, and a container shard suffix. More... | |
resolveStoragePathReal ( $storagePath) | |
Like resolveStoragePath() except null values are returned if the container is sharded and the shard could not be determined or if the path ends with '/'. More... | |
setConcurrencyFlags (array $opts) | |
Set the 'concurrency' option from a list of operation options. More... | |
setContainerCache ( $container, array $val) | |
Set the cached info for a container. More... | |
setFileCache ( $path, array $val) | |
Set the cached stat info for a file path. More... | |
stripInvalidHeadersFromOp (array $op) | |
Strip long HTTP headers from a file operation. More... | |
Protected Member Functions inherited from FileBackend | |
getScopedPHPBehaviorForOps () | |
Enter file operation scope. More... | |
Static Protected Member Functions | |
static | isValidContainerName ( $container) |
Check if a container name is valid. More... | |
static | normalizeXAttributes (array $xattr) |
Normalize file headers/metadata to the FileBackend::getFileXAttributes() format. More... | |
Static Protected Member Functions inherited from FileBackend | |
static | normalizeContainerPath ( $path) |
Validate and normalize a relative storage path. More... | |
Protected Attributes | |
$cheapCache | |
$expensiveCache | |
$maxFileSize = 4294967296 | |
BagOStuff | $memCache |
callback | $mimeCallback |
Method to get the MIME type of files *. More... | |
array | $shardViaHashLevels = array() |
Map of container names to sharding config *. More... | |
Protected Attributes inherited from FileBackend | |
int | $concurrency |
How many operations can be done in parallel *. More... | |
FileJournal | $fileJournal |
LockManager | $lockManager |
string | $name |
Unique backend name *. More... | |
string | $parallelize |
When to do operations in parallel *. More... | |
string | $readOnly |
Read-only explanation message *. More... | |
string | $wikiId |
Unique wiki name *. More... | |
Private Member Functions | |
containerCacheKey ( $container) | |
Get the cache key for a container. More... | |
fileCacheKey ( $path) | |
Get the cache key for a file path. More... | |
Additional Inherited Members | |
Static Public Member Functions inherited from FileBackend | |
static | extensionFromPath ( $path) |
Get the final extension from a storage or FS path. More... | |
static | isPathTraversalFree ( $path) |
Check if a relative path has no directory traversals. More... | |
static | isStoragePath ( $path) |
Check if a given path is a "mwstore://" path. More... | |
static | makeContentDisposition ( $type, $filename='') |
Build a Content-Disposition header value per RFC 6266. More... | |
static | normalizeStoragePath ( $storagePath) |
Normalize a storage path by cleaning up directory separators. More... | |
static | parentStoragePath ( $storagePath) |
Get the parent storage directory of a storage path. More... | |
static | splitStoragePath ( $storagePath) |
Split a storage path into a backend name, a container name, and a relative file path. More... | |
Base class for all backends using particular storage medium.
This class defines the methods as abstract that subclasses must implement. Outside callers should not use functions with "Internal" in the name.
The FileBackend operations are implemented using basic functions such as storeInternal(), copyInternal(), deleteInternal() and the like. This class is also responsible for path resolution and sanitization.
Definition at line 38 of file FileBackendStore.php.
FileBackendStore::__construct | ( | array | $config | ) |
array | $config |
Reimplemented from FileBackend.
Reimplemented in SwiftFileBackend, and FSFileBackend.
Definition at line 64 of file FileBackendStore.php.
References StreamFile\contentTypeFromPath().
|
final |
Invalidate any in-process file stat and property cache.
If $paths is given, then only the cache for those files will be cleared.
array | $paths | Storage paths (optional) |
Reimplemented from FileBackend.
Definition at line 1254 of file FileBackendStore.php.
References $path, as, and doClearCache().
Referenced by copyInternal(), createInternal(), deleteInternal(), describeInternal(), SwiftFileBackend\doGetFileSha1base36(), SwiftFileBackend\doGetFileXAttributes(), doOperationsInternal(), doQuickOperationsInternal(), moveInternal(), storeInternal(), and streamFile().
|
final |
Concatenate a list of storage files into a single file system file.
The target path should refer to a file that is already locked or otherwise safe from modification from other processes. Normally, the file will be a new temp file, which should be adequate.
array | $params | Operation parameters, include:
|
Reimplemented from FileBackend.
Definition at line 345 of file FileBackendStore.php.
References $params, $section, doConcatenate(), FileBackend\getScopedFileLocks(), LockManager\LOCK_UW, Status\newGood(), and wfDebugLog().
|
private |
Get the cache key for a container.
string | $container | Resolved container name |
Definition at line 1567 of file FileBackendStore.php.
Referenced by primeContainerCache(), and setContainerCache().
|
final |
Copy a file from one storage path to another in the backend.
This will overwrite any file that exists at the destination. Do not call this function from places outside FileBackend and FileOp.
$params include:
array | $params |
Definition at line 200 of file FileBackendStore.php.
References $params, $section, array(), clearCache(), deleteFileCache(), and doCopyInternal().
Referenced by doMoveInternal().
|
final |
Create a file in the backend with the given contents.
This will overwrite any file that exists at the destination. Do not call this function from places outside FileBackend and FileOp.
$params include:
array | $params |
Definition at line 117 of file FileBackendStore.php.
References $params, $section, array(), clearCache(), deleteFileCache(), doCreateInternal(), maxFileSizeInternal(), and Status\newFatal().
|
finalprotected |
Delete the cached info for a container.
The cache key is salted for a while to prevent race conditions.
string | $container | Resolved container name |
Definition at line 1587 of file FileBackendStore.php.
Referenced by doClean().
|
finalprotected |
Delete the cached stat info for a file path.
The cache key is salted for a while to prevent race conditions. Since negatives (404s) are not cached, this does not need to be called when a file is created at a path were there was none before.
string | $path | Storage path |
Definition at line 1693 of file FileBackendStore.php.
References $path, and FileBackend\normalizeStoragePath().
Referenced by copyInternal(), createInternal(), deleteInternal(), describeInternal(), moveInternal(), storeInternal(), and streamFile().
|
final |
Delete a file at the storage path.
Do not call this function from places outside FileBackend and FileOp.
$params include:
array | $params |
Definition at line 232 of file FileBackendStore.php.
References $section, array(), clearCache(), deleteFileCache(), and doDeleteInternal().
Referenced by doMoveInternal().
|
final |
Alter metadata for a file at the storage path.
Do not call this function from places outside FileBackend and FileOp.
$params include:
array | $params |
Definition at line 312 of file FileBackendStore.php.
References $params, $section, array(), clearCache(), deleteFileCache(), doDescribeInternal(), and Status\newGood().
|
abstractprotected |
Is this a key/value store where directories are just virtual? Virtual directories exists in so much as files exists that are prefixed with the directory path followed by a forward slash.
Reimplemented in SwiftFileBackend, FSFileBackend, and MemoryFileBackend.
Referenced by doClean().
|
final |
Check if a directory exists at a given storage path.
Backends using key/value stores will check if the path is a virtual directory, meaning there are files under the given directory.
Storage backends with eventual consistency might return stale data.
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 901 of file FileBackendStore.php.
References $dir, $params, $res, as, doDirectoryExists(), getContainerSuffixes(), list, resolveStoragePath(), FileBackend\splitStoragePath(), and wfDebug().
|
finalprotected |
Reimplemented from FileBackend.
Definition at line 543 of file FileBackendStore.php.
References $dir, $params, $section, array(), as, deleteContainerCache(), directoriesAreVirtual(), doCleanInternal(), getContainerSuffixes(), FileBackend\getScopedFileLocks(), FileBackend\getTopDirectoryList(), list, LockManager\LOCK_EX, Status\newGood(), resolveStoragePath(), FileBackend\splitStoragePath(), and wfDebug().
|
protected |
$container | ||
string | $dir | |
array | $params |
Reimplemented in FSFileBackend, and SwiftFileBackend.
Definition at line 595 of file FileBackendStore.php.
References Status\newGood().
Referenced by doClean().
|
protected |
Clears any additional stat caches for storage paths.
array | $paths | Storage paths (optional) |
Reimplemented in FSFileBackend.
Definition at line 1278 of file FileBackendStore.php.
Referenced by clearCache().
|
protected |
array | $params |
Definition at line 370 of file FileBackendStore.php.
References $ok, $params, $path, array(), as, FileBackend\getLocalReference(), getLocalReferenceMulti(), Status\newGood(), wfRestoreWarnings(), and wfSuppressWarnings().
Referenced by concatenate().
|
abstractprotected |
array | $params |
Reimplemented in SwiftFileBackend, FSFileBackend, and MemoryFileBackend.
Referenced by copyInternal().
|
abstractprotected |
array | $params |
Reimplemented in SwiftFileBackend, FSFileBackend, and MemoryFileBackend.
Referenced by createInternal().
|
abstractprotected |
array | $params |
Reimplemented in SwiftFileBackend, FSFileBackend, and MemoryFileBackend.
Referenced by deleteInternal().
|
protected |
array | $params |
Reimplemented in SwiftFileBackend.
Definition at line 330 of file FileBackendStore.php.
References Status\newGood().
Referenced by describeInternal().
|
abstractprotected |
string | $container | Resolved container name |
string | $dir | Resolved path relative to container |
array | $params |
Reimplemented in FSFileBackend, SwiftFileBackend, and MemoryFileBackend.
Referenced by directoryExists().
|
protected |
array | $fileOpHandles |
FileBackendError |
Reimplemented in SwiftFileBackend, and FSFileBackend.
Definition at line 1209 of file FileBackendStore.php.
References array().
Referenced by executeOpHandlesInternal().
|
protected |
array | $params |
Reimplemented in SwiftFileBackend.
Definition at line 692 of file FileBackendStore.php.
References $path, array(), as, doGetLocalReferenceMulti(), wfRestoreWarnings(), and wfSuppressWarnings().
Referenced by getFileContentsMulti().
|
protected |
array | $params |
Definition at line 765 of file FileBackendStore.php.
References FileBackend\getLocalReference().
Referenced by getFileSha1Base36().
|
abstractprotected |
Reimplemented in SwiftFileBackend, FSFileBackend, and MemoryFileBackend.
Referenced by getFileStat().
|
protected |
Get file stat information (concurrently if possible) for several files.
array | $params | Parameters include:
|
Reimplemented in SwiftFileBackend.
Definition at line 1335 of file FileBackendStore.php.
Referenced by preloadFileStat().
|
protected |
Reimplemented in SwiftFileBackend.
Definition at line 733 of file FileBackendStore.php.
References array().
Referenced by getFileXAttributes().
|
abstractprotected |
array | $params |
Reimplemented in SwiftFileBackend, FSFileBackend, MemoryFileBackend, and MockFileBackend.
Referenced by doGetLocalReferenceMulti(), and getLocalCopyMulti().
|
protected |
array | $params |
Reimplemented in FSFileBackend.
Definition at line 821 of file FileBackendStore.php.
References doGetLocalCopyMulti().
Referenced by doGetFileContentsMulti(), and getLocalReferenceMulti().
|
protected |
array | $params |
Reimplemented in SwiftFileBackend, and FSFileBackend.
Definition at line 283 of file FileBackendStore.php.
References $params, array(), copyInternal(), deleteInternal(), and FileBackend\normalizeStoragePath().
Referenced by moveInternal().
Reimplemented from FileBackend.
Definition at line 1070 of file FileBackendStore.php.
References $section, array(), as, FileOpBatch\attempt(), clearCache(), getOperationsInternal(), getPathsToLockForOpsInternal(), FileBackend\getScopedFileLocks(), Status\newGood(), preloadFileStat(), primeContainerCache(), and setConcurrencyFlags().
|
finalprotected |
Reimplemented from FileBackend.
Definition at line 438 of file FileBackendStore.php.
References $dir, $params, $section, as, doPrepareInternal(), getContainerSuffixes(), list, Status\newGood(), resolveStoragePath(), FileBackend\splitStoragePath(), and wfDebug().
|
protected |
$container | ||
string | $dir | |
array | $params |
Reimplemented in FSFileBackend, and SwiftFileBackend.
Definition at line 469 of file FileBackendStore.php.
References Status\newGood().
Referenced by doPrepare().
|
protected |
Fill the backend-specific process cache given an array of resolved container names and their corresponding cached info.
Only containers that actually exist should appear in the map.
array | $containerInfo | Map of resolved container names to cached info |
Reimplemented in SwiftFileBackend.
Definition at line 1639 of file FileBackendStore.php.
Referenced by primeContainerCache().
|
finalprotected |
Reimplemented from FileBackend.
Definition at line 508 of file FileBackendStore.php.
References $dir, $params, $section, as, doPublishInternal(), getContainerSuffixes(), list, Status\newGood(), resolveStoragePath(), FileBackend\splitStoragePath(), and wfDebug().
|
protected |
$container | ||
string | $dir | |
array | $params |
Reimplemented in FSFileBackend, and SwiftFileBackend.
Definition at line 539 of file FileBackendStore.php.
References Status\newGood().
Referenced by doPublish().
|
finalprotected |
Reimplemented from FileBackend.
Definition at line 1118 of file FileBackendStore.php.
References FileBackend\$concurrency, $params, $section, array(), as, clearCache(), executeOpHandlesInternal(), and Status\newGood().
|
finalprotected |
Reimplemented from FileBackend.
Definition at line 473 of file FileBackendStore.php.
References $dir, $params, $section, as, doSecureInternal(), getContainerSuffixes(), list, Status\newGood(), resolveStoragePath(), FileBackend\splitStoragePath(), and wfDebug().
|
protected |
$container | ||
string | $dir | |
array | $params |
Reimplemented in FSFileBackend, and SwiftFileBackend.
Definition at line 504 of file FileBackendStore.php.
References Status\newGood().
Referenced by doSecure().
|
abstractprotected |
array | $params |
Reimplemented in SwiftFileBackend, FSFileBackend, and MemoryFileBackend.
Referenced by storeInternal().
|
protected |
array | $params |
Reimplemented in SwiftFileBackend, and MemoryFileBackend.
Definition at line 888 of file FileBackendStore.php.
References $params, FileBackend\getLocalReference(), and Status\newGood().
Referenced by streamFile().
|
final |
Execute a list of FileBackendStoreOpHandle handles in parallel.
The resulting Status object fields will correspond to the order in which the handles where given.
array | $fileOpHandles |
FileBackendError |
Definition at line 1185 of file FileBackendStore.php.
References $res, $section, as, doExecuteOpHandlesInternal(), and FileBackend\getName().
Referenced by doQuickOperationsInternal().
|
private |
Get the cache key for a file path.
string | $path | Normalized storage path |
Definition at line 1648 of file FileBackendStore.php.
References $path.
Referenced by primeFileCache(), and setFileCache().
|
final |
Check if a file exists at a storage path in the backend.
This returns false if only a directory exists at the path.
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 599 of file FileBackendStore.php.
References $section, and getFileStat().
|
finalprotected |
Get the full container name, including the wiki ID prefix.
string | $container |
Definition at line 1527 of file FileBackendStore.php.
Referenced by resolveStoragePath().
|
finalprotected |
Get the sharding config for a container.
If greater than 0, then all file storage paths within the container are required to be hashed accordingly.
string | $container |
Definition at line 1487 of file FileBackendStore.php.
References array().
Referenced by getContainerShard(), and getContainerSuffixes().
|
finalprotected |
Get the container name shard suffix for a given path.
Any empty suffix means the container is not sharded.
string | $container | Container name |
string | $relPath | Storage path relative to the container |
Definition at line 1435 of file FileBackendStore.php.
References array(), getContainerHashLevels(), and list.
Referenced by resolveStoragePath().
|
finalprotected |
Get a list of full container shard suffixes for a container.
string | $container |
Definition at line 1508 of file FileBackendStore.php.
References array(), getContainerHashLevels(), list, and wfBaseConvert().
Referenced by directoryExists(), doClean(), doPrepare(), doPublish(), doSecure(), getDirectoryList(), and getFileList().
|
protected |
Get the content type to use in HEAD/GET requests for a file.
Definition at line 1799 of file FileBackendStore.php.
Referenced by SwiftFileBackend\doCreateInternal(), and SwiftFileBackend\doStoreInternal().
|
final |
Get an iterator to list all directories under a storage directory.
If the directory is of the form "mwstore://backend/container", then all directories in the container will be listed. If the directory is of form "mwstore://backend/container/dir", then all directories directly under that directory will be listed. Results will be storage directories relative to the given directory.
Storage backends with eventual consistency might return stale data.
Failures during iteration can result in FileBackendError exceptions (since 1.22).
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 936 of file FileBackendStore.php.
References $dir, $params, getContainerSuffixes(), getDirectoryListInternal(), list, resolveStoragePath(), FileBackend\splitStoragePath(), and wfDebug().
|
abstract |
Do not call this function from places outside FileBackend.
string | $container | Resolved container name |
string | $dir | Resolved path relative to container |
array | $params |
Reimplemented in FSFileBackend, SwiftFileBackend, and MemoryFileBackend.
Referenced by getDirectoryList().
FileBackendStore::getFileContentsMulti | ( | array | $params | ) |
Like getFileContents() except it takes an array of storage paths and returns a map of storage paths to strings (or null on failure).
The map keys (paths) are in the same order as the provided list of paths.
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 678 of file FileBackendStore.php.
References $params, $section, doGetFileContentsMulti(), and setConcurrencyFlags().
FileBackendStore::getFileHttpUrl | ( | array | $params | ) |
array | $params |
Reimplemented from FileBackend.
Reimplemented in SwiftFileBackend.
Definition at line 846 of file FileBackendStore.php.
|
final |
Get an iterator to list all stored files under a storage directory.
If the directory is of the form "mwstore://backend/container", then all files in the container will be listed. If the directory is of form "mwstore://backend/container/dir", then all files under that directory will be listed. Results will be storage paths relative to the given directory.
Storage backends with eventual consistency might return stale data.
Failures during iteration can result in FileBackendError exceptions (since 1.22).
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 966 of file FileBackendStore.php.
References $dir, $params, getContainerSuffixes(), getFileListInternal(), list, resolveStoragePath(), FileBackend\splitStoragePath(), and wfDebug().
|
abstract |
Do not call this function from places outside FileBackend.
string | $container | Resolved container name |
string | $dir | Resolved path relative to container |
array | $params |
Reimplemented in FSFileBackend, SwiftFileBackend, and MemoryFileBackend.
Referenced by getFileList().
|
final |
Get the properties of the file at a storage path in the backend.
This gives the result of FSFile::getProps() on a local copy of the file.
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 774 of file FileBackendStore.php.
References $section, FileBackend\getLocalReference(), and FSFile\placeholderProps().
|
final |
Get a SHA-1 hash of the file at a storage path in the backend.
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 737 of file FileBackendStore.php.
References $hash, $params, $path, $section, array(), doGetFileSha1Base36(), name, FileBackend\normalizeStoragePath(), wfProfileIn(), and wfProfileOut().
|
final |
Get the size (bytes) of a file at a storage path in the backend.
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 613 of file FileBackendStore.php.
References $section, and getFileStat().
|
final |
Get quick information about a file at a storage path in the backend.
If the file does not exist, then this returns false. Otherwise, the result is an associative array that includes:
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 620 of file FileBackendStore.php.
References $params, $path, $section, array(), doGetFileStat(), name, FileBackend\normalizeStoragePath(), normalizeXAttributes(), primeFileCache(), setFileCache(), wfDebug(), wfProfileIn(), and wfProfileOut().
Referenced by SwiftFileBackend\doDescribeInternal(), SwiftFileBackend\doGetFileSha1base36(), SwiftFileBackend\doGetFileXAttributes(), fileExists(), getFileSize(), getFileTimestamp(), and streamFile().
|
final |
Get the last-modified timestamp of the file at a storage path.
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 606 of file FileBackendStore.php.
References $section, and getFileStat().
|
final |
Get metadata about a file at a storage path in the backend.
If the file does not exist, then this returns false. Otherwise, the result is an associative array that includes:
Use FileBackend::hasFeatures() to check how well this is supported.
array | $params | $params include:
|
Reimplemented from FileBackend.
Definition at line 703 of file FileBackendStore.php.
References $params, $path, $section, array(), doGetFileXAttributes(), name, FileBackend\normalizeStoragePath(), normalizeXAttributes(), wfProfileIn(), and wfProfileOut().
|
final |
Like getLocalCopy() except it takes an array of storage paths and returns a map of storage paths to TempFSFile objects (or null on failure).
The map keys (paths) are in the same order as the provided list of paths.
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 825 of file FileBackendStore.php.
References $params, $section, doGetLocalCopyMulti(), and setConcurrencyFlags().
|
final |
Like getLocalReference() except it takes an array of storage paths and returns a map of storage paths to FSFile objects (or null on failure).
The map keys (paths) are in the same order as the provided list of paths.
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 782 of file FileBackendStore.php.
References $params, $path, $section, array(), as, doGetLocalReferenceMulti(), FileBackend\normalizeStoragePath(), and setConcurrencyFlags().
Referenced by doConcatenate().
|
final |
Return a list of FileOp objects from a list of operations.
Do not call this function from places outside FileBackend.
The result must have the same number of items as the input. An exception is thrown if an unsupported operation is requested.
array | $ops | Same format as doOperations() |
FileBackendError |
Definition at line 1007 of file FileBackendStore.php.
References $params, array(), and as.
Referenced by doOperationsInternal(), and getScopedLocksForOps().
|
final |
Get a list of storage paths to lock for a list of operations Returns an array with LockManager::LOCK_UW (shared locks) and LockManager::LOCK_EX (exclusive locks) keys, each corresponding to a list of storage paths to be locked.
All returned paths are normalized.
array | $performOps | List of FileOp objects |
Definition at line 1046 of file FileBackendStore.php.
References array(), as, LockManager\LOCK_EX, and LockManager\LOCK_UW.
Referenced by doOperationsInternal(), and getScopedLocksForOps().
Get an array of scoped locks needed for a batch of file operations.
Normally, FileBackend::doOperations() handles locking, unless the 'nonLocking' param is passed in. This function is useful if you want the files to be locked for a broader scope than just when the files are changing. For example, if you need to update DB metadata, you may want to keep the files locked until finished.
array | $ops | List of file operations to FileBackend::doOperations() |
Status | $status | Status to update on lock/unlock |
Reimplemented from FileBackend.
Definition at line 1064 of file FileBackendStore.php.
References array(), getOperationsInternal(), getPathsToLockForOpsInternal(), and FileBackend\getScopedFileLocks().
|
abstract |
Check if a file can be created or changed at a given storage path.
FS backends should check if the parent directory exists, files can be written under it, and that any file already there is writable. Backends using key/value stores should check if the container exists.
string | $storagePath |
Reimplemented in FSFileBackend, SwiftFileBackend, and MemoryFileBackend.
|
final |
Check if a storage path maps to a single shard.
Container dirs like "a", where the container shards on "x/xy", can reside on several shards. Such paths are tricky to handle.
string | $storagePath | Storage path |
Definition at line 1473 of file FileBackendStore.php.
References list, and resolveStoragePath().
|
staticfinalprotected |
Check if a container name is valid.
This checks for for length and illegal characters.
string | $container |
Definition at line 1355 of file FileBackendStore.php.
|
final |
Get the maximum allowable file size given backend medium restrictions and basic performance constraints.
Do not call this function from places outside FileBackend and FileOp.
Definition at line 84 of file FileBackendStore.php.
References $maxFileSize.
Referenced by createInternal(), and storeInternal().
|
final |
Move a file from one storage path to another in the backend.
This will overwrite any file that exists at the destination. Do not call this function from places outside FileBackend and FileOp.
$params include:
array | $params |
Definition at line 266 of file FileBackendStore.php.
References $params, $section, array(), clearCache(), deleteFileCache(), and doMoveInternal().
|
staticfinalprotected |
Normalize file headers/metadata to the FileBackend::getFileXAttributes() format.
array | $xattr |
Definition at line 1756 of file FileBackendStore.php.
References FileBackend\$name, $value, array(), and as.
Referenced by getFileStat(), getFileXAttributes(), preloadFileStat(), and primeFileCache().
|
final |
No-op file operation that does nothing.
Do not call this function from places outside FileBackend and FileOp.
array | $params |
Definition at line 341 of file FileBackendStore.php.
References Status\newGood().
|
final |
Preload persistent file stat cache and property cache into in-process cache.
This should be used when stat calls will be made on a known list of a many files.
array | $paths | Storage paths |
Reimplemented from FileBackend.
Definition at line 1243 of file FileBackendStore.php.
References $path, array(), as, list, primeContainerCache(), primeFileCache(), and resolveStoragePath().
|
final |
Preload file stat information (concurrently if possible) into in-process cache.
This should be used when stat calls will be made on a known list of a many files.
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 1281 of file FileBackendStore.php.
References $params, $path, $section, array(), as, doGetFileStatMulti(), FileBackend\normalizeStoragePath(), normalizeXAttributes(), setFileCache(), and wfDebug().
Referenced by doOperationsInternal().
|
finalprotected |
Do a batch lookup from cache for container stats for all containers used in a list of container names or storage paths objects.
This loads the persistent cache values into the process cache.
array | $items |
Definition at line 1600 of file FileBackendStore.php.
References $path, $section, array(), as, containerCacheKey(), doPrimeContainerCache(), list, and resolveStoragePath().
Referenced by doOperationsInternal(), SwiftFileBackend\getContainerStat(), and preloadCache().
|
finalprotected |
Do a batch lookup from cache for file stats for all paths used in a list of storage paths or FileOp objects.
This loads the persistent cache values into the process cache.
array | $items | List of storage paths |
Definition at line 1710 of file FileBackendStore.php.
References $path, $section, array(), as, fileCacheKey(), list, FileBackend\normalizeStoragePath(), normalizeXAttributes(), and resolveStoragePath().
Referenced by getFileStat(), and preloadCache().
|
protected |
Resolve a container name, checking if it's allowed by the backend.
This is intended for internal use, such as encoding illegal chars. Subclasses can override this to be more restrictive.
string | $container |
Definition at line 1543 of file FileBackendStore.php.
Referenced by resolveStoragePath().
|
protected |
Resolve a relative storage path, checking if it's allowed by the backend.
This is intended for internal use, such as encoding illegal chars or perhaps getting absolute paths (e.g. FS based backends). Note that the relative path may be the empty string (e.g. the path is simply to the container).
string | $container | Container name |
string | $relStoragePath | Storage path relative to the container |
Reimplemented in SwiftFileBackend, and FSFileBackend.
Definition at line 1557 of file FileBackendStore.php.
Referenced by resolveStoragePath().
|
finalprotected |
Splits a storage path into an internal container name, an internal relative file name, and a container shard suffix.
Any shard suffix is already appended to the internal container name. This also checks that the storage path is valid and within this backend.
If the container is sharded but a suffix could not be determined, this means that the path can only refer to a directory and can only be scanned by looking in all the container shards.
string | $storagePath |
Definition at line 1377 of file FileBackendStore.php.
References array(), fullContainerName(), getContainerShard(), list, name, FileBackend\normalizeContainerPath(), resolveContainerName(), resolveContainerPath(), and FileBackend\splitStoragePath().
Referenced by directoryExists(), doClean(), doPrepare(), doPublish(), doSecure(), getDirectoryList(), getFileList(), isSingleShardPathInternal(), preloadCache(), primeContainerCache(), primeFileCache(), and resolveStoragePathReal().
|
finalprotected |
Like resolveStoragePath() except null values are returned if the container is sharded and the shard could not be determined or if the path ends with '/'.
The later case is illegal for FS backends and can confuse listings for object store backends.
This function is used when resolving paths that must be valid locations for files. Directory and listing functions should generally just use resolveStoragePath() instead.
string | $storagePath |
Definition at line 1418 of file FileBackendStore.php.
References array(), list, and resolveStoragePath().
Referenced by SwiftFileBackend\addMissingMetadata(), SwiftFileBackend\doCopyInternal(), SwiftFileBackend\doCreateInternal(), SwiftFileBackend\doDeleteInternal(), SwiftFileBackend\doDescribeInternal(), SwiftFileBackend\doGetFileContentsMulti(), SwiftFileBackend\doGetFileStatMulti(), SwiftFileBackend\doGetLocalCopyMulti(), SwiftFileBackend\doMoveInternal(), SwiftFileBackend\doStoreInternal(), SwiftFileBackend\doStreamFile(), SwiftFileBackend\getFileHttpUrl(), SwiftFileBackend\isPathUsableInternal(), MemoryFileBackend\resolveHashKey(), and FSFileBackend\resolveToFSPath().
|
finalprotected |
Set the 'concurrency' option from a list of operation options.
array | $opts | Map of operation options |
Definition at line 1776 of file FileBackendStore.php.
References FileBackend\$concurrency.
Referenced by doOperationsInternal(), getFileContentsMulti(), getLocalCopyMulti(), and getLocalReferenceMulti().
|
finalprotected |
Set the cached info for a container.
string | $container | Resolved container name |
array | $val | Information to cache |
Definition at line 1577 of file FileBackendStore.php.
References containerCacheKey().
Referenced by SwiftFileBackend\getContainerStat().
|
finalprotected |
Set the cached stat info for a file path.
Negatives (404s) are not cached. By not caching negatives, we can skip cache salting for the case when a file is created at a path were there was none before.
string | $path | Storage path |
array | $val | Stat information to cache |
Definition at line 1660 of file FileBackendStore.php.
References $cache, $path, fileCacheKey(), FileBackend\normalizeStoragePath(), TS_UNIX, and wfTimestamp().
Referenced by getFileStat(), and preloadFileStat().
|
final |
Store a file into the backend from a file on disk.
This will overwrite any file that exists at the destination. Do not call this function from places outside FileBackend and FileOp.
$params include:
array | $params |
Definition at line 158 of file FileBackendStore.php.
References $params, $section, array(), clearCache(), deleteFileCache(), doStoreInternal(), maxFileSizeInternal(), and Status\newFatal().
|
final |
Stream the file at a storage path in the backend.
If the file does not exists, an HTTP 404 error will be given. Appropriate HTTP headers (Status, Content-Type, Content-Length) will be sent if streaming began, while none will be sent otherwise. Implementations should flush the output buffer before sending data.
array | $params | Parameters include:
|
Reimplemented from FileBackend.
Definition at line 850 of file FileBackendStore.php.
References $params, $res, $section, array(), clearCache(), deleteFileCache(), doStreamFile(), getFileStat(), name, Status\newGood(), StreamFile\NOT_MODIFIED, StreamFile\prepareForStream(), StreamFile\READY_STREAM, wfProfileIn(), and wfProfileOut().
|
protected |
Strip long HTTP headers from a file operation.
Most headers are just numbers, but some are allowed to be long. This function is useful for cleaning up headers and avoiding backend specific errors, especially in the middle of batch file operations.
array | $op | Same format as doOperation() |
Definition at line 1226 of file FileBackendStore.php.
References FileBackend\$name, $value, array(), and as.
|
protected |
Definition at line 41 of file FileBackendStore.php.
|
protected |
Definition at line 43 of file FileBackendStore.php.
|
protected |
Definition at line 49 of file FileBackendStore.php.
Referenced by maxFileSizeInternal().
|
protected |
Definition at line 39 of file FileBackendStore.php.
|
protected |
Method to get the MIME type of files *.
Definition at line 47 of file FileBackendStore.php.
Map of container names to sharding config *.
Definition at line 45 of file FileBackendStore.php.
const FileBackendStore::CACHE_CHEAP_SIZE = 500 |
Definition at line 52 of file FileBackendStore.php.
const FileBackendStore::CACHE_EXPENSIVE_SIZE = 5 |
Definition at line 53 of file FileBackendStore.php.
const FileBackendStore::CACHE_TTL = 10 |
Definition at line 51 of file FileBackendStore.php.