MediaWiki REL1_28
FileBackendStore Class Reference

Base class for all backends using particular storage medium. More...

Inheritance diagram for FileBackendStore:
Collaboration diagram for FileBackendStore:

Public Member Functions

 __construct (array $config)
 
 clearCache (array $paths=null)
 Invalidate any in-process file stat and property cache.
 
 concatenate (array $params)
 Concatenate a list of storage files into a single file system file.
 
 copyInternal (array $params)
 Copy a file from one storage path to another in the backend.
 
 createInternal (array $params)
 Create a file in the backend with the given contents.
 
 deleteInternal (array $params)
 Delete a file at the storage path.
 
 describeInternal (array $params)
 Alter metadata for a file at the storage path.
 
 directoryExists (array $params)
 Check if a directory exists at a given storage path.
 
 executeOpHandlesInternal (array $fileOpHandles)
 Execute a list of FileBackendStoreOpHandle handles in parallel.
 
 fileExists (array $params)
 Check if a file exists at a storage path in the backend.
 
 getDirectoryList (array $params)
 Get an iterator to list all directories under a storage directory.
 
 getDirectoryListInternal ( $container, $dir, array $params)
 Do not call this function from places outside FileBackend.
 
 getFileContentsMulti (array $params)
 Like getFileContents() except it takes an array of storage paths and returns a map of storage paths to strings (or null on failure).
 
 getFileHttpUrl (array $params)
 
 getFileList (array $params)
 Get an iterator to list all stored files under a storage directory.
 
 getFileListInternal ( $container, $dir, array $params)
 Do not call this function from places outside FileBackend.
 
 getFileProps (array $params)
 Get the properties of the file at a storage path in the backend.
 
 getFileSha1Base36 (array $params)
 Get a SHA-1 hash of the file at a storage path in the backend.
 
 getFileSize (array $params)
 Get the size (bytes) of a file at a storage path in the backend.
 
 getFileStat (array $params)
 Get quick information about a file at a storage path in the backend.
 
 getFileTimestamp (array $params)
 Get the last-modified timestamp of the file at a storage path.
 
 getFileXAttributes (array $params)
 Get metadata about a file at a storage path in the backend.
 
 getLocalCopyMulti (array $params)
 Like getLocalCopy() except it takes an array of storage paths and returns a map of storage paths to TempFSFile objects (or null on failure).
 
 getLocalReferenceMulti (array $params)
 Like getLocalReference() except it takes an array of storage paths and returns a map of storage paths to FSFile objects (or null on failure).
 
 getOperationsInternal (array $ops)
 Return a list of FileOp objects from a list of operations.
 
 getPathsToLockForOpsInternal (array $performOps)
 Get a list of storage paths to lock for a list of operations Returns an array with LockManager::LOCK_UW (shared locks) and LockManager::LOCK_EX (exclusive locks) keys, each corresponding to a list of storage paths to be locked.
 
 getScopedLocksForOps (array $ops, StatusValue $status)
 Get an array of scoped locks needed for a batch of file operations.
 
 isPathUsableInternal ( $storagePath)
 Check if a file can be created or changed at a given storage path.
 
 isSingleShardPathInternal ( $storagePath)
 Check if a storage path maps to a single shard.
 
 maxFileSizeInternal ()
 Get the maximum allowable file size given backend medium restrictions and basic performance constraints.
 
 moveInternal (array $params)
 Move a file from one storage path to another in the backend.
 
 nullInternal (array $params)
 No-op file operation that does nothing.
 
 preloadCache (array $paths)
 Preload persistent file stat cache and property cache into in-process cache.
 
 preloadFileStat (array $params)
 Preload file stat information (concurrently if possible) into in-process cache.
 
 storeInternal (array $params)
 Store a file into the backend from a file on disk.
 
 streamFile (array $params)
 Stream the file at a storage path in the backend.
 
- Public Member Functions inherited from FileBackend
 clean (array $params)
 Delete a storage directory if it is empty.
 
 copy (array $params, array $opts=[])
 Performs a single copy operation.
 
 create (array $params, array $opts=[])
 Performs a single create operation.
 
 delete (array $params, array $opts=[])
 Performs a single delete operation.
 
 describe (array $params, array $opts=[])
 Performs a single describe operation.
 
 doOperation (array $op, array $opts=[])
 Same as doOperations() except it takes a single operation.
 
 doOperations (array $ops, array $opts=[])
 This is the main entry point into the backend for write operations.
 
 doQuickOperation (array $op)
 Same as doQuickOperations() except it takes a single operation.
 
 doQuickOperations (array $ops, array $opts=[])
 Perform a set of independent file operations on some files.
 
 getContainerStoragePath ( $container)
 Get the storage path for the given container for this backend.
 
 getDomainId ()
 Get the domain identifier used for this backend (possibly empty).
 
 getFeatures ()
 Get the a bitfield of extra features supported by the backend medium.
 
 getFileContents (array $params)
 Get the contents of a file at a storage path in the backend.
 
 getJournal ()
 Get the file journal object for this backend.
 
 getLocalCopy (array $params)
 Get a local copy on disk of the file at a storage path in the backend.
 
 getLocalReference (array $params)
 Returns a file system file, identical to the file at a storage path.
 
 getName ()
 Get the unique backend name.
 
 getReadOnlyReason ()
 Get an explanatory message if this backend is read-only.
 
 getRootStoragePath ()
 Get the root storage path of this backend.
 
 getScopedFileLocks (array $paths, $type, StatusValue $status, $timeout=0)
 Lock the files at the given storage paths in the backend.
 
 getTopDirectoryList (array $params)
 Same as FileBackend::getDirectoryList() except only lists directories that are immediately under the given directory.
 
 getTopFileList (array $params)
 Same as FileBackend::getFileList() except only lists files that are immediately under the given directory.
 
 getWikiId ()
 Alias to getDomainId()
 
 hasFeatures ( $bitfield)
 Check if the backend medium supports a field of extra features.
 
 isReadOnly ()
 Check if this backend is read-only.
 
 lockFiles (array $paths, $type, $timeout=0)
 Lock the files at the given storage paths in the backend.
 
 move (array $params, array $opts=[])
 Performs a single move operation.
 
 prepare (array $params)
 Prepare a storage directory for usage.
 
 publish (array $params)
 Remove measures to block web access to a storage directory and the container it belongs to.
 
 quickCopy (array $params)
 Performs a single quick copy operation.
 
 quickCreate (array $params)
 Performs a single quick create operation.
 
 quickDelete (array $params)
 Performs a single quick delete operation.
 
 quickDescribe (array $params)
 Performs a single quick describe operation.
 
 quickMove (array $params)
 Performs a single quick move operation.
 
 quickStore (array $params)
 Performs a single quick store operation.
 
 secure (array $params)
 Take measures to block web access to a storage directory and the container it belongs to.
 
 setLogger (LoggerInterface $logger)
 
 store (array $params, array $opts=[])
 Performs a single store operation.
 
 unlockFiles (array $paths, $type)
 Unlock the files at the given storage paths in the backend.
 

Public Attributes

const CACHE_CHEAP_SIZE = 500
 
const CACHE_EXPENSIVE_SIZE = 5
 
const CACHE_TTL = 10
 
- Public Attributes inherited from FileBackend
const ATTR_HEADERS = 1
 Bitfield flags for supported features.
 
const ATTR_METADATA = 2
 
const ATTR_UNICODE_PATHS = 4
 

Protected Member Functions

 deleteContainerCache ( $container)
 Delete the cached info for a container.
 
 deleteFileCache ( $path)
 Delete the cached stat info for a file path.
 
 directoriesAreVirtual ()
 Is this a key/value store where directories are just virtual? Virtual directories exists in so much as files exists that are prefixed with the directory path followed by a forward slash.
 
 doClean (array $params)
 
 doCleanInternal ( $container, $dir, array $params)
 
 doClearCache (array $paths=null)
 Clears any additional stat caches for storage paths.
 
 doConcatenate (array $params)
 
 doCopyInternal (array $params)
 
 doCreateInternal (array $params)
 
 doDeleteInternal (array $params)
 
 doDescribeInternal (array $params)
 
 doDirectoryExists ( $container, $dir, array $params)
 
 doExecuteOpHandlesInternal (array $fileOpHandles)
 
 doGetFileContentsMulti (array $params)
 
 doGetFileSha1Base36 (array $params)
 
 doGetFileStat (array $params)
 
 doGetFileStatMulti (array $params)
 Get file stat information (concurrently if possible) for several files.
 
 doGetFileXAttributes (array $params)
 
 doGetLocalCopyMulti (array $params)
 
 doGetLocalReferenceMulti (array $params)
 
 doMoveInternal (array $params)
 
 doOperationsInternal (array $ops, array $opts)
 
 doPrepare (array $params)
 
 doPrepareInternal ( $container, $dir, array $params)
 
 doPrimeContainerCache (array $containerInfo)
 Fill the backend-specific process cache given an array of resolved container names and their corresponding cached info.
 
 doPublish (array $params)
 
 doPublishInternal ( $container, $dir, array $params)
 
 doQuickOperationsInternal (array $ops)
 
 doSecure (array $params)
 
 doSecureInternal ( $container, $dir, array $params)
 
 doStoreInternal (array $params)
 
 doStreamFile (array $params)
 
 fullContainerName ( $container)
 Get the full container name, including the wiki ID prefix.
 
 getContainerHashLevels ( $container)
 Get the sharding config for a container.
 
 getContainerShard ( $container, $relPath)
 Get the container name shard suffix for a given path.
 
 getContainerSuffixes ( $container)
 Get a list of full container shard suffixes for a container.
 
 getContentType ( $storagePath, $content, $fsPath)
 Get the content type to use in HEAD/GET requests for a file.
 
 primeContainerCache (array $items)
 Do a batch lookup from cache for container stats for all containers used in a list of container names or storage paths objects.
 
 primeFileCache (array $items)
 Do a batch lookup from cache for file stats for all paths used in a list of storage paths or FileOp objects.
 
 resolveContainerName ( $container)
 Resolve a container name, checking if it's allowed by the backend.
 
 resolveContainerPath ( $container, $relStoragePath)
 Resolve a relative storage path, checking if it's allowed by the backend.
 
 resolveStoragePath ( $storagePath)
 Splits a storage path into an internal container name, an internal relative file name, and a container shard suffix.
 
 resolveStoragePathReal ( $storagePath)
 Like resolveStoragePath() except null values are returned if the container is sharded and the shard could not be determined or if the path ends with '/'.
 
 sanitizeOpHeaders (array $op)
 Normalize and filter HTTP headers from a file operation.
 
 setConcurrencyFlags (array $opts)
 Set the 'concurrency' option from a list of operation options.
 
 setContainerCache ( $container, array $val)
 Set the cached info for a container.
 
 setFileCache ( $path, array $val)
 Set the cached stat info for a file path.
 
- Protected Member Functions inherited from FileBackend
 getScopedPHPBehaviorForOps ()
 Enter file operation scope.
 
 newStatus ()
 Yields the result of the status wrapper callback on either:
 
 resetOutputBuffer ()
 
 resolveFSFileObjects (array $ops)
 Convert FSFile 'src' paths to string paths (with an 'srcRef' field set to the FSFile)
 
 scopedProfileSection ( $section)
 
 wrapStatus (StatusValue $sv)
 

Static Protected Member Functions

static isValidContainerName ( $container)
 Check if a full container name is valid.
 
static isValidShortContainerName ( $container)
 Check if a short container name is valid.
 
static normalizeXAttributes (array $xattr)
 Normalize file headers/metadata to the FileBackend::getFileXAttributes() format.
 
- Static Protected Member Functions inherited from FileBackend
static normalizeContainerPath ( $path)
 Validate and normalize a relative storage path.
 

Protected Attributes

ProcessCacheLRU $cheapCache
 Map of paths to small (RAM/disk) cache items.
 
ProcessCacheLRU $expensiveCache
 Map of paths to large (RAM/disk) cache items.
 
 $maxFileSize = 4294967296
 
WANObjectCache $memCache
 
callable $mimeCallback
 Method to get the MIME type of files.
 
array $shardViaHashLevels = []
 Map of container names to sharding config.
 
BagOStuff $srvCache
 
- Protected Attributes inherited from FileBackend
int $concurrency
 How many operations can be done in parallel.
 
string $domainId
 Unique domain name.
 
FileJournal $fileJournal
 
LockManager $lockManager
 
LoggerInterface $logger
 
string $name
 Unique backend name.
 
callable $obResetFunc
 
string $parallelize
 When to do operations in parallel.
 
object string $profiler
 Class name or object With profileIn/profileOut methods.
 
string $readOnly
 Read-only explanation message.
 
callable $statusWrapper
 
callable $streamMimeFunc
 
string $tmpDirectory
 Temporary file directory.
 

Private Member Functions

 containerCacheKey ( $container)
 Get the cache key for a container.
 
 fileCacheKey ( $path)
 Get the cache key for a file path.
 

Additional Inherited Members

- Static Public Member Functions inherited from FileBackend
static extensionFromPath ( $path, $case='lowercase')
 Get the final extension from a storage or FS path.
 
static isPathTraversalFree ( $path)
 Check if a relative path has no directory traversals.
 
static isStoragePath ( $path)
 Check if a given path is a "mwstore://" path.
 
static makeContentDisposition ( $type, $filename='')
 Build a Content-Disposition header value per RFC 6266.
 
static normalizeStoragePath ( $storagePath)
 Normalize a storage path by cleaning up directory separators.
 
static parentStoragePath ( $storagePath)
 Get the parent storage directory of a storage path.
 
static splitStoragePath ( $storagePath)
 Split a storage path into a backend name, a container name, and a relative file path.
 

Detailed Description

Base class for all backends using particular storage medium.

This class defines the methods as abstract that subclasses must implement. Outside callers should not use functions with "Internal" in the name.

The FileBackend operations are implemented using basic functions such as storeInternal(), copyInternal(), deleteInternal() and the like. This class is also responsible for path resolution and sanitization.

Since
1.19

Definition at line 38 of file FileBackendStore.php.

Constructor & Destructor Documentation

◆ __construct()

FileBackendStore::__construct ( array  $config)
See also
FileBackend::__construct() Additional $config params include:
  • srvCache : BagOStuff cache to APC/XCache or the like.
  • wanCache : WANObjectCache object to use for persistent caching.
  • mimeCallback : Callback that takes (storage path, content, file system path) and returns the MIME type of the file or 'unknown/unknown'. The file system path parameter should be used if the content one is null.
Parameters
array$config

Reimplemented from FileBackend.

Reimplemented in FSFileBackend, and SwiftFileBackend.

Definition at line 71 of file FileBackendStore.php.

Member Function Documentation

◆ clearCache()

FileBackendStore::clearCache ( array  $paths = null)
final

Invalidate any in-process file stat and property cache.

If $paths is given, then only the cache for those files will be cleared.

See also
FileBackend::getFileStat()
Parameters
array$pathsStorage paths (optional)

Reimplemented from FileBackend.

Definition at line 1283 of file FileBackendStore.php.

References $path, as, and doClearCache().

Referenced by copyInternal(), createInternal(), deleteInternal(), describeInternal(), SwiftFileBackend\doGetFileSha1base36(), SwiftFileBackend\doGetFileXAttributes(), doOperationsInternal(), doQuickOperationsInternal(), SwiftFileBackend\doStreamFile(), moveInternal(), and storeInternal().

◆ concatenate()

FileBackendStore::concatenate ( array  $params)
final

Concatenate a list of storage files into a single file system file.

The target path should refer to a file that is already locked or otherwise safe from modification from other processes. Normally, the file will be a new temp file, which should be adequate.

Parameters
array$paramsOperation parameters, include:
  • srcs : ordered source storage paths (e.g. chunk1, chunk2, ...)
  • dst : file system path to 0-byte temp file
  • parallelize : try to do operations in parallel when possible
Returns
StatusValue

Reimplemented from FileBackend.

Definition at line 350 of file FileBackendStore.php.

References $params, $status, doConcatenate(), FileBackend\getScopedFileLocks(), LockManager\LOCK_UW, FileBackend\newStatus(), and FileBackend\scopedProfileSection().

◆ containerCacheKey()

FileBackendStore::containerCacheKey (   $container)
private

Get the cache key for a container.

Parameters
string$containerResolved container name
Returns
string

Definition at line 1619 of file FileBackendStore.php.

Referenced by primeContainerCache(), and setContainerCache().

◆ copyInternal()

FileBackendStore::copyInternal ( array  $params)
final

Copy a file from one storage path to another in the backend.

This will overwrite any file that exists at the destination. Do not call this function from places outside FileBackend and FileOp.

$params include:

  • src : source storage path
  • dst : destination storage path
  • ignoreMissingSource : do nothing if the source file does not exist
  • headers : HTTP header name/value map
  • async : StatusValue will be returned immediately if supported. If the StatusValue is OK, then its value field will be set to a FileBackendStoreOpHandle object.
  • dstExists : Whether a file exists at the destination (optimization). Callers can use "false" if no existing file is being changed.
Parameters
array$params
Returns
StatusValue

Definition at line 205 of file FileBackendStore.php.

References $params, $status, clearCache(), deleteFileCache(), doCopyInternal(), and FileBackend\scopedProfileSection().

Referenced by doMoveInternal().

◆ createInternal()

FileBackendStore::createInternal ( array  $params)
final

Create a file in the backend with the given contents.

This will overwrite any file that exists at the destination. Do not call this function from places outside FileBackend and FileOp.

$params include:

  • content : the raw file contents
  • dst : destination storage path
  • headers : HTTP header name/value map
  • async : StatusValue will be returned immediately if supported. If the StatusValue is OK, then its value field will be set to a FileBackendStoreOpHandle object.
  • dstExists : Whether a file exists at the destination (optimization). Callers can use "false" if no existing file is being changed.
Parameters
array$params
Returns
StatusValue

Definition at line 122 of file FileBackendStore.php.

References $params, $status, clearCache(), deleteFileCache(), doCreateInternal(), maxFileSizeInternal(), FileBackend\newStatus(), and FileBackend\scopedProfileSection().

◆ deleteContainerCache()

FileBackendStore::deleteContainerCache (   $container)
finalprotected

Delete the cached info for a container.

The cache key is salted for a while to prevent race conditions.

Parameters
string$containerResolved container name

Definition at line 1639 of file FileBackendStore.php.

Referenced by doClean().

◆ deleteFileCache()

FileBackendStore::deleteFileCache (   $path)
finalprotected

Delete the cached stat info for a file path.

The cache key is salted for a while to prevent race conditions. Since negatives (404s) are not cached, this does not need to be called when a file is created at a path were there was none before.

Parameters
string$pathStorage path

Definition at line 1732 of file FileBackendStore.php.

References $path, and FileBackend\normalizeStoragePath().

Referenced by SwiftFileBackend\addMissingMetadata(), copyInternal(), createInternal(), deleteInternal(), describeInternal(), SwiftFileBackend\doStreamFile(), moveInternal(), and storeInternal().

◆ deleteInternal()

FileBackendStore::deleteInternal ( array  $params)
final

Delete a file at the storage path.

Do not call this function from places outside FileBackend and FileOp.

$params include:

  • src : source storage path
  • ignoreMissingSource : do nothing if the source file does not exist
  • async : StatusValue will be returned immediately if supported. If the StatusValue is OK, then its value field will be set to a FileBackendStoreOpHandle object.
Parameters
array$params
Returns
StatusValue

Definition at line 237 of file FileBackendStore.php.

References $status, clearCache(), deleteFileCache(), doDeleteInternal(), and FileBackend\scopedProfileSection().

Referenced by doMoveInternal().

◆ describeInternal()

FileBackendStore::describeInternal ( array  $params)
final

Alter metadata for a file at the storage path.

Do not call this function from places outside FileBackend and FileOp.

$params include:

Parameters
array$params
Returns
StatusValue

Definition at line 317 of file FileBackendStore.php.

References $params, $status, clearCache(), deleteFileCache(), doDescribeInternal(), FileBackend\newStatus(), and FileBackend\scopedProfileSection().

◆ directoriesAreVirtual()

FileBackendStore::directoriesAreVirtual ( )
abstractprotected

Is this a key/value store where directories are just virtual? Virtual directories exists in so much as files exists that are prefixed with the directory path followed by a forward slash.

Returns
bool

Reimplemented in FSFileBackend, MemoryFileBackend, and SwiftFileBackend.

Referenced by doClean().

◆ directoryExists()

FileBackendStore::directoryExists ( array  $params)
final

Check if a directory exists at a given storage path.

Backends using key/value stores will check if the path is a virtual directory, meaning there are files under the given directory.

Storage backends with eventual consistency might return stale data.

Parameters
array$paramsParameters include:
  • dir : storage directory
Returns
bool|null Returns null on failure
Since
1.20

Reimplemented from FileBackend.

Definition at line 903 of file FileBackendStore.php.

References $dir, $params, $res, as, doDirectoryExists(), getContainerSuffixes(), list, resolveStoragePath(), and FileBackend\splitStoragePath().

◆ doClean()

◆ doCleanInternal()

FileBackendStore::doCleanInternal (   $container,
  $dir,
array  $params 
)
protected
See also
FileBackendStore::doClean()
Parameters
string$container
string$dir
array$params
Returns
StatusValue

Reimplemented in SwiftFileBackend, and FSFileBackend.

Definition at line 600 of file FileBackendStore.php.

References FileBackend\newStatus().

Referenced by doClean().

◆ doClearCache()

FileBackendStore::doClearCache ( array  $paths = null)
protected

Clears any additional stat caches for storage paths.

See also
FileBackend::clearCache()
Parameters
array$pathsStorage paths (optional)

Reimplemented in FSFileBackend.

Definition at line 1307 of file FileBackendStore.php.

Referenced by clearCache().

◆ doConcatenate()

FileBackendStore::doConcatenate ( array  $params)
protected

◆ doCopyInternal()

FileBackendStore::doCopyInternal ( array  $params)
abstractprotected
See also
FileBackendStore::copyInternal()
Parameters
array$params
Returns
StatusValue

Reimplemented in FSFileBackend, MemoryFileBackend, and SwiftFileBackend.

Referenced by copyInternal().

◆ doCreateInternal()

FileBackendStore::doCreateInternal ( array  $params)
abstractprotected
See also
FileBackendStore::createInternal()
Parameters
array$params
Returns
StatusValue

Reimplemented in FSFileBackend, MemoryFileBackend, and SwiftFileBackend.

Referenced by createInternal().

◆ doDeleteInternal()

FileBackendStore::doDeleteInternal ( array  $params)
abstractprotected
See also
FileBackendStore::deleteInternal()
Parameters
array$params
Returns
StatusValue

Reimplemented in FSFileBackend, MemoryFileBackend, and SwiftFileBackend.

Referenced by deleteInternal().

◆ doDescribeInternal()

FileBackendStore::doDescribeInternal ( array  $params)
protected
See also
FileBackendStore::describeInternal()
Parameters
array$params
Returns
StatusValue

Reimplemented in SwiftFileBackend.

Definition at line 335 of file FileBackendStore.php.

References FileBackend\newStatus().

Referenced by describeInternal().

◆ doDirectoryExists()

FileBackendStore::doDirectoryExists (   $container,
  $dir,
array  $params 
)
abstractprotected
See also
FileBackendStore::directoryExists()
Parameters
string$containerResolved container name
string$dirResolved path relative to container
array$params
Returns
bool|null

Reimplemented in MemoryFileBackend, SwiftFileBackend, and FSFileBackend.

Referenced by directoryExists().

◆ doExecuteOpHandlesInternal()

FileBackendStore::doExecuteOpHandlesInternal ( array  $fileOpHandles)
protected
See also
FileBackendStore::executeOpHandlesInternal()
Parameters
FileBackendStoreOpHandle[]$fileOpHandles
Exceptions
FileBackendError
Returns
StatusValue[] List of corresponding StatusValue objects

Reimplemented in FSFileBackend, and SwiftFileBackend.

Definition at line 1233 of file FileBackendStore.php.

Referenced by executeOpHandlesInternal().

◆ doGetFileContentsMulti()

FileBackendStore::doGetFileContentsMulti ( array  $params)
protected
See also
FileBackendStore::getFileContentsMulti()
Parameters
array$params
Returns
array

Reimplemented in SwiftFileBackend.

Definition at line 696 of file FileBackendStore.php.

References $path, as, and doGetLocalReferenceMulti().

Referenced by getFileContentsMulti().

◆ doGetFileSha1Base36()

FileBackendStore::doGetFileSha1Base36 ( array  $params)
protected
See also
FileBackendStore::getFileSha1Base36()
Parameters
array$params
Returns
bool|string

Definition at line 764 of file FileBackendStore.php.

References FileBackend\getLocalReference().

Referenced by getFileSha1Base36().

◆ doGetFileStat()

FileBackendStore::doGetFileStat ( array  $params)
abstractprotected
See also
FileBackendStore::getFileStat()
Parameters
array$params

Reimplemented in FSFileBackend, MemoryFileBackend, and SwiftFileBackend.

Referenced by getFileStat().

◆ doGetFileStatMulti()

FileBackendStore::doGetFileStatMulti ( array  $params)
protected

Get file stat information (concurrently if possible) for several files.

See also
FileBackend::getFileStat()
Parameters
array$paramsParameters include:
  • srcs : list of source storage paths
  • latest : use the latest available data
Returns
array|null Map of storage paths to array|bool|null (returns null if not supported)
Since
1.23

Reimplemented in SwiftFileBackend.

Definition at line 1368 of file FileBackendStore.php.

Referenced by preloadFileStat().

◆ doGetFileXAttributes()

FileBackendStore::doGetFileXAttributes ( array  $params)
protected
See also
FileBackendStore::getFileXAttributes()
Parameters
array$params
Returns
bool|string

Reimplemented in SwiftFileBackend.

Definition at line 734 of file FileBackendStore.php.

Referenced by getFileXAttributes().

◆ doGetLocalCopyMulti()

FileBackendStore::doGetLocalCopyMulti ( array  $params)
abstractprotected
See also
FileBackendStore::getLocalCopyMulti()
Parameters
array$params
Returns
array

Reimplemented in FSFileBackend, MemoryFileBackend, SwiftFileBackend, and MockFileBackend.

Referenced by doGetLocalReferenceMulti(), and getLocalCopyMulti().

◆ doGetLocalReferenceMulti()

FileBackendStore::doGetLocalReferenceMulti ( array  $params)
protected
See also
FileBackendStore::getLocalReferenceMulti()
Parameters
array$params
Returns
array

Reimplemented in FSFileBackend.

Definition at line 820 of file FileBackendStore.php.

References doGetLocalCopyMulti().

Referenced by doGetFileContentsMulti(), and getLocalReferenceMulti().

◆ doMoveInternal()

FileBackendStore::doMoveInternal ( array  $params)
protected
See also
FileBackendStore::moveInternal()
Parameters
array$params
Returns
StatusValue

Reimplemented in FSFileBackend, and SwiftFileBackend.

Definition at line 288 of file FileBackendStore.php.

References $params, $status, copyInternal(), deleteInternal(), and FileBackend\normalizeStoragePath().

Referenced by moveInternal().

◆ doOperationsInternal()

◆ doPrepare()

FileBackendStore::doPrepare ( array  $params)
finalprotected

◆ doPrepareInternal()

FileBackendStore::doPrepareInternal (   $container,
  $dir,
array  $params 
)
protected
See also
FileBackendStore::doPrepare()
Parameters
string$container
string$dir
array$params
Returns
StatusValue

Reimplemented in SwiftFileBackend, and FSFileBackend.

Definition at line 474 of file FileBackendStore.php.

References FileBackend\newStatus().

Referenced by doPrepare().

◆ doPrimeContainerCache()

FileBackendStore::doPrimeContainerCache ( array  $containerInfo)
protected

Fill the backend-specific process cache given an array of resolved container names and their corresponding cached info.

Only containers that actually exist should appear in the map.

Parameters
array$containerInfoMap of resolved container names to cached info

Reimplemented in SwiftFileBackend.

Definition at line 1691 of file FileBackendStore.php.

Referenced by primeContainerCache().

◆ doPublish()

FileBackendStore::doPublish ( array  $params)
finalprotected

◆ doPublishInternal()

FileBackendStore::doPublishInternal (   $container,
  $dir,
array  $params 
)
protected
See also
FileBackendStore::doPublish()
Parameters
string$container
string$dir
array$params
Returns
StatusValue

Reimplemented in SwiftFileBackend, and FSFileBackend.

Definition at line 544 of file FileBackendStore.php.

References FileBackend\newStatus().

Referenced by doPublish().

◆ doQuickOperationsInternal()

FileBackendStore::doQuickOperationsInternal ( array  $ops)
finalprotected

◆ doSecure()

FileBackendStore::doSecure ( array  $params)
finalprotected

◆ doSecureInternal()

FileBackendStore::doSecureInternal (   $container,
  $dir,
array  $params 
)
protected
See also
FileBackendStore::doSecure()
Parameters
string$container
string$dir
array$params
Returns
StatusValue

Reimplemented in SwiftFileBackend, and FSFileBackend.

Definition at line 509 of file FileBackendStore.php.

References FileBackend\newStatus().

Referenced by doSecure().

◆ doStoreInternal()

FileBackendStore::doStoreInternal ( array  $params)
abstractprotected
See also
FileBackendStore::storeInternal()
Parameters
array$params
Returns
StatusValue

Reimplemented in FSFileBackend, MemoryFileBackend, and SwiftFileBackend.

Referenced by storeInternal().

◆ doStreamFile()

FileBackendStore::doStreamFile ( array  $params)
protected

◆ executeOpHandlesInternal()

FileBackendStore::executeOpHandlesInternal ( array  $fileOpHandles)
final

Execute a list of FileBackendStoreOpHandle handles in parallel.

The resulting StatusValue object fields will correspond to the order in which the handles where given.

Parameters
FileBackendStoreOpHandle[]$fileOpHandles
Exceptions
FileBackendError
Returns
StatusValue[] Map of StatusValue objects

Definition at line 1206 of file FileBackendStore.php.

References $res, as, doExecuteOpHandlesInternal(), and FileBackend\scopedProfileSection().

Referenced by doQuickOperationsInternal().

◆ fileCacheKey()

FileBackendStore::fileCacheKey (   $path)
private

Get the cache key for a file path.

Parameters
string$pathNormalized storage path
Returns
string

Definition at line 1700 of file FileBackendStore.php.

References $path.

Referenced by primeFileCache(), and setFileCache().

◆ fileExists()

FileBackendStore::fileExists ( array  $params)
final

Check if a file exists at a storage path in the backend.

This returns false if only a directory exists at the path.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
bool|null Returns null on failure

Reimplemented from FileBackend.

Definition at line 604 of file FileBackendStore.php.

References getFileStat(), and FileBackend\scopedProfileSection().

Referenced by SwiftFileBackend\doStreamFile().

◆ fullContainerName()

FileBackendStore::fullContainerName (   $container)
finalprotected

Get the full container name, including the wiki ID prefix.

Parameters
string$container
Returns
string

Definition at line 1579 of file FileBackendStore.php.

Referenced by resolveStoragePath().

◆ getContainerHashLevels()

FileBackendStore::getContainerHashLevels (   $container)
finalprotected

Get the sharding config for a container.

If greater than 0, then all file storage paths within the container are required to be hashed accordingly.

Parameters
string$container
Returns
array (integer levels, integer base, repeat flag) or (0, 0, false)

Definition at line 1539 of file FileBackendStore.php.

References false.

Referenced by getContainerShard(), and getContainerSuffixes().

◆ getContainerShard()

FileBackendStore::getContainerShard (   $container,
  $relPath 
)
finalprotected

Get the container name shard suffix for a given path.

Any empty suffix means the container is not sharded.

Parameters
string$containerContainer name
string$relPathStorage path relative to the container
Returns
string|null Returns null if shard could not be determined

Definition at line 1487 of file FileBackendStore.php.

References $base, getContainerHashLevels(), and list.

Referenced by resolveStoragePath().

◆ getContainerSuffixes()

FileBackendStore::getContainerSuffixes (   $container)
finalprotected

Get a list of full container shard suffixes for a container.

Parameters
string$container
Returns
array

Definition at line 1560 of file FileBackendStore.php.

References $base, getContainerHashLevels(), and list.

Referenced by directoryExists(), doClean(), doPrepare(), doPublish(), doSecure(), getDirectoryList(), and getFileList().

◆ getContentType()

FileBackendStore::getContentType (   $storagePath,
  $content,
  $fsPath 
)
protected

Get the content type to use in HEAD/GET requests for a file.

Parameters
string$storagePath
string | null$contentFile data
string | null$fsPathFile system path
Returns
string MIME type

Definition at line 1839 of file FileBackendStore.php.

References $mime.

Referenced by SwiftFileBackend\doCreateInternal(), and SwiftFileBackend\doStoreInternal().

◆ getDirectoryList()

FileBackendStore::getDirectoryList ( array  $params)
final

Get an iterator to list all directories under a storage directory.

If the directory is of the form "mwstore://backend/container", then all directories in the container will be listed. If the directory is of form "mwstore://backend/container/dir", then all directories directly under that directory will be listed. Results will be storage directories relative to the given directory.

Storage backends with eventual consistency might return stale data.

Failures during iteration can result in FileBackendError exceptions (since 1.22).

Parameters
array$paramsParameters include:
  • dir : storage directory
  • topOnly : only return direct child dirs of the directory
Returns
Traversable|array|null Returns null on failure
Since
1.20

Reimplemented from FileBackend.

Definition at line 938 of file FileBackendStore.php.

References $dir, $params, getContainerSuffixes(), getDirectoryListInternal(), list, resolveStoragePath(), and FileBackend\splitStoragePath().

◆ getDirectoryListInternal()

FileBackendStore::getDirectoryListInternal (   $container,
  $dir,
array  $params 
)
abstract

Do not call this function from places outside FileBackend.

See also
FileBackendStore::getDirectoryList()
Parameters
string$containerResolved container name
string$dirResolved path relative to container
array$params
Returns
Traversable|array|null Returns null on failure

Reimplemented in MemoryFileBackend, SwiftFileBackend, and FSFileBackend.

Referenced by getDirectoryList().

◆ getFileContentsMulti()

FileBackendStore::getFileContentsMulti ( array  $params)

Like getFileContents() except it takes an array of storage paths and returns a map of storage paths to strings (or null on failure).

The map keys (paths) are in the same order as the provided list of paths.

See also
FileBackend::getFileContents()
Parameters
array$paramsParameters include:
  • srcs : list of source storage paths
  • latest : use the latest available data
  • parallelize : try to do operations in parallel when possible
Returns
array Map of (path name => string or false on failure)
Since
1.20

Reimplemented from FileBackend.

Definition at line 682 of file FileBackendStore.php.

References $params, doGetFileContentsMulti(), FileBackend\scopedProfileSection(), and setConcurrencyFlags().

◆ getFileHttpUrl()

FileBackendStore::getFileHttpUrl ( array  $params)
See also
FileBackend::getFileHttpUrl()
Parameters
array$params
Returns
string|null

Reimplemented from FileBackend.

Reimplemented in SwiftFileBackend.

Definition at line 845 of file FileBackendStore.php.

◆ getFileList()

FileBackendStore::getFileList ( array  $params)
final

Get an iterator to list all stored files under a storage directory.

If the directory is of the form "mwstore://backend/container", then all files in the container will be listed. If the directory is of form "mwstore://backend/container/dir", then all files under that directory will be listed. Results will be storage paths relative to the given directory.

Storage backends with eventual consistency might return stale data.

Failures during iteration can result in FileBackendError exceptions (since 1.22).

Parameters
array$paramsParameters include:
  • dir : storage directory
  • topOnly : only return direct child files of the directory (since 1.20)
  • adviseStat : set to true if stat requests will be made on the files (since 1.22)
Returns
Traversable|array|null Returns null on failure

Reimplemented from FileBackend.

Definition at line 968 of file FileBackendStore.php.

References $dir, $params, getContainerSuffixes(), getFileListInternal(), list, resolveStoragePath(), and FileBackend\splitStoragePath().

◆ getFileListInternal()

FileBackendStore::getFileListInternal (   $container,
  $dir,
array  $params 
)
abstract

Do not call this function from places outside FileBackend.

See also
FileBackendStore::getFileList()
Parameters
string$containerResolved container name
string$dirResolved path relative to container
array$params
Returns
Traversable|array|null Returns null on failure

Reimplemented in MemoryFileBackend, SwiftFileBackend, and FSFileBackend.

Referenced by getFileList().

◆ getFileProps()

FileBackendStore::getFileProps ( array  $params)
final

Get the properties of the file at a storage path in the backend.

This gives the result of FSFile::getProps() on a local copy of the file.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
array Returns FSFile::placeholderProps() on failure

Reimplemented from FileBackend.

Definition at line 773 of file FileBackendStore.php.

References FileBackend\getLocalReference(), FSFile\placeholderProps(), and FileBackend\scopedProfileSection().

◆ getFileSha1Base36()

FileBackendStore::getFileSha1Base36 ( array  $params)
final

Get a SHA-1 hash of the file at a storage path in the backend.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
string|bool Hash string or false on failure

Reimplemented from FileBackend.

Definition at line 738 of file FileBackendStore.php.

References $params, $path, doGetFileSha1Base36(), FileBackend\normalizeStoragePath(), and FileBackend\scopedProfileSection().

◆ getFileSize()

FileBackendStore::getFileSize ( array  $params)
final

Get the size (bytes) of a file at a storage path in the backend.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
int|bool Returns false on failure

Reimplemented from FileBackend.

Definition at line 618 of file FileBackendStore.php.

References getFileStat(), and FileBackend\scopedProfileSection().

◆ getFileStat()

FileBackendStore::getFileStat ( array  $params)
final

Get quick information about a file at a storage path in the backend.

If the file does not exist, then this returns false. Otherwise, the result is an associative array that includes:

  • mtime : the last-modified timestamp (TS_MW)
  • size : the file size (bytes) Additional values may be included for internal use only.
Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
array|bool|null Returns null on failure

Reimplemented from FileBackend.

Definition at line 625 of file FileBackendStore.php.

References $params, $path, doGetFileStat(), FileBackend\normalizeStoragePath(), normalizeXAttributes(), primeFileCache(), FileBackend\scopedProfileSection(), and setFileCache().

Referenced by SwiftFileBackend\doDescribeInternal(), SwiftFileBackend\doGetFileSha1base36(), SwiftFileBackend\doGetFileXAttributes(), fileExists(), getFileSize(), and getFileTimestamp().

◆ getFileTimestamp()

FileBackendStore::getFileTimestamp ( array  $params)
final

Get the last-modified timestamp of the file at a storage path.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
string|bool TS_MW timestamp or false on failure

Reimplemented from FileBackend.

Definition at line 611 of file FileBackendStore.php.

References getFileStat(), and FileBackend\scopedProfileSection().

◆ getFileXAttributes()

FileBackendStore::getFileXAttributes ( array  $params)
final

Get metadata about a file at a storage path in the backend.

If the file does not exist, then this returns false. Otherwise, the result is an associative array that includes:

  • headers : map of HTTP headers used for GET/HEAD requests (name => value)
  • metadata : map of file metadata (name => value) Metadata keys and headers names will be returned in all lower-case. Additional values may be included for internal use only.

Use FileBackend::hasFeatures() to check how well this is supported.

Parameters
array$params$params include:
  • src : source storage path
  • latest : use the latest available data
Returns
array|bool Returns false on failure
Since
1.23

Reimplemented from FileBackend.

Definition at line 707 of file FileBackendStore.php.

References $params, $path, doGetFileXAttributes(), FileBackend\normalizeStoragePath(), normalizeXAttributes(), and FileBackend\scopedProfileSection().

◆ getLocalCopyMulti()

FileBackendStore::getLocalCopyMulti ( array  $params)
final

Like getLocalCopy() except it takes an array of storage paths and returns a map of storage paths to TempFSFile objects (or null on failure).

The map keys (paths) are in the same order as the provided list of paths.

See also
FileBackend::getLocalCopy()
Parameters
array$paramsParameters include:
  • srcs : list of source storage paths
  • latest : use the latest available data
  • parallelize : try to do operations in parallel when possible
Returns
array Map of (path name => TempFSFile or null on failure)
Since
1.20

Reimplemented from FileBackend.

Definition at line 824 of file FileBackendStore.php.

References $params, doGetLocalCopyMulti(), FileBackend\scopedProfileSection(), and setConcurrencyFlags().

◆ getLocalReferenceMulti()

FileBackendStore::getLocalReferenceMulti ( array  $params)
final

Like getLocalReference() except it takes an array of storage paths and returns a map of storage paths to FSFile objects (or null on failure).

The map keys (paths) are in the same order as the provided list of paths.

See also
FileBackend::getLocalReference()
Parameters
array$paramsParameters include:
  • srcs : list of source storage paths
  • latest : use the latest available data
  • parallelize : try to do operations in parallel when possible
Returns
array Map of (path name => FSFile or null on failure)
Since
1.20

Reimplemented from FileBackend.

Definition at line 781 of file FileBackendStore.php.

References $params, $path, as, doGetLocalReferenceMulti(), FileBackend\normalizeStoragePath(), FileBackend\scopedProfileSection(), and setConcurrencyFlags().

Referenced by doConcatenate().

◆ getOperationsInternal()

FileBackendStore::getOperationsInternal ( array  $ops)
final

Return a list of FileOp objects from a list of operations.

Do not call this function from places outside FileBackend.

The result must have the same number of items as the input. An exception is thrown if an unsupported operation is requested.

Parameters
array$opsSame format as doOperations()
Returns
FileOp[] List of FileOp objects
Exceptions
FileBackendError

Definition at line 1009 of file FileBackendStore.php.

References $params, and as.

Referenced by doOperationsInternal(), and getScopedLocksForOps().

◆ getPathsToLockForOpsInternal()

FileBackendStore::getPathsToLockForOpsInternal ( array  $performOps)
final

Get a list of storage paths to lock for a list of operations Returns an array with LockManager::LOCK_UW (shared locks) and LockManager::LOCK_EX (exclusive locks) keys, each corresponding to a list of storage paths to be locked.

All returned paths are normalized.

Parameters
array$performOpsList of FileOp objects
Returns
array (LockManager::LOCK_UW => path list, LockManager::LOCK_EX => path list)

Definition at line 1048 of file FileBackendStore.php.

References as, LockManager\LOCK_EX, and LockManager\LOCK_UW.

Referenced by doOperationsInternal(), and getScopedLocksForOps().

◆ getScopedLocksForOps()

FileBackendStore::getScopedLocksForOps ( array  $ops,
StatusValue  $status 
)

Get an array of scoped locks needed for a batch of file operations.

Normally, FileBackend::doOperations() handles locking, unless the 'nonLocking' param is passed in. This function is useful if you want the files to be locked for a broader scope than just when the files are changing. For example, if you need to update DB metadata, you may want to keep the files locked until finished.

See also
FileBackend::doOperations()
Parameters
array$opsList of file operations to FileBackend::doOperations()
StatusValue$statusStatusValue to update on lock/unlock
Returns
ScopedLock|null
Since
1.20

Reimplemented from FileBackend.

Definition at line 1066 of file FileBackendStore.php.

References $status, getOperationsInternal(), getPathsToLockForOpsInternal(), and FileBackend\getScopedFileLocks().

◆ isPathUsableInternal()

FileBackendStore::isPathUsableInternal (   $storagePath)
abstract

Check if a file can be created or changed at a given storage path.

FS backends should check if the parent directory exists, files can be written under it, and that any file already there is writable. Backends using key/value stores should check if the container exists.

Parameters
string$storagePath
Returns
bool

Reimplemented in FSFileBackend, MemoryFileBackend, and SwiftFileBackend.

◆ isSingleShardPathInternal()

FileBackendStore::isSingleShardPathInternal (   $storagePath)
final

Check if a storage path maps to a single shard.

Container dirs like "a", where the container shards on "x/xy", can reside on several shards. Such paths are tricky to handle.

Parameters
string$storagePathStorage path
Returns
bool

Definition at line 1525 of file FileBackendStore.php.

References list, and resolveStoragePath().

◆ isValidContainerName()

static FileBackendStore::isValidContainerName (   $container)
staticfinalprotected

Check if a full container name is valid.

This checks for length and illegal characters. Limiting the characters makes migrations to other stores easier.

Parameters
string$container
Returns
bool

Definition at line 1408 of file FileBackendStore.php.

Referenced by isValidShortContainerName().

◆ isValidShortContainerName()

static FileBackendStore::isValidShortContainerName (   $container)
staticfinalprotected

Check if a short container name is valid.

This checks for length and illegal characters. This may disallow certain characters that can appear in the prefix used to make the full container name.

Parameters
string$container
Returns
bool

Definition at line 1391 of file FileBackendStore.php.

References isValidContainerName().

◆ maxFileSizeInternal()

FileBackendStore::maxFileSizeInternal ( )
final

Get the maximum allowable file size given backend medium restrictions and basic performance constraints.

Do not call this function from places outside FileBackend and FileOp.

Returns
int Bytes

Definition at line 89 of file FileBackendStore.php.

References $maxFileSize.

Referenced by createInternal(), and storeInternal().

◆ moveInternal()

FileBackendStore::moveInternal ( array  $params)
final

Move a file from one storage path to another in the backend.

This will overwrite any file that exists at the destination. Do not call this function from places outside FileBackend and FileOp.

$params include:

  • src : source storage path
  • dst : destination storage path
  • ignoreMissingSource : do nothing if the source file does not exist
  • headers : HTTP header name/value map
  • async : StatusValue will be returned immediately if supported. If the StatusValue is OK, then its value field will be set to a FileBackendStoreOpHandle object.
  • dstExists : Whether a file exists at the destination (optimization). Callers can use "false" if no existing file is being changed.
Parameters
array$params
Returns
StatusValue

Definition at line 271 of file FileBackendStore.php.

References $params, $status, clearCache(), deleteFileCache(), doMoveInternal(), and FileBackend\scopedProfileSection().

◆ normalizeXAttributes()

static FileBackendStore::normalizeXAttributes ( array  $xattr)
staticfinalprotected

Normalize file headers/metadata to the FileBackend::getFileXAttributes() format.

Parameters
array$xattr
Returns
array
Since
1.22

Definition at line 1796 of file FileBackendStore.php.

References FileBackend\$name, $value, and as.

Referenced by getFileStat(), getFileXAttributes(), preloadFileStat(), and primeFileCache().

◆ nullInternal()

FileBackendStore::nullInternal ( array  $params)
final

No-op file operation that does nothing.

Do not call this function from places outside FileBackend and FileOp.

Parameters
array$params
Returns
StatusValue

Definition at line 346 of file FileBackendStore.php.

References FileBackend\newStatus().

◆ preloadCache()

FileBackendStore::preloadCache ( array  $paths)
final

Preload persistent file stat cache and property cache into in-process cache.

This should be used when stat calls will be made on a known list of a many files.

See also
FileBackend::getFileStat()
Parameters
array$pathsStorage paths

Reimplemented from FileBackend.

Definition at line 1272 of file FileBackendStore.php.

References $path, as, list, primeContainerCache(), primeFileCache(), and resolveStoragePath().

◆ preloadFileStat()

FileBackendStore::preloadFileStat ( array  $params)
final

Preload file stat information (concurrently if possible) into in-process cache.

This should be used when stat calls will be made on a known list of a many files. This does not make use of the persistent file stat cache.

See also
FileBackend::getFileStat()
Parameters
array$paramsParameters include:
  • srcs : list of source storage paths
  • latest : use the latest available data
Returns
bool All requests proceeded without I/O errors (since 1.24)
Since
1.23

Reimplemented from FileBackend.

Definition at line 1310 of file FileBackendStore.php.

References $params, $path, $success, as, doGetFileStatMulti(), FileBackend\normalizeStoragePath(), normalizeXAttributes(), FileBackend\scopedProfileSection(), and setFileCache().

Referenced by doOperationsInternal().

◆ primeContainerCache()

FileBackendStore::primeContainerCache ( array  $items)
finalprotected

Do a batch lookup from cache for container stats for all containers used in a list of container names or storage paths objects.

This loads the persistent cache values into the process cache.

Parameters
array$items

Definition at line 1652 of file FileBackendStore.php.

References $path, as, containerCacheKey(), doPrimeContainerCache(), list, resolveStoragePath(), and FileBackend\scopedProfileSection().

Referenced by doOperationsInternal(), SwiftFileBackend\getContainerStat(), and preloadCache().

◆ primeFileCache()

FileBackendStore::primeFileCache ( array  $items)
finalprotected

Do a batch lookup from cache for file stats for all paths used in a list of storage paths or FileOp objects.

This loads the persistent cache values into the process cache.

Parameters
array$itemsList of storage paths

Definition at line 1749 of file FileBackendStore.php.

References $path, as, fileCacheKey(), list, FileBackend\normalizeStoragePath(), normalizeXAttributes(), resolveStoragePath(), and FileBackend\scopedProfileSection().

Referenced by getFileStat(), and preloadCache().

◆ resolveContainerName()

FileBackendStore::resolveContainerName (   $container)
protected

Resolve a container name, checking if it's allowed by the backend.

This is intended for internal use, such as encoding illegal chars. Subclasses can override this to be more restrictive.

Parameters
string$container
Returns
string|null

Definition at line 1595 of file FileBackendStore.php.

Referenced by resolveStoragePath().

◆ resolveContainerPath()

FileBackendStore::resolveContainerPath (   $container,
  $relStoragePath 
)
protected

Resolve a relative storage path, checking if it's allowed by the backend.

This is intended for internal use, such as encoding illegal chars or perhaps getting absolute paths (e.g. FS based backends). Note that the relative path may be the empty string (e.g. the path is simply to the container).

Parameters
string$containerContainer name
string$relStoragePathStorage path relative to the container
Returns
string|null Path or null if not valid

Reimplemented in FSFileBackend, and SwiftFileBackend.

Definition at line 1609 of file FileBackendStore.php.

Referenced by resolveStoragePath().

◆ resolveStoragePath()

FileBackendStore::resolveStoragePath (   $storagePath)
finalprotected

Splits a storage path into an internal container name, an internal relative file name, and a container shard suffix.

Any shard suffix is already appended to the internal container name. This also checks that the storage path is valid and within this backend.

If the container is sharded but a suffix could not be determined, this means that the path can only refer to a directory and can only be scanned by looking in all the container shards.

Parameters
string$storagePath
Returns
array (container, path, container suffix) or (null, null, null) if invalid

Definition at line 1429 of file FileBackendStore.php.

References fullContainerName(), getContainerShard(), list, name, FileBackend\normalizeContainerPath(), resolveContainerName(), resolveContainerPath(), and FileBackend\splitStoragePath().

Referenced by directoryExists(), doClean(), doPrepare(), doPublish(), doSecure(), getDirectoryList(), getFileList(), isSingleShardPathInternal(), preloadCache(), primeContainerCache(), primeFileCache(), and resolveStoragePathReal().

◆ resolveStoragePathReal()

FileBackendStore::resolveStoragePathReal (   $storagePath)
finalprotected

Like resolveStoragePath() except null values are returned if the container is sharded and the shard could not be determined or if the path ends with '/'.

The latter case is illegal for FS backends and can confuse listings for object store backends.

This function is used when resolving paths that must be valid locations for files. Directory and listing functions should generally just use resolveStoragePath() instead.

See also
FileBackendStore::resolveStoragePath()
Parameters
string$storagePath
Returns
array (container, path) or (null, null) if invalid

Definition at line 1470 of file FileBackendStore.php.

References list, and resolveStoragePath().

Referenced by SwiftFileBackend\addMissingMetadata(), SwiftFileBackend\doCopyInternal(), SwiftFileBackend\doCreateInternal(), SwiftFileBackend\doDeleteInternal(), SwiftFileBackend\doDescribeInternal(), SwiftFileBackend\doGetFileContentsMulti(), SwiftFileBackend\doGetFileStatMulti(), SwiftFileBackend\doGetLocalCopyMulti(), SwiftFileBackend\doMoveInternal(), SwiftFileBackend\doStoreInternal(), SwiftFileBackend\doStreamFile(), SwiftFileBackend\getFileHttpUrl(), SwiftFileBackend\isPathUsableInternal(), MemoryFileBackend\resolveHashKey(), and FSFileBackend\resolveToFSPath().

◆ sanitizeOpHeaders()

FileBackendStore::sanitizeOpHeaders ( array  $op)
protected

Normalize and filter HTTP headers from a file operation.

This normalizes and strips long HTTP headers from a file operation. Most headers are just numbers, but some are allowed to be long. This function is useful for cleaning up headers and avoiding backend specific errors, especially in the middle of batch file operations.

Parameters
array$opSame format as doOperation()
Returns
array

Definition at line 1252 of file FileBackendStore.php.

References FileBackend\$name, $value, and as.

◆ setConcurrencyFlags()

FileBackendStore::setConcurrencyFlags ( array  $opts)
finalprotected

Set the 'concurrency' option from a list of operation options.

Parameters
array$optsMap of operation options
Returns
array

Definition at line 1816 of file FileBackendStore.php.

References FileBackend\$concurrency.

Referenced by doOperationsInternal(), getFileContentsMulti(), getLocalCopyMulti(), and getLocalReferenceMulti().

◆ setContainerCache()

FileBackendStore::setContainerCache (   $container,
array  $val 
)
finalprotected

Set the cached info for a container.

Parameters
string$containerResolved container name
array$valInformation to cache

Definition at line 1629 of file FileBackendStore.php.

References containerCacheKey().

Referenced by SwiftFileBackend\getContainerStat().

◆ setFileCache()

FileBackendStore::setFileCache (   $path,
array  $val 
)
finalprotected

Set the cached stat info for a file path.

Negatives (404s) are not cached. By not caching negatives, we can skip cache salting for the case when a file is created at a path were there was none before.

Parameters
string$pathStorage path
array$valStat information to cache

Definition at line 1712 of file FileBackendStore.php.

References $path, ConvertibleTimestamp\convert(), fileCacheKey(), FileBackend\normalizeStoragePath(), and TS_UNIX.

Referenced by getFileStat(), and preloadFileStat().

◆ storeInternal()

FileBackendStore::storeInternal ( array  $params)
final

Store a file into the backend from a file on disk.

This will overwrite any file that exists at the destination. Do not call this function from places outside FileBackend and FileOp.

$params include:

  • src : source path on disk
  • dst : destination storage path
  • headers : HTTP header name/value map
  • async : StatusValue will be returned immediately if supported. If the StatusValue is OK, then its value field will be set to a FileBackendStoreOpHandle object.
  • dstExists : Whether a file exists at the destination (optimization). Callers can use "false" if no existing file is being changed.
Parameters
array$params
Returns
StatusValue

Definition at line 163 of file FileBackendStore.php.

References $params, $status, clearCache(), deleteFileCache(), doStoreInternal(), maxFileSizeInternal(), FileBackend\newStatus(), and FileBackend\scopedProfileSection().

◆ streamFile()

FileBackendStore::streamFile ( array  $params)
final

Stream the file at a storage path in the backend.

If the file does not exists, an HTTP 404 error will be given. Appropriate HTTP headers (Status, Content-Type, Content-Length) will be sent if streaming began, while none will be sent otherwise. Implementations should flush the output buffer before sending data.

Parameters
array$paramsParameters include:
  • src : source storage path
  • headers : list of additional HTTP headers to send if the file exists
  • options : HTTP request header map with lower case keys (since 1.28). Supports: range : format is "bytes=(\\d*-\\d*)" if-modified-since : format is an HTTP date
  • headless : only include the body (and headers from "headers") (since 1.28)
  • latest : use the latest available data
  • allowOB : preserve any output buffers (since 1.28)
Returns
StatusValue

Reimplemented from FileBackend.

Definition at line 849 of file FileBackendStore.php.

References $params, $status, doStreamFile(), FileBackend\newStatus(), print, and FileBackend\scopedProfileSection().

Member Data Documentation

◆ $cheapCache

ProcessCacheLRU FileBackendStore::$cheapCache
protected

Map of paths to small (RAM/disk) cache items.

Definition at line 44 of file FileBackendStore.php.

◆ $expensiveCache

ProcessCacheLRU FileBackendStore::$expensiveCache
protected

Map of paths to large (RAM/disk) cache items.

Definition at line 46 of file FileBackendStore.php.

◆ $maxFileSize

FileBackendStore::$maxFileSize = 4294967296
protected

Definition at line 54 of file FileBackendStore.php.

Referenced by maxFileSizeInternal().

◆ $memCache

WANObjectCache FileBackendStore::$memCache
protected

Definition at line 40 of file FileBackendStore.php.

◆ $mimeCallback

callable FileBackendStore::$mimeCallback
protected

Method to get the MIME type of files.

Definition at line 52 of file FileBackendStore.php.

◆ $shardViaHashLevels

array FileBackendStore::$shardViaHashLevels = []
protected

Map of container names to sharding config.

Definition at line 49 of file FileBackendStore.php.

◆ $srvCache

BagOStuff FileBackendStore::$srvCache
protected

Definition at line 42 of file FileBackendStore.php.

◆ CACHE_CHEAP_SIZE

const FileBackendStore::CACHE_CHEAP_SIZE = 500

Definition at line 57 of file FileBackendStore.php.

◆ CACHE_EXPENSIVE_SIZE

const FileBackendStore::CACHE_EXPENSIVE_SIZE = 5

Definition at line 58 of file FileBackendStore.php.

◆ CACHE_TTL

const FileBackendStore::CACHE_TTL = 10

Definition at line 56 of file FileBackendStore.php.


The documentation for this class was generated from the following file: