MediaWiki REL1_32
FileBackend Class Reference

Base class for all file backend classes (including multi-write backends). More...

Inheritance diagram for FileBackend:
Collaboration diagram for FileBackend:

Public Member Functions

 __construct (array $config)
 Create a new backend instance from configuration.
 
 clean (array $params)
 Delete a storage directory if it is empty.
 
 clearCache (array $paths=null)
 Invalidate any in-process file stat and property cache.
 
 concatenate (array $params)
 Concatenate a list of storage files into a single file system file.
 
 copy (array $params, array $opts=[])
 Performs a single copy operation.
 
 create (array $params, array $opts=[])
 Performs a single create operation.
 
 delete (array $params, array $opts=[])
 Performs a single delete operation.
 
 describe (array $params, array $opts=[])
 Performs a single describe operation.
 
 directoryExists (array $params)
 Check if a directory exists at a given storage path.
 
 doOperation (array $op, array $opts=[])
 Same as doOperations() except it takes a single operation.
 
 doOperations (array $ops, array $opts=[])
 This is the main entry point into the backend for write operations.
 
 doQuickOperation (array $op)
 Same as doQuickOperations() except it takes a single operation.
 
 doQuickOperations (array $ops, array $opts=[])
 Perform a set of independent file operations on some files.
 
 fileExists (array $params)
 Check if a file exists at a storage path in the backend.
 
 getContainerStoragePath ( $container)
 Get the storage path for the given container for this backend.
 
 getDirectoryList (array $params)
 Get an iterator to list all directories under a storage directory.
 
 getDomainId ()
 Get the domain identifier used for this backend (possibly empty).
 
 getFeatures ()
 Get the a bitfield of extra features supported by the backend medium.
 
 getFileContents (array $params)
 Get the contents of a file at a storage path in the backend.
 
 getFileContentsMulti (array $params)
 Like getFileContents() except it takes an array of storage paths and returns a map of storage paths to strings (or null on failure).
 
 getFileHttpUrl (array $params)
 Return an HTTP URL to a given file that requires no authentication to use.
 
 getFileList (array $params)
 Get an iterator to list all stored files under a storage directory.
 
 getFileProps (array $params)
 Get the properties of the file at a storage path in the backend.
 
 getFileSha1Base36 (array $params)
 Get a SHA-1 hash of the file at a storage path in the backend.
 
 getFileSize (array $params)
 Get the size (bytes) of a file at a storage path in the backend.
 
 getFileStat (array $params)
 Get quick information about a file at a storage path in the backend.
 
 getFileTimestamp (array $params)
 Get the last-modified timestamp of the file at a storage path.
 
 getFileXAttributes (array $params)
 Get metadata about a file at a storage path in the backend.
 
 getJournal ()
 Get the file journal object for this backend.
 
 getLocalCopy (array $params)
 Get a local copy on disk of the file at a storage path in the backend.
 
 getLocalCopyMulti (array $params)
 Like getLocalCopy() except it takes an array of storage paths and returns a map of storage paths to TempFSFile objects (or null on failure).
 
 getLocalReference (array $params)
 Returns a file system file, identical to the file at a storage path.
 
 getLocalReferenceMulti (array $params)
 Like getLocalReference() except it takes an array of storage paths and returns a map of storage paths to FSFile objects (or null on failure).
 
 getName ()
 Get the unique backend name.
 
 getReadOnlyReason ()
 Get an explanatory message if this backend is read-only.
 
 getRootStoragePath ()
 Get the root storage path of this backend.
 
 getScopedFileLocks (array $paths, $type, StatusValue $status, $timeout=0)
 Lock the files at the given storage paths in the backend.
 
 getScopedLocksForOps (array $ops, StatusValue $status)
 Get an array of scoped locks needed for a batch of file operations.
 
 getTopDirectoryList (array $params)
 Same as FileBackend::getDirectoryList() except only lists directories that are immediately under the given directory.
 
 getTopFileList (array $params)
 Same as FileBackend::getFileList() except only lists files that are immediately under the given directory.
 
 getWikiId ()
 Alias to getDomainId()
 
 hasFeatures ( $bitfield)
 Check if the backend medium supports a field of extra features.
 
 isReadOnly ()
 Check if this backend is read-only.
 
 lockFiles (array $paths, $type, $timeout=0)
 Lock the files at the given storage paths in the backend.
 
 move (array $params, array $opts=[])
 Performs a single move operation.
 
 preloadCache (array $paths)
 Preload persistent file stat cache and property cache into in-process cache.
 
 preloadFileStat (array $params)
 Preload file stat information (concurrently if possible) into in-process cache.
 
 prepare (array $params)
 Prepare a storage directory for usage.
 
 publish (array $params)
 Remove measures to block web access to a storage directory and the container it belongs to.
 
 quickCopy (array $params)
 Performs a single quick copy operation.
 
 quickCreate (array $params)
 Performs a single quick create operation.
 
 quickDelete (array $params)
 Performs a single quick delete operation.
 
 quickDescribe (array $params)
 Performs a single quick describe operation.
 
 quickMove (array $params)
 Performs a single quick move operation.
 
 quickStore (array $params)
 Performs a single quick store operation.
 
 secure (array $params)
 Take measures to block web access to a storage directory and the container it belongs to.
 
 setLogger (LoggerInterface $logger)
 
 store (array $params, array $opts=[])
 Performs a single store operation.
 
 streamFile (array $params)
 Stream the file at a storage path in the backend.
 
 unlockFiles (array $paths, $type)
 Unlock the files at the given storage paths in the backend.
 

Static Public Member Functions

static extensionFromPath ( $path, $case='lowercase')
 Get the final extension from a storage or FS path.
 
static isPathTraversalFree ( $path)
 Check if a relative path has no directory traversals.
 
static isStoragePath ( $path)
 Check if a given path is a "mwstore://" path.
 
static makeContentDisposition ( $type, $filename='')
 Build a Content-Disposition header value per RFC 6266.
 
static normalizeStoragePath ( $storagePath)
 Normalize a storage path by cleaning up directory separators.
 
static parentStoragePath ( $storagePath)
 Get the parent storage directory of a storage path.
 
static splitStoragePath ( $storagePath)
 Split a storage path into a backend name, a container name, and a relative file path.
 

Public Attributes

const ATTR_HEADERS = 1
 Bitfield flags for supported features.
 
const ATTR_METADATA = 2
 
const ATTR_UNICODE_PATHS = 4
 

Protected Member Functions

 doClean (array $params)
 
 doOperationsInternal (array $ops, array $opts)
 
 doPrepare (array $params)
 
 doPublish (array $params)
 
 doQuickOperationsInternal (array $ops)
 
 doSecure (array $params)
 
 getScopedPHPBehaviorForOps ()
 Enter file operation scope.
 
 newStatus ()
 Yields the result of the status wrapper callback on either:
 
 resetOutputBuffer ()
 
 resolveFSFileObjects (array $ops)
 Convert FSFile 'src' paths to string paths (with an 'srcRef' field set to the FSFile)
 
 scopedProfileSection ( $section)
 
 wrapStatus (StatusValue $sv)
 

Static Protected Member Functions

static normalizeContainerPath ( $path)
 Validate and normalize a relative storage path.
 

Protected Attributes

int $concurrency
 How many operations can be done in parallel.
 
string $domainId
 Unique domain name.
 
FileJournal $fileJournal
 
LockManager $lockManager
 
LoggerInterface $logger
 
string $name
 Unique backend name.
 
callable $obResetFunc
 
string $parallelize
 When to do operations in parallel.
 
object string $profiler
 Class name or object With profileIn/profileOut methods.
 
string $readOnly
 Read-only explanation message.
 
callable $statusWrapper
 
callable $streamMimeFunc
 
string $tmpDirectory
 Temporary file directory.
 

Detailed Description

Base class for all file backend classes (including multi-write backends).

This class defines the methods as abstract that subclasses must implement. Outside callers can assume that all backends will have these functions.

All "storage paths" are of the format "mwstore://<backend>/<container>/<path>". The "backend" portion is unique name for the application to refer to a backend, while the "container" portion is a top-level directory of the backend. The "path" portion is a relative path that uses UNIX file system (FS) notation, though any particular backend may not actually be using a local filesystem. Therefore, the relative paths are only virtual.

Backend contents are stored under "domain"-specific container names by default. A domain is simply a logical umbrella for entities, such as those belonging to a certain application or portion of a website, for example. A domain can be local or global. Global (qualified) backends are achieved by configuring the "domain ID" to a constant. Global domains are simpler, but local domains can be used by choosing a domain ID based on the current context, such as which language of a website is being used.

For legacy reasons, the FSFileBackend class allows manually setting the paths of containers to ones that do not respect the "domain ID".

In key/value (object) stores, containers are the only hierarchy (the rest is emulated). FS-based backends are somewhat more restrictive due to the existence of real directory files; a regular file cannot have the same name as a directory. Other backends with virtual directories may not have this limitation. Callers should store files in such a way that no files and directories are under the same path.

In general, this class allows for callers to access storage through the same interface, without regard to the underlying storage system. However, calling code must follow certain patterns and be aware of certain things to ensure compatibility:

  • a) Always call prepare() on the parent directory before trying to put a file there; key/value stores only need the container to exist first, but filesystems need all the parent directories to exist first (prepare() is aware of all this)
  • b) Always call clean() on a directory when it might become empty to avoid empty directory buildup on filesystems; key/value stores never have empty directories, so doing this helps preserve consistency in both cases
  • c) Likewise, do not rely on the existence of empty directories for anything; calling directoryExists() on a path that prepare() was previously called on will return false for key/value stores if there are no files under that path
  • d) Never alter the resulting FSFile returned from getLocalReference(), as it could either be a copy of the source file in /tmp or the original source file itself
  • e) Use a file layout that results in never attempting to store files over directories or directories over files; key/value stores allow this but filesystems do not
  • f) Use ASCII file names (e.g. base32, IDs, hashes) to avoid Unicode issues in Windows
  • g) Do not assume that move operations are atomic (difficult with key/value stores)
  • h) Do not assume that file stat or read operations always have immediate consistency; various methods have a "latest" flag that should always be used if up-to-date information is required (this trades performance for correctness as needed)
  • i) Do not assume that directory listings have immediate consistency

Methods of subclasses should avoid throwing exceptions at all costs. As a corollary, external dependencies should be kept to a minimum.

Since
1.19

Definition at line 92 of file FileBackend.php.

Constructor & Destructor Documentation

◆ __construct()

FileBackend::__construct ( array $config)

Create a new backend instance from configuration.

This should only be called from within FileBackendGroup.

Parameters
array$configParameters include:
  • name : The unique name of this backend. This should consist of alphanumberic, '-', and '_' characters. This name should not be changed after use (e.g. with journaling). Note that the name is not used in actual container names.
  • domainId : Prefix to container names that is unique to this backend. It should only consist of alphanumberic, '-', and '_' characters. This ID is what avoids collisions if multiple logical backends use the same storage system, so this should be set carefully.
  • lockManager : LockManager object to use for any file locking. If not provided, then no file locking will be enforced.
  • fileJournal : FileJournal object to use for logging changes to files. If not provided, then change journaling will be disabled.
  • readOnly : Write operations are disallowed if this is a non-empty string. It should be an explanation for the backend being read-only.
  • parallelize : When to do file operations in parallel (when possible). Allowed values are "implicit", "explicit" and "off".
  • concurrency : How many file operations can be done in parallel.
  • tmpDirectory : Directory to use for temporary files. If this is not set or null, then the backend will try to discover a usable temporary directory.
  • obResetFunc : alternative callback to clear the output buffer
  • streamMimeFunc : alternative method to determine the content type from the path
  • logger : Optional PSR logger object.
  • profiler : Optional class name or object With profileIn/profileOut methods.
Exceptions
InvalidArgumentException

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, FileBackendStore, FSFileBackend, and SwiftFileBackend.

Definition at line 162 of file FileBackend.php.

References FileJournal\factory(), and string.

Member Function Documentation

◆ clean()

FileBackend::clean ( array $params)
final

Delete a storage directory if it is empty.

Backends using key/value stores may do nothing unless the directory is that of an empty container, in which case it will be deleted.

Parameters
array$paramsParameters include:
  • dir : storage directory
  • recursive : recursively delete empty subdirectories first (since 1.20)
  • bypassReadOnly : allow writes in read-only mode (since 1.20)
Returns
StatusValue

Definition at line 900 of file FileBackend.php.

References $params, doClean(), getScopedPHPBehaviorForOps(), isReadOnly(), and newStatus().

◆ clearCache()

FileBackend::clearCache ( array $paths = null)
abstract

Invalidate any in-process file stat and property cache.

If $paths is given, then only the cache for those files will be cleared.

See also
FileBackend::getFileStat()
Parameters
array | null$pathsStorage paths (optional)

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by CopyFileBackend\copyFileBatch().

◆ concatenate()

FileBackend::concatenate ( array $params)
abstract

Concatenate a list of storage files into a single file system file.

The target path should refer to a file that is already locked or otherwise safe from modification from other processes. Normally, the file will be a new temp file, which should be adequate.

Parameters
array$paramsOperation parameters, include:
  • srcs : ordered source storage paths (e.g. chunk1, chunk2, ...)
  • dst : file system path to 0-byte temp file
  • parallelize : try to do operations in parallel when possible
Returns
StatusValue

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

◆ copy()

FileBackend::copy ( array $params,
array $opts = [] )
final

Performs a single copy operation.

This sets $params['op'] to 'copy' and passes it to doOperation().

See also
FileBackend::doOperation()
Parameters
array$paramsOperation parameters
array$optsOperation options
Returns
StatusValue

Definition at line 495 of file FileBackend.php.

References doOperation().

◆ create()

FileBackend::create ( array $params,
array $opts = [] )
final

Performs a single create operation.

This sets $params['op'] to 'create' and passes it to doOperation().

See also
FileBackend::doOperation()
Parameters
array$paramsOperation parameters
array$optsOperation options
Returns
StatusValue

Definition at line 467 of file FileBackend.php.

References doOperation().

◆ delete()

FileBackend::delete ( array $params,
array $opts = [] )
final

Performs a single delete operation.

This sets $params['op'] to 'delete' and passes it to doOperation().

See also
FileBackend::doOperation()
Parameters
array$paramsOperation parameters
array$optsOperation options
Returns
StatusValue

Definition at line 523 of file FileBackend.php.

References doOperation().

◆ describe()

FileBackend::describe ( array $params,
array $opts = [] )
final

Performs a single describe operation.

This sets $params['op'] to 'describe' and passes it to doOperation().

See also
FileBackend::doOperation()
Parameters
array$paramsOperation parameters
array$optsOperation options
Returns
StatusValue
Since
1.21

Definition at line 538 of file FileBackend.php.

References doOperation().

◆ directoryExists()

FileBackend::directoryExists ( array $params)
abstract

Check if a directory exists at a given storage path.

Backends using key/value stores will check if the path is a virtual directory, meaning there are files under the given directory.

Storage backends with eventual consistency might return stale data.

Parameters
array$paramsParameters include:
  • dir : storage directory
Returns
bool|null Returns null on failure
Since
1.20

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

◆ doClean()

FileBackend::doClean ( array $params)
abstractprotected
See also
FileBackend::clean()
Parameters
array$params

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by clean().

◆ doOperation()

FileBackend::doOperation ( array $op,
array $opts = [] )
final

Same as doOperations() except it takes a single operation.

If you are doing a batch of operations that should either all succeed or all fail, then use that function instead.

See also
FileBackend::doOperations()
Parameters
array$opOperation
array$optsOperation options
Returns
StatusValue

Definition at line 453 of file FileBackend.php.

References doOperations().

Referenced by LocalRepo\cleanupDeletedBatch(), copy(), create(), delete(), describe(), move(), and store().

◆ doOperations()

FileBackend::doOperations ( array $ops,
array $opts = [] )
final

This is the main entry point into the backend for write operations.

Callers supply an ordered list of operations to perform as a transaction. Files will be locked, the stat cache cleared, and then the operations attempted. If any serious errors occur, all attempted operations will be rolled back.

$ops is an array of arrays. The outer array holds a list of operations. Each inner array is a set of key value pairs that specify an operation.

Supported operations and their parameters. The supported actions are:

  • create
  • store
  • copy
  • move
  • delete
  • describe (since 1.21)
  • null

FSFile/TempFSFile object support was added in 1.27.

a) Create a new file in storage with the contents of a string

[
'op' => 'create',
'dst' => <storage path>,
'content' => <string of new file contents>,
'overwrite' => <boolean>,
'overwriteSame' => <boolean>,
'headers' => <HTTP header name/value map> # since 1.21
]
Some information about database access in MediaWiki By Tim January Database layout For information about the MediaWiki database such as a description of the tables and their contents
Definition database.txt:9
> value, names are case insensitive). Two headers get special handling:If-Modified-Since(value must be a valid HTTP date) and Range(must be of the form "bytes=(\d*-\d*)") will be honored when streaming the file. 'ImportHandleLogItemXMLTag':When parsing a XML tag in a log item. Return false to stop further processing of the tag $reader:XMLReader object $logInfo:Array of information 'ImportHandlePageXMLTag':When parsing a XML tag in a page. Return false to stop further processing of the tag $reader:XMLReader object & $pageInfo:Array of information 'ImportHandleRevisionXMLTag':When parsing a XML tag in a page revision. Return false to stop further processing of the tag $reader:XMLReader object $pageInfo:Array of page information $revisionInfo:Array of revision information 'ImportHandleToplevelXMLTag':When parsing a top level XML tag. Return false to stop further processing of the tag $reader:XMLReader object 'ImportHandleUnknownUser':When a user doesn 't exist locally, this hook is called to give extensions an opportunity to auto-create it. If the auto-creation is successful, return false. $name:User name 'ImportHandleUploadXMLTag':When parsing a XML tag in a file upload. Return false to stop further processing of the tag $reader:XMLReader object $revisionInfo:Array of information 'ImportLogInterwikiLink':Hook to change the interwiki link used in log entries and edit summaries for transwiki imports. & $fullInterwikiPrefix:Interwiki prefix, may contain colons. & $pageTitle:String that contains page title. 'ImportSources':Called when reading from the $wgImportSources configuration variable. Can be used to lazy-load the import sources list. & $importSources:The value of $wgImportSources. Modify as necessary. See the comment in DefaultSettings.php for the detail of how to structure this array. 'InfoAction':When building information to display on the action=info page. $context:IContextSource object & $pageInfo:Array of information 'InitializeArticleMaybeRedirect':MediaWiki check to see if title is a redirect. & $title:Title object for the current page & $request:WebRequest & $ignoreRedirect:boolean to skip redirect check & $target:Title/string of redirect target & $article:Article object 'InternalParseBeforeLinks':during Parser 's internalParse method before links but after nowiki/noinclude/includeonly/onlyinclude and other processings. & $parser:Parser object & $text:string containing partially parsed text & $stripState:Parser 's internal StripState object 'InternalParseBeforeSanitize':during Parser 's internalParse method just before the parser removes unwanted/dangerous HTML tags and after nowiki/noinclude/includeonly/onlyinclude and other processings. Ideal for syntax-extensions after template/parser function execution which respect nowiki and HTML-comments. & $parser:Parser object & $text:string containing partially parsed text & $stripState:Parser 's internal StripState object 'InterwikiLoadPrefix':When resolving if a given prefix is an interwiki or not. Return true without providing an interwiki to continue interwiki search. $prefix:interwiki prefix we are looking for. & $iwData:output array describing the interwiki with keys iw_url, iw_local, iw_trans and optionally iw_api and iw_wikiid. 'InvalidateEmailComplete':Called after a user 's email has been invalidated successfully. $user:user(object) whose email is being invalidated 'IRCLineURL':When constructing the URL to use in an IRC notification. Callee may modify $url and $query, URL will be constructed as $url . $query & $url:URL to index.php & $query:Query string $rc:RecentChange object that triggered url generation 'IsFileCacheable':Override the result of Article::isFileCacheable()(if true) & $article:article(object) being checked 'IsTrustedProxy':Override the result of IP::isTrustedProxy() & $ip:IP being check & $result:Change this value to override the result of IP::isTrustedProxy() 'IsUploadAllowedFromUrl':Override the result of UploadFromUrl::isAllowedUrl() $url:URL used to upload from & $allowed:Boolean indicating if uploading is allowed for given URL 'isValidEmailAddr':Override the result of Sanitizer::validateEmail(), for instance to return false if the domain name doesn 't match your organization. $addr:The e-mail address entered by the user & $result:Set this and return false to override the internal checks 'isValidPassword':Override the result of User::isValidPassword() $password:The password entered by the user & $result:Set this and return false to override the internal checks $user:User the password is being validated for 'Language::getMessagesFileName':$code:The language code or the language we 're looking for a messages file for & $file:The messages file path, you can override this to change the location. 'LanguageGetMagic':DEPRECATED since 1.16! Use $magicWords in a file listed in $wgExtensionMessagesFiles instead. Use this to define synonyms of magic words depending of the language & $magicExtensions:associative array of magic words synonyms $lang:language code(string) 'LanguageGetNamespaces':Provide custom ordering for namespaces or remove namespaces. Do not use this hook to add namespaces. Use CanonicalNamespaces for that. & $namespaces:Array of namespaces indexed by their numbers 'LanguageGetSpecialPageAliases':DEPRECATED! Use $specialPageAliases in a file listed in $wgExtensionMessagesFiles instead. Use to define aliases of special pages names depending of the language & $specialPageAliases:associative array of magic words synonyms $lang:language code(string) 'LanguageGetTranslatedLanguageNames':Provide translated language names. & $names:array of language code=> language name $code:language of the preferred translations 'LanguageLinks':Manipulate a page 's language links. This is called in various places to allow extensions to define the effective language links for a page. $title:The page 's Title. & $links:Array with elements of the form "language:title" in the order that they will be output. & $linkFlags:Associative array mapping prefixed links to arrays of flags. Currently unused, but planned to provide support for marking individual language links in the UI, e.g. for featured articles. 'LanguageSelector':Hook to change the language selector available on a page. $out:The output page. $cssClassName:CSS class name of the language selector. 'LinkBegin':DEPRECATED since 1.28! Use HtmlPageLinkRendererBegin instead. Used when generating internal and interwiki links in Linker::link(), before processing starts. Return false to skip default processing and return $ret. See documentation for Linker::link() for details on the expected meanings of parameters. $skin:the Skin object $target:the Title that the link is pointing to & $html:the contents that the< a > tag should have(raw HTML) name
Definition hooks.txt:1889
MediaWiki s SiteStore can be cached and stored in a flat in a json format If the SiteStore is frequently the file cache may provide a performance benefit over a database even with memcached in front of it sites are listed in a key value map

b) Copy a file system file into storage

[
'op' => 'store',
'src' => <file system path, FSFile, or TempFSFile>,
'dst' => <storage path>,
'overwrite' => <boolean>,
'overwriteSame' => <boolean>,
'headers' => <HTTP header name/value map> # since 1.21
]
this section has the sole purpose of protecting the integrity of the free software distribution system
Definition COPYING.txt:218
Class representing a non-directory file on the file system.
Definition FSFile.php:29
This class is used to hold the location and do limited manipulation of files stored temporarily (this...

c) Copy a file within storage

[
'op' => 'copy',
'src' => <storage path>,
'dst' => <storage path>,
'overwrite' => <boolean>,
'overwriteSame' => <boolean>,
'ignoreMissingSource' => <boolean>, # since 1.21
'headers' => <HTTP header name/value map> # since 1.21
]

d) Move a file within storage

[
'op' => 'move',
'src' => <storage path>,
'dst' => <storage path>,
'overwrite' => <boolean>,
'overwriteSame' => <boolean>,
'ignoreMissingSource' => <boolean>, # since 1.21
'headers' => <HTTP header name/value map> # since 1.21
]

e) Delete a file within storage

[
'op' => 'delete',
'src' => <storage path>,
'ignoreMissingSource' => <boolean>
]

f) Update metadata for a file within storage

[
'op' => 'describe',
'src' => <storage path>,
'headers' => <HTTP header name/value map>
]

g) Do nothing (no-op)

[
'op' => 'null',
]

Boolean flags for operations (operation-specific):

  • ignoreMissingSource : The operation will simply succeed and do nothing if the source file does not exist.
  • overwrite : Any destination file will be overwritten.
  • overwriteSame : If a file already exists at the destination with the same contents, then do nothing to the destination file instead of giving an error. This does not compare headers. This option is ignored if 'overwrite' is already provided.
  • headers : If supplied, the result of merging these headers with any existing source file headers (replacing conflicting ones) will be set as the destination file headers. Headers are deleted if their value is set to the empty string. When a file has headers they are included in responses to GET and HEAD requests to the backing store for that file. Header values should be no larger than 255 bytes, except for Content-Disposition. The system might ignore or truncate any headers that are too long to store (exact limits will vary). Backends that don't support metadata ignore this. (since 1.21)

$opts is an associative of boolean flags, including:

  • force : Operation precondition errors no longer trigger an abort. Any remaining operations are still attempted. Unexpected failures may still cause remaining operations to be aborted.
  • nonLocking : No locks are acquired for the operations. This can increase performance for non-critical writes. This has no effect unless the 'force' flag is set.
  • nonJournaled : Don't log this operation batch in the file journal. This limits the ability of recovery scripts.
  • parallelize : Try to do operations in parallel when possible.
  • bypassReadOnly : Allow writes in read-only mode. (since 1.20)
  • preserveCache : Don't clear the process cache before checking files. This should only be used if all entries in the process cache were added after the files were already locked. (since 1.20)
Note
Remarks on locking: File system paths given to operations should refer to files that are already locked or otherwise safe from modification from other processes. Normally these files will be new temp files, which should be adequate.
Return value:

This returns a Status, which contains all warnings and fatals that occurred during the operation. The 'failCount', 'successCount', and 'success' members will reflect each operation attempted.

The StatusValue will be "OK" unless:

  • a) unexpected operation errors occurred (network partitions, disk full...)
  • b) significant operation errors occurred and 'force' was not set
Parameters
array$opsList of operations to execute in order
array$optsBatch operation options
Returns
StatusValue

Definition at line 416 of file FileBackend.php.

References doOperationsInternal(), getScopedPHPBehaviorForOps(), isReadOnly(), newStatus(), and resolveFSFileObjects().

Referenced by FileRepo\deleteBatch(), doOperation(), FileRepo\publishBatch(), and FileRepo\storeBatch().

◆ doOperationsInternal()

FileBackend::doOperationsInternal ( array $ops,
array $opts )
abstractprotected
See also
FileBackend::doOperations()
Parameters
array$ops
array$opts

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by doOperations().

◆ doPrepare()

FileBackend::doPrepare ( array $params)
abstractprotected
See also
FileBackend::prepare()
Parameters
array$params

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by prepare().

◆ doPublish()

FileBackend::doPublish ( array $params)
abstractprotected
See also
FileBackend::publish()
Parameters
array$params

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by publish().

◆ doQuickOperation()

FileBackend::doQuickOperation ( array $op)
final

Same as doQuickOperations() except it takes a single operation.

If you are doing a batch of operations, then use that function instead.

See also
FileBackend::doQuickOperations()
Parameters
array$opOperation
Returns
StatusValue
Since
1.20

Definition at line 690 of file FileBackend.php.

References doQuickOperations().

Referenced by quickCopy(), quickCreate(), quickDelete(), quickDescribe(), quickMove(), and quickStore().

◆ doQuickOperations()

FileBackend::doQuickOperations ( array $ops,
array $opts = [] )
final

Perform a set of independent file operations on some files.

This does no locking, nor journaling, and possibly no stat calls. Any destination files that already exist will be overwritten. This should only be used on non-original files, like cache files.

Supported operations and their parameters:

  • create
  • store
  • copy
  • move
  • delete
  • describe (since 1.21)
  • null

FSFile/TempFSFile object support was added in 1.27.

a) Create a new file in storage with the contents of a string

[
'op' => 'create',
'dst' => <storage path>,
'content' => <string of new file contents>,
'headers' => <HTTP header name/value map> # since 1.21
]

b) Copy a file system file into storage

[
'op' => 'store',
'src' => <file system path, FSFile, or TempFSFile>,
'dst' => <storage path>,
'headers' => <HTTP header name/value map> # since 1.21
]

c) Copy a file within storage

[
'op' => 'copy',
'src' => <storage path>,
'dst' => <storage path>,
'ignoreMissingSource' => <boolean>, # since 1.21
'headers' => <HTTP header name/value map> # since 1.21
]

d) Move a file within storage

[
'op' => 'move',
'src' => <storage path>,
'dst' => <storage path>,
'ignoreMissingSource' => <boolean>, # since 1.21
'headers' => <HTTP header name/value map> # since 1.21
]

e) Delete a file within storage

[
'op' => 'delete',
'src' => <storage path>,
'ignoreMissingSource' => <boolean>
]

f) Update metadata for a file within storage

[
'op' => 'describe',
'src' => <storage path>,
'headers' => <HTTP header name/value map>
]

g) Do nothing (no-op)

[
'op' => 'null',
]
Boolean flags for operations (operation-specific):
  • ignoreMissingSource : The operation will simply succeed and do nothing if the source file does not exist.
  • headers : If supplied with a header name/value map, the backend will reply with these headers when GETs/HEADs of the destination file are made. Header values should be smaller than 256 bytes. Content-Disposition headers can be longer, though the system might ignore or truncate ones that are too long to store. Existing headers will remain, but these will replace any conflicting previous headers, and headers will be removed if they are set to an empty string. Backends that don't support metadata ignore this. (since 1.21)

$opts is an associative of boolean flags, including:

  • bypassReadOnly : Allow writes in read-only mode (since 1.20)
Return value:
This returns a Status, which contains all warnings and fatals that occurred during the operation. The 'failCount', 'successCount', and 'success' members will reflect each operation attempted for the given files. The StatusValue will be considered "OK" as long as no fatal errors occurred.
Parameters
array$opsSet of operations to execute
array$optsBatch operation options
Returns
StatusValue
Since
1.20

Definition at line 654 of file FileBackend.php.

References doQuickOperationsInternal(), getScopedPHPBehaviorForOps(), isReadOnly(), newStatus(), and resolveFSFileObjects().

Referenced by doQuickOperation().

◆ doQuickOperationsInternal()

FileBackend::doQuickOperationsInternal ( array $ops)
abstractprotected
See also
FileBackend::doQuickOperations()
Parameters
array$ops
Since
1.20

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by doQuickOperations().

◆ doSecure()

FileBackend::doSecure ( array $params)
abstractprotected
See also
FileBackend::secure()
Parameters
array$params

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by secure().

◆ extensionFromPath()

static FileBackend::extensionFromPath ( $path,
$case = 'lowercase' )
staticfinal

◆ fileExists()

FileBackend::fileExists ( array $params)
abstract

Check if a file exists at a storage path in the backend.

This returns false if only a directory exists at the path.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
bool|null Returns null on failure

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by CopyFileBackend\copyFileBatch(), ForeignAPIRepo\getThumbUrlFromCache(), and SyncFileBackend\syncFileBatch().

◆ getContainerStoragePath()

FileBackend::getContainerStoragePath ( $container)
final

Get the storage path for the given container for this backend.

Parameters
string$containerContainer name
Returns
string Storage path
Since
1.21

Definition at line 1386 of file FileBackend.php.

References getRootStoragePath().

◆ getDirectoryList()

FileBackend::getDirectoryList ( array $params)
abstract

Get an iterator to list all directories under a storage directory.

If the directory is of the form "mwstore://backend/container", then all directories in the container will be listed. If the directory is of form "mwstore://backend/container/dir", then all directories directly under that directory will be listed. Results will be storage directories relative to the given directory.

Storage backends with eventual consistency might return stale data.

Failures during iteration can result in FileBackendError exceptions (since 1.22).

Parameters
array$paramsParameters include:
  • dir : storage directory
  • topOnly : only return direct child dirs of the directory
Returns
Traversable|array|null Returns null on failure
Since
1.20

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by getTopDirectoryList().

◆ getDomainId()

FileBackend::getDomainId ( )
final

Get the domain identifier used for this backend (possibly empty).

Returns
string
Since
1.28

Definition at line 216 of file FileBackend.php.

References $domainId.

Referenced by getWikiId().

◆ getFeatures()

FileBackend::getFeatures ( )

Get the a bitfield of extra features supported by the backend medium.

Returns
int Bitfield of FileBackend::ATTR_* flags
Since
1.23

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, FSFileBackend, MemoryFileBackend, and SwiftFileBackend.

Definition at line 253 of file FileBackend.php.

References ATTR_UNICODE_PATHS.

Referenced by hasFeatures().

◆ getFileContents()

FileBackend::getFileContents ( array $params)
final

Get the contents of a file at a storage path in the backend.

This should be avoided for potentially large files.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
string|bool Returns false on failure

Definition at line 963 of file FileBackend.php.

References $params, and getFileContentsMulti().

◆ getFileContentsMulti()

FileBackend::getFileContentsMulti ( array $params)
abstract

Like getFileContents() except it takes an array of storage paths and returns a map of storage paths to strings (or null on failure).

The map keys (paths) are in the same order as the provided list of paths.

See also
FileBackend::getFileContents()
Parameters
array$paramsParameters include:
  • srcs : list of source storage paths
  • latest : use the latest available data
  • parallelize : try to do operations in parallel when possible
Returns
array Map of (path name => string or false on failure)
Since
1.20

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by getFileContents().

◆ getFileHttpUrl()

FileBackend::getFileHttpUrl ( array $params)
abstract

Return an HTTP URL to a given file that requires no authentication to use.

The URL may be pre-authenticated (via some token in the URL) and temporary. This will return null if the backend cannot make an HTTP URL for the file.

This is useful for key/value stores when using scripts that seek around large files and those scripts (and the backend) support HTTP Range headers. Otherwise, one would need to use getLocalReference(), which involves loading the entire file on to local disk.

Parameters
array$paramsParameters include:
  • src : source storage path
  • ttl : lifetime (seconds) if pre-authenticated; default is 1 day
Returns
string|null
Since
1.21

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, FileBackendStore, and SwiftFileBackend.

◆ getFileList()

FileBackend::getFileList ( array $params)
abstract

Get an iterator to list all stored files under a storage directory.

If the directory is of the form "mwstore://backend/container", then all files in the container will be listed. If the directory is of form "mwstore://backend/container/dir", then all files under that directory will be listed. Results will be storage paths relative to the given directory.

Storage backends with eventual consistency might return stale data.

Failures during iteration can result in FileBackendError exceptions (since 1.22).

Parameters
array$paramsParameters include:
  • dir : storage directory
  • topOnly : only return direct child files of the directory (since 1.20)
  • adviseStat : set to true if stat requests will be made on the files (since 1.22)
Returns
Traversable|array|null Returns null on failure

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by CopyFileBackend\getListingDiffRel(), and getTopFileList().

◆ getFileProps()

FileBackend::getFileProps ( array $params)
abstract

Get the properties of the file at a storage path in the backend.

This gives the result of FSFile::getProps() on a local copy of the file.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
array Returns FSFile::placeholderProps() on failure

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

◆ getFileSha1Base36()

FileBackend::getFileSha1Base36 ( array $params)
abstract

Get a SHA-1 hash of the file at a storage path in the backend.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
string|bool Hash string or false on failure

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by CopyFileBackend\filesAreSame(), and SyncFileBackend\filesAreSame().

◆ getFileSize()

FileBackend::getFileSize ( array $params)
abstract

Get the size (bytes) of a file at a storage path in the backend.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
int|bool Returns false on failure

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by SyncFileBackend\filesAreSame().

◆ getFileStat()

FileBackend::getFileStat ( array $params)
abstract

Get quick information about a file at a storage path in the backend.

If the file does not exist, then this returns false. Otherwise, the result is an associative array that includes:

  • mtime : the last-modified timestamp (TS_MW)
  • size : the file size (bytes) Additional values may be included for internal use only.
Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
array|bool|null Returns null on failure

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by CopyFileBackend\filesAreSame().

◆ getFileTimestamp()

FileBackend::getFileTimestamp ( array $params)
abstract

Get the last-modified timestamp of the file at a storage path.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
string|bool TS_MW timestamp or false on failure

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by ForeignAPIRepo\getThumbUrlFromCache().

◆ getFileXAttributes()

FileBackend::getFileXAttributes ( array $params)
abstract

Get metadata about a file at a storage path in the backend.

If the file does not exist, then this returns false. Otherwise, the result is an associative array that includes:

  • headers : map of HTTP headers used for GET/HEAD requests (name => value)
  • metadata : map of file metadata (name => value) Metadata keys and headers names will be returned in all lower-case. Additional values may be included for internal use only.

Use FileBackend::hasFeatures() to check how well this is supported.

Parameters
array$params$params include:
  • src : source storage path
  • latest : use the latest available data
Returns
array|bool Returns false on failure
Since
1.23

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

◆ getJournal()

FileBackend::getJournal ( )
final

Get the file journal object for this backend.

Returns
FileJournal

Definition at line 1395 of file FileBackend.php.

References $fileJournal.

Referenced by SyncFileBackend\syncBackends().

◆ getLocalCopy()

FileBackend::getLocalCopy ( array $params)
final

Get a local copy on disk of the file at a storage path in the backend.

The temporary copy will have the same file extension as the source. Temporary files may be purged when the file object falls out of scope.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
TempFSFile|null Returns null on failure

Definition at line 1124 of file FileBackend.php.

References $params, and getLocalCopyMulti().

Referenced by SwiftFileBackend\addMissingMetadata().

◆ getLocalCopyMulti()

FileBackend::getLocalCopyMulti ( array $params)
abstract

Like getLocalCopy() except it takes an array of storage paths and returns a map of storage paths to TempFSFile objects (or null on failure).

The map keys (paths) are in the same order as the provided list of paths.

See also
FileBackend::getLocalCopy()
Parameters
array$paramsParameters include:
  • srcs : list of source storage paths
  • latest : use the latest available data
  • parallelize : try to do operations in parallel when possible
Returns
array Map of (path name => TempFSFile or null on failure)
Since
1.20

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by getLocalCopy().

◆ getLocalReference()

FileBackend::getLocalReference ( array $params)
final

Returns a file system file, identical to the file at a storage path.

The file returned is either:

  • a) A local copy of the file at a storage path in the backend. The temporary copy will have the same extension as the source.
  • b) An original of the file at a storage path in the backend. Temporary files may be purged when the file object falls out of scope.

Write operations should never be done on this file as some backends may do internal tracking or may be instances of FileBackendMultiWrite. In that latter case, there are copies of the file that must stay in sync. Additionally, further calls to this function may return the same file.

Parameters
array$paramsParameters include:
  • src : source storage path
  • latest : use the latest available data
Returns
FSFile|null Returns null on failure

Definition at line 1091 of file FileBackend.php.

References $params, and getLocalReferenceMulti().

Referenced by CopyFileBackend\copyFileBatch(), FileBackendStore\doConcatenate(), FileBackendStore\doGetFileSha1Base36(), FileBackendStore\doStreamFile(), FileBackendStore\getFileProps(), and SyncFileBackend\syncFileBatch().

◆ getLocalReferenceMulti()

FileBackend::getLocalReferenceMulti ( array $params)
abstract

Like getLocalReference() except it takes an array of storage paths and returns a map of storage paths to FSFile objects (or null on failure).

The map keys (paths) are in the same order as the provided list of paths.

See also
FileBackend::getLocalReference()
Parameters
array$paramsParameters include:
  • srcs : list of source storage paths
  • latest : use the latest available data
  • parallelize : try to do operations in parallel when possible
Returns
array Map of (path name => FSFile or null on failure)
Since
1.20

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by CopyFileBackend\copyFileBatch(), and getLocalReference().

◆ getName()

FileBackend::getName ( )
final

Get the unique backend name.

We may have multiple different backends of the same type. For example, we can have two Swift backends using different proxies.

Returns
string

Definition at line 206 of file FileBackend.php.

References $name.

Referenced by FileBackendDBRepoWrapper\__construct(), FileOpPerfTest\doPerfTest(), SyncFileBackend\replaceNamePaths(), and SyncFileBackend\syncFileBatch().

◆ getReadOnlyReason()

FileBackend::getReadOnlyReason ( )
final

Get an explanatory message if this backend is read-only.

Returns
string|bool Returns false if the backend is not read-only

Definition at line 243 of file FileBackend.php.

◆ getRootStoragePath()

FileBackend::getRootStoragePath ( )
final

Get the root storage path of this backend.

All container paths are "subdirectories" of this path.

Returns
string Storage path
Since
1.20

Definition at line 1375 of file FileBackend.php.

Referenced by CopyFileBackend\copyFileBatch(), getContainerStoragePath(), and CopyFileBackend\getListingDiffRel().

◆ getScopedFileLocks()

FileBackend::getScopedFileLocks ( array $paths,
$type,
StatusValue $status,
$timeout = 0 )
final

Lock the files at the given storage paths in the backend.

This will either lock all the files or none (on failure). On failure, the StatusValue object will be updated with errors.

Once the return value goes out scope, the locks will be released and the StatusValue updated. Unlock fatals will not change the StatusValue "OK" value.

See also
ScopedLock::factory()
Parameters
array$pathsList of storage paths or map of lock types to path lists
int | string$typeLockManager::LOCK_* constant or "mixed"
StatusValue$statusStatusValue to update on lock/unlock
int$timeoutTimeout in seconds (0 means non-blocking) (since 1.24)
Returns
ScopedLock|null Returns null on failure

Definition at line 1336 of file FileBackend.php.

References $type, and ScopedLock\factory().

Referenced by SwiftFileBackend\addMissingMetadata(), FileBackendStore\concatenate(), FileBackendStore\doClean(), FileBackendStore\doOperationsInternal(), FileBackendMultiWrite\getScopedLocksForOps(), FileBackendStore\getScopedLocksForOps(), and SyncFileBackend\syncFileBatch().

◆ getScopedLocksForOps()

FileBackend::getScopedLocksForOps ( array $ops,
StatusValue $status )
abstract

Get an array of scoped locks needed for a batch of file operations.

Normally, FileBackend::doOperations() handles locking, unless the 'nonLocking' param is passed in. This function is useful if you want the files to be locked for a broader scope than just when the files are changing. For example, if you need to update DB metadata, you may want to keep the files locked until finished.

See also
FileBackend::doOperations()
Parameters
array$opsList of file operations to FileBackend::doOperations()
StatusValue$statusStatusValue to update on lock/unlock
Returns
ScopedLock|null
Since
1.20

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

◆ getScopedPHPBehaviorForOps()

FileBackend::getScopedPHPBehaviorForOps ( )
finalprotected

Enter file operation scope.

This just makes PHP ignore user aborts/disconnects until the return value leaves scope. This returns null and does nothing in CLI mode.

Returns
ScopedCallback|null

Definition at line 922 of file FileBackend.php.

Referenced by clean(), doOperations(), doQuickOperations(), prepare(), publish(), and secure().

◆ getTopDirectoryList()

FileBackend::getTopDirectoryList ( array $params)
final

Same as FileBackend::getDirectoryList() except only lists directories that are immediately under the given directory.

Storage backends with eventual consistency might return stale data.

Failures during iteration can result in FileBackendError exceptions (since 1.22).

Parameters
array$paramsParameters include:
  • dir : storage directory
Returns
Traversable|array|null Returns null on failure
Since
1.20

Definition at line 1212 of file FileBackend.php.

References getDirectoryList().

Referenced by FileBackendStore\doClean().

◆ getTopFileList()

FileBackend::getTopFileList ( array $params)
final

Same as FileBackend::getFileList() except only lists files that are immediately under the given directory.

Storage backends with eventual consistency might return stale data.

Failures during iteration can result in FileBackendError exceptions (since 1.22).

Parameters
array$paramsParameters include:
  • dir : storage directory
  • adviseStat : set to true if stat requests will be made on the files (since 1.22)
Returns
Traversable|array|null Returns null on failure
Since
1.20

Definition at line 1250 of file FileBackend.php.

References getFileList().

◆ getWikiId()

FileBackend::getWikiId ( )
final

Alias to getDomainId()

Returns
string
Since
1.20

Definition at line 225 of file FileBackend.php.

References getDomainId().

Referenced by FileBackendDBRepoWrapper\__construct(), and CopyFileBackend\copyFileBatch().

◆ hasFeatures()

FileBackend::hasFeatures ( $bitfield)
final

Check if the backend medium supports a field of extra features.

Parameters
int$bitfieldBitfield of FileBackend::ATTR_* flags
Returns
bool
Since
1.23

Definition at line 264 of file FileBackend.php.

References getFeatures().

◆ isPathTraversalFree()

static FileBackend::isPathTraversalFree ( $path)
staticfinal

Check if a relative path has no directory traversals.

Parameters
string$path
Returns
bool
Since
1.20

Definition at line 1519 of file FileBackend.php.

Referenced by FileRepo\validateFilename().

◆ isReadOnly()

FileBackend::isReadOnly ( )
final

Check if this backend is read-only.

Returns
bool

Definition at line 234 of file FileBackend.php.

Referenced by clean(), doOperations(), doQuickOperations(), prepare(), publish(), and secure().

◆ isStoragePath()

static FileBackend::isStoragePath ( $path)
staticfinal

◆ lockFiles()

FileBackend::lockFiles ( array $paths,
$type,
$timeout = 0 )
final

Lock the files at the given storage paths in the backend.

This will either lock all the files or none (on failure).

Callers should consider using getScopedFileLocks() instead.

Parameters
array$pathsStorage paths
int$typeLockManager::LOCK_* constant
int$timeoutTimeout in seconds (0 means non-blocking) (since 1.24)
Returns
StatusValue

Definition at line 1301 of file FileBackend.php.

References $type, and wrapStatus().

◆ makeContentDisposition()

static FileBackend::makeContentDisposition ( $type,
$filename = '' )
staticfinal

Build a Content-Disposition header value per RFC 6266.

Parameters
string$typeOne of (attachment, inline)
string$filenameSuggested file name (should not contain slashes)
Exceptions
FileBackendError
Returns
string
Since
1.20

Definition at line 1532 of file FileBackend.php.

References $type.

Referenced by File\getThumbDisposition(), ResourceLoaderImage\sendResponseHeaders(), and FileBackendTest\testSanitizeOpHeaders().

◆ move()

FileBackend::move ( array $params,
array $opts = [] )
final

Performs a single move operation.

This sets $params['op'] to 'move' and passes it to doOperation().

See also
FileBackend::doOperation()
Parameters
array$paramsOperation parameters
array$optsOperation options
Returns
StatusValue

Definition at line 509 of file FileBackend.php.

References doOperation().

◆ newStatus()

FileBackend::newStatus ( )
finalprotected

Yields the result of the status wrapper callback on either:

  • StatusValue::newGood() if this method is called without parameters
  • StatusValue::newFatal() with all parameters to this method if passed in
Parameters
string$args,...
Returns
StatusValue

Definition at line 1590 of file FileBackend.php.

References $args, and wrapStatus().

Referenced by FileBackendMultiWrite\accessibilityCheck(), SwiftFileBackend\addMissingMetadata(), clean(), FileBackendMultiWrite\concatenate(), FileBackendStore\concatenate(), FileBackendMultiWrite\consistencyCheck(), SwiftFileBackend\createContainer(), FileBackendStore\createInternal(), SwiftFileBackend\deleteContainer(), FileBackendStore\describeInternal(), FileBackendStore\doClean(), FileBackendStore\doCleanInternal(), SwiftFileBackend\doCleanInternal(), FSFileBackend\doCleanInternal(), FileBackendStore\doConcatenate(), FSFileBackend\doCopyInternal(), MemoryFileBackend\doCopyInternal(), SwiftFileBackend\doCopyInternal(), FSFileBackend\doCreateInternal(), MemoryFileBackend\doCreateInternal(), SwiftFileBackend\doCreateInternal(), FSFileBackend\doDeleteInternal(), MemoryFileBackend\doDeleteInternal(), SwiftFileBackend\doDeleteInternal(), FileBackendStore\doDescribeInternal(), SwiftFileBackend\doDescribeInternal(), FileBackendMultiWrite\doDirectoryOp(), FSFileBackend\doExecuteOpHandlesInternal(), SwiftFileBackend\doExecuteOpHandlesInternal(), FSFileBackend\doMoveInternal(), SwiftFileBackend\doMoveInternal(), doOperations(), FileBackendMultiWrite\doOperationsInternal(), FileBackendStore\doOperationsInternal(), FileBackendStore\doPrepare(), FileBackendStore\doPrepareInternal(), SwiftFileBackend\doPrepareInternal(), FSFileBackend\doPrepareInternal(), FileBackendStore\doPublish(), FileBackendStore\doPublishInternal(), SwiftFileBackend\doPublishInternal(), FSFileBackend\doPublishInternal(), doQuickOperations(), FileBackendMultiWrite\doQuickOperationsInternal(), FileBackendStore\doQuickOperationsInternal(), FileBackendStore\doSecure(), FileBackendStore\doSecureInternal(), SwiftFileBackend\doSecureInternal(), FSFileBackend\doSecureInternal(), FSFileBackend\doStoreInternal(), MemoryFileBackend\doStoreInternal(), SwiftFileBackend\doStoreInternal(), FileBackendStore\doStreamFile(), SwiftFileBackend\doStreamFile(), FileBackendStore\nullInternal(), SwiftFileBackend\objectListing(), prepare(), publish(), FileBackendMultiWrite\resyncFiles(), secure(), SwiftFileBackend\setContainerAccess(), FileBackendStore\storeInternal(), and FileBackendStore\streamFile().

◆ normalizeContainerPath()

static FileBackend::normalizeContainerPath ( $path)
staticfinalprotected

Validate and normalize a relative storage path.

Null is returned if the path involves directory traversal. Traversal is insecure for FS backends and broken for others.

This uses the same traversal protection as Title::secureAndSplit().

Parameters
string$pathStorage path relative to a container
Returns
string|null

Definition at line 1558 of file FileBackend.php.

References $path.

Referenced by normalizeStoragePath(), and FileBackendStore\resolveStoragePath().

◆ normalizeStoragePath()

static FileBackend::normalizeStoragePath ( $storagePath)
staticfinal

◆ parentStoragePath()

static FileBackend::parentStoragePath ( $storagePath)
staticfinal

Get the parent storage directory of a storage path.

This returns a path like "mwstore://backend/container", "mwstore://backend/container/...", or null if there is no parent.

Parameters
string$storagePath
Returns
string|null

Definition at line 1485 of file FileBackend.php.

References list, and splitStoragePath().

Referenced by ParserTestRunner\deleteFiles(), and FileBackendTest\testParentStoragePath().

◆ preloadCache()

FileBackend::preloadCache ( array $paths)
abstract

Preload persistent file stat cache and property cache into in-process cache.

This should be used when stat calls will be made on a known list of a many files.

See also
FileBackend::getFileStat()
Parameters
array$pathsStorage paths

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

◆ preloadFileStat()

FileBackend::preloadFileStat ( array $params)
abstract

Preload file stat information (concurrently if possible) into in-process cache.

This should be used when stat calls will be made on a known list of a many files. This does not make use of the persistent file stat cache.

See also
FileBackend::getFileStat()
Parameters
array$paramsParameters include:
  • srcs : list of source storage paths
  • latest : use the latest available data
Returns
bool All requests proceeded without I/O errors (since 1.24)
Since
1.23

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

Referenced by SyncFileBackend\syncFileBatch().

◆ prepare()

FileBackend::prepare ( array $params)
final

Prepare a storage directory for usage.

This will create any required containers and parent directories. Backends using key/value stores only need to create the container.

The 'noAccess' and 'noListing' parameters works the same as in secure(), except they are only applied if the directory/container had to be created. These flags should always be set for directories that have private files. However, setting them is not guaranteed to actually do anything. Additional server configuration may be needed to achieve the desired effect.

Parameters
array$paramsParameters include:
  • dir : storage directory
  • noAccess : try to deny file access (since 1.20)
  • noListing : try to deny file listing (since 1.20)
  • bypassReadOnly : allow writes in read-only mode (since 1.20)
Returns
StatusValue

Definition at line 810 of file FileBackend.php.

References $params, doPrepare(), getScopedPHPBehaviorForOps(), isReadOnly(), and newStatus().

Referenced by FileOpPerfTest\doPerfTest(), and ForeignAPIRepo\getThumbUrlFromCache().

◆ publish()

FileBackend::publish ( array $params)
final

Remove measures to block web access to a storage directory and the container it belongs to.

FS backends might remove .htaccess files whereas key/value store backends might grant container access to the storage user representing end-users in web requests. This essentially can undo the result of secure() calls.

This is not guaranteed to actually make files or listings publically viewable. Additional server configuration may be needed to achieve the desired effect.

Parameters
array$paramsParameters include:
  • dir : storage directory
  • access : try to allow file access
  • listing : try to allow file listing
  • bypassReadOnly : allow writes in read-only mode (since 1.20)
Returns
StatusValue
Since
1.20

Definition at line 874 of file FileBackend.php.

References $params, doPublish(), getScopedPHPBehaviorForOps(), isReadOnly(), and newStatus().

◆ quickCopy()

FileBackend::quickCopy ( array $params)
final

Performs a single quick copy operation.

This sets $params['op'] to 'copy' and passes it to doQuickOperation().

See also
FileBackend::doQuickOperation()
Parameters
array$paramsOperation parameters
Returns
StatusValue
Since
1.20

Definition at line 732 of file FileBackend.php.

References doQuickOperation().

◆ quickCreate()

FileBackend::quickCreate ( array $params)
final

Performs a single quick create operation.

This sets $params['op'] to 'create' and passes it to doQuickOperation().

See also
FileBackend::doQuickOperation()
Parameters
array$paramsOperation parameters
Returns
StatusValue
Since
1.20

Definition at line 704 of file FileBackend.php.

References doQuickOperation().

Referenced by ForeignAPIRepo\getThumbUrlFromCache().

◆ quickDelete()

FileBackend::quickDelete ( array $params)
final

Performs a single quick delete operation.

This sets $params['op'] to 'delete' and passes it to doQuickOperation().

See also
FileBackend::doQuickOperation()
Parameters
array$paramsOperation parameters
Returns
StatusValue
Since
1.20

Definition at line 760 of file FileBackend.php.

References doQuickOperation().

◆ quickDescribe()

FileBackend::quickDescribe ( array $params)
final

Performs a single quick describe operation.

This sets $params['op'] to 'describe' and passes it to doQuickOperation().

See also
FileBackend::doQuickOperation()
Parameters
array$paramsOperation parameters
Returns
StatusValue
Since
1.21

Definition at line 774 of file FileBackend.php.

References doQuickOperation().

◆ quickMove()

FileBackend::quickMove ( array $params)
final

Performs a single quick move operation.

This sets $params['op'] to 'move' and passes it to doQuickOperation().

See also
FileBackend::doQuickOperation()
Parameters
array$paramsOperation parameters
Returns
StatusValue
Since
1.20

Definition at line 746 of file FileBackend.php.

References doQuickOperation().

◆ quickStore()

FileBackend::quickStore ( array $params)
final

Performs a single quick store operation.

This sets $params['op'] to 'store' and passes it to doQuickOperation().

See also
FileBackend::doQuickOperation()
Parameters
array$paramsOperation parameters
Returns
StatusValue
Since
1.20

Definition at line 718 of file FileBackend.php.

References doQuickOperation().

◆ resetOutputBuffer()

FileBackend::resetOutputBuffer ( )
protected

Definition at line 1622 of file FileBackend.php.

◆ resolveFSFileObjects()

FileBackend::resolveFSFileObjects ( array $ops)
protected

Convert FSFile 'src' paths to string paths (with an 'srcRef' field set to the FSFile)

The 'srcRef' field keeps any TempFSFile objects in scope for the backend to have it around as long it needs (which may vary greatly depending on configuration)

Parameters
array$opsFile operation batch for FileBaclend::doOperations()
Returns
array File operation batch

Definition at line 1408 of file FileBackend.php.

Referenced by doOperations(), and doQuickOperations().

◆ scopedProfileSection()

◆ secure()

FileBackend::secure ( array $params)
final

Take measures to block web access to a storage directory and the container it belongs to.

FS backends might add .htaccess files whereas key/value store backends might revoke container access to the storage user representing end-users in web requests.

This is not guaranteed to actually make files or listings publically hidden. Additional server configuration may be needed to achieve the desired effect.

Parameters
array$paramsParameters include:
  • dir : storage directory
  • noAccess : try to deny file access
  • noListing : try to deny file listing
  • bypassReadOnly : allow writes in read-only mode (since 1.20)
Returns
StatusValue

Definition at line 841 of file FileBackend.php.

References $params, doSecure(), getScopedPHPBehaviorForOps(), isReadOnly(), and newStatus().

◆ setLogger()

FileBackend::setLogger ( LoggerInterface $logger)

Definition at line 195 of file FileBackend.php.

References $logger.

◆ splitStoragePath()

◆ store()

FileBackend::store ( array $params,
array $opts = [] )
final

Performs a single store operation.

This sets $params['op'] to 'store' and passes it to doOperation().

See also
FileBackend::doOperation()
Parameters
array$paramsOperation parameters
array$optsOperation options
Returns
StatusValue

Definition at line 481 of file FileBackend.php.

References doOperation().

◆ streamFile()

FileBackend::streamFile ( array $params)
abstract

Stream the file at a storage path in the backend.

If the file does not exists, an HTTP 404 error will be given. Appropriate HTTP headers (Status, Content-Type, Content-Length) will be sent if streaming began, while none will be sent otherwise. Implementations should flush the output buffer before sending data.

Parameters
array$paramsParameters include:
  • src : source storage path
  • headers : list of additional HTTP headers to send if the file exists
  • options : HTTP request header map with lower case keys (since 1.28). Supports: range : format is "bytes=(\\d*-\\d*)" if-modified-since : format is an HTTP date
  • headless : only include the body (and headers from "headers") (since 1.28)
  • latest : use the latest available data
  • allowOB : preserve any output buffers (since 1.28)
Returns
StatusValue

Reimplemented in FileBackendDBRepoWrapper, FileBackendMultiWrite, and FileBackendStore.

◆ unlockFiles()

FileBackend::unlockFiles ( array $paths,
$type )
final

Unlock the files at the given storage paths in the backend.

Parameters
array$pathsStorage paths
int$typeLockManager::LOCK_* constant
Returns
StatusValue

Definition at line 1314 of file FileBackend.php.

References $type, and wrapStatus().

◆ wrapStatus()

FileBackend::wrapStatus ( StatusValue $sv)
finalprotected
Parameters
StatusValue$sv
Returns
StatusValue Modified status or StatusValue subclass

Definition at line 1605 of file FileBackend.php.

Referenced by lockFiles(), newStatus(), and unlockFiles().

Member Data Documentation

◆ $concurrency

int FileBackend::$concurrency
protected

How many operations can be done in parallel.

Definition at line 106 of file FileBackend.php.

Referenced by FileBackendStore\doQuickOperationsInternal(), and FileBackendStore\setConcurrencyFlags().

◆ $domainId

string FileBackend::$domainId
protected

Unique domain name.

Definition at line 97 of file FileBackend.php.

Referenced by FileBackendMultiWrite\__construct(), and getDomainId().

◆ $fileJournal

FileJournal FileBackend::$fileJournal
protected

Definition at line 114 of file FileBackend.php.

Referenced by FileBackendMultiWrite\__construct(), and getJournal().

◆ $lockManager

LockManager FileBackend::$lockManager
protected

Definition at line 112 of file FileBackend.php.

◆ $logger

LoggerInterface FileBackend::$logger
protected

Definition at line 116 of file FileBackend.php.

Referenced by setLogger().

◆ $name

string FileBackend::$name
protected

◆ $obResetFunc

callable FileBackend::$obResetFunc
protected

Definition at line 121 of file FileBackend.php.

Referenced by SwiftFileBackend\doStreamFile().

◆ $parallelize

string FileBackend::$parallelize
protected

When to do operations in parallel.

Definition at line 103 of file FileBackend.php.

◆ $profiler

object string FileBackend::$profiler
protected

Class name or object With profileIn/profileOut methods.

Definition at line 118 of file FileBackend.php.

◆ $readOnly

string FileBackend::$readOnly
protected

Read-only explanation message.

Definition at line 100 of file FileBackend.php.

◆ $statusWrapper

callable FileBackend::$statusWrapper
protected

Definition at line 125 of file FileBackend.php.

◆ $streamMimeFunc

callable FileBackend::$streamMimeFunc
protected

Definition at line 123 of file FileBackend.php.

◆ $tmpDirectory

string FileBackend::$tmpDirectory
protected

Temporary file directory.

Definition at line 109 of file FileBackend.php.

◆ ATTR_HEADERS

const FileBackend::ATTR_HEADERS = 1

Bitfield flags for supported features.

Definition at line 128 of file FileBackend.php.

Referenced by FileBackendTest\doTestDescribe(), and SwiftFileBackend\getFeatures().

◆ ATTR_METADATA

const FileBackend::ATTR_METADATA = 2

Definition at line 129 of file FileBackend.php.

Referenced by SwiftFileBackend\getFeatures().

◆ ATTR_UNICODE_PATHS


The documentation for this class was generated from the following file: