MediaWiki master
|
Class for an OpenStack Swift (or Ceph RGW) based file backend. More...
Inherits Wikimedia\FileBackend\FileBackendStore.
Public Member Functions | |
__construct (array $config) | |
addShellboxInputFile (BoxedCommand $command, string $boxedName, array $params) | |
Add a file to a Shellbox command as an input file. | |
getDirectoryListInternal ( $fullCont, $dir, array $params) | |
getDirListPageInternal ( $fullCont, $dir, &$after, $limit, array $params) | |
Do not call this function outside of SwiftFileBackendFileList. | |
getFeatures () | |
Get the a bitfield of extra features supported by the backend medium. | |
getFileHttpUrl (array $params) | |
getFileListInternal ( $fullCont, $dir, array $params) | |
getFileListPageInternal ( $fullCont, $dir, &$after, $limit, array $params) | |
Do not call this function outside of SwiftFileBackendFileList. | |
isPathUsableInternal ( $storagePath) | |
Check if a file can be created or changed at a given storage path in the backend. | |
loadListingStatInternal ( $path, array $val) | |
Do not call this function outside of SwiftFileBackendFileList. | |
onError ( $status, $func, array $params, $err='', $code=0, $desc='', $body='') | |
Log an unexpected exception for this backend. | |
setLogger (LoggerInterface $logger) | |
![]() | |
clearCache (?array $paths=null) | |
Invalidate any in-process file stat and property cache. | |
concatenate (array $params) | |
Concatenate a list of storage files into a single file system file. | |
copyInternal (array $params) | |
Copy a file from one storage path to another in the backend. | |
createInternal (array $params) | |
Create a file in the backend with the given contents. | |
deleteInternal (array $params) | |
Delete a file at the storage path. | |
describeInternal (array $params) | |
Alter metadata for a file at the storage path. | |
directoryExists (array $params) | |
Check if a directory exists at a given storage path. | |
executeOpHandlesInternal (array $fileOpHandles) | |
Execute a list of FileBackendStoreOpHandle handles in parallel. | |
fileExists (array $params) | |
Check if a file exists at a storage path in the backend. | |
getDirectoryList (array $params) | |
Get an iterator to list all directories under a storage directory. | |
getFileContentsMulti (array $params) | |
Like getFileContents() except it takes an array of storage paths and returns an order preserved map of storage paths to their content. | |
getFileList (array $params) | |
Get an iterator to list all stored files under a storage directory. | |
getFileProps (array $params) | |
Get the properties of the content of the file at a storage path in the backend. | |
getFileSha1Base36 (array $params) | |
Get a SHA-1 hash of the content of the file at a storage path in the backend. | |
getFileSize (array $params) | |
Get the size (bytes) of a file at a storage path in the backend. | |
getFileStat (array $params) | |
Get quick information about a file at a storage path in the backend. | |
getFileTimestamp (array $params) | |
Get the last-modified timestamp of the file at a storage path. | |
getFileXAttributes (array $params) | |
Get metadata about a file at a storage path in the backend. | |
getLocalCopyMulti (array $params) | |
Like getLocalCopy() except it takes an array of storage paths and yields an order preserved-map of storage paths to temporary local file copies. | |
getLocalReferenceMulti (array $params) | |
Like getLocalReference() except it takes an array of storage paths and yields an order-preserved map of storage paths to temporary local file copies. | |
getOperationsInternal (array $ops) | |
Return a list of FileOp objects from a list of operations. | |
getPathsToLockForOpsInternal (array $performOps) | |
Get a list of storage paths to lock for a list of operations Returns an array with LockManager::LOCK_UW (shared locks) and LockManager::LOCK_EX (exclusive locks) keys, each corresponding to a list of storage paths to be locked. | |
getScopedLocksForOps (array $ops, StatusValue $status) | |
Get an array of scoped locks needed for a batch of file operations. | |
isSingleShardPathInternal ( $storagePath) | |
Check if a storage path maps to a single shard. | |
maxFileSizeInternal () | |
Get the maximum allowable file size given backend medium restrictions and basic performance constraints. | |
moveInternal (array $params) | |
Move a file from one storage path to another in the backend. | |
nullInternal (array $params) | |
No-op file operation that does nothing. | |
preloadCache (array $paths) | |
Preload persistent file stat cache and property cache into in-process cache. | |
preloadFileStat (array $params) | |
Preload file stat information (concurrently if possible) into in-process cache. | |
storeInternal (array $params) | |
Store a file into the backend from a file on disk. | |
streamFile (array $params) | |
Stream the content of the file at a storage path in the backend. | |
![]() | |
clean (array $params) | |
Delete a storage directory if it is empty. | |
copy (array $params, array $opts=[]) | |
Performs a single copy operation. | |
create (array $params, array $opts=[]) | |
Performs a single create operation. | |
delete (array $params, array $opts=[]) | |
Performs a single delete operation. | |
describe (array $params, array $opts=[]) | |
Performs a single describe operation. | |
doOperation (array $op, array $opts=[]) | |
Same as doOperations() except it takes a single operation. | |
doOperations (array $ops, array $opts=[]) | |
This is the main entry point into the backend for write operations. | |
doQuickOperation (array $op, array $opts=[]) | |
Same as doQuickOperations() except it takes a single operation. | |
doQuickOperations (array $ops, array $opts=[]) | |
Perform a set of independent file operations on some files. | |
getContainerStoragePath ( $container) | |
Get the storage path for the given container for this backend. | |
getDomainId () | |
Get the domain identifier used for this backend (possibly empty). | |
getFileContents (array $params) | |
Get the contents of a file at a storage path in the backend. | |
getLocalCopy (array $params) | |
Get a local copy on disk of the file at a storage path in the backend. | |
getLocalReference (array $params) | |
Returns a file system file, identical in content to the file at a storage path. | |
getName () | |
Get the unique backend name. | |
getReadOnlyReason () | |
Get an explanatory message if this backend is read-only. | |
getRootStoragePath () | |
Get the root storage path of this backend. | |
getScopedFileLocks (array $paths, $type, StatusValue $status, $timeout=0) | |
Lock the files at the given storage paths in the backend. | |
getStreamerOptions () | |
Return options for use with HTTPFileStreamer. | |
getTopDirectoryList (array $params) | |
Same as FileBackend::getDirectoryList() except only lists directories that are immediately under the given directory. | |
getTopFileList (array $params) | |
Same as FileBackend::getFileList() except only lists files that are immediately under the given directory. | |
getWikiId () | |
Alias to getDomainId() | |
hasFeatures ( $bitfield) | |
Check if the backend medium supports a field of extra features. | |
isReadOnly () | |
Check if this backend is read-only. | |
lockFiles (array $paths, $type, $timeout=0) | |
Lock the files at the given storage paths in the backend. | |
move (array $params, array $opts=[]) | |
Performs a single move operation. | |
prepare (array $params) | |
Prepare a storage directory for usage. | |
publish (array $params) | |
Remove measures to block web access to a storage directory and the container it belongs to. | |
quickCopy (array $params, array $opts=[]) | |
Performs a single quick copy operation. | |
quickCreate (array $params, array $opts=[]) | |
Performs a single quick create operation. | |
quickDelete (array $params, array $opts=[]) | |
Performs a single quick delete operation. | |
quickDescribe (array $params, array $opts=[]) | |
Performs a single quick describe operation. | |
quickMove (array $params, array $opts=[]) | |
Performs a single quick move operation. | |
quickStore (array $params, array $opts=[]) | |
Performs a single quick store operation. | |
secure (array $params) | |
Take measures to block web access to a storage directory and the container it belongs to. | |
store (array $params, array $opts=[]) | |
Performs a single store operation. | |
unlockFiles (array $paths, $type) | |
Unlock the files at the given storage paths in the backend. | |
Protected Member Functions | ||||||||||
addMissingHashMetadata (array $objHdrs, $path) | ||||||||||
Fill in any missing object metadata and save it to Swift. | ||||||||||
authTokenHeaders (array $creds) | ||||||||||
convertSwiftDate ( $ts, $format=TS_MW) | ||||||||||
Convert dates like "Tue, 03 Jan 2012 22:01:04 GMT"/"2013-05-11T07:37:27.678360Z". | ||||||||||
createContainer ( $container, array $params) | ||||||||||
Create a Swift container. | ||||||||||
deleteContainer ( $container, array $params) | ||||||||||
Delete a Swift container. | ||||||||||
directoriesAreVirtual () | ||||||||||
Is this a key/value store where directories are just virtual? Virtual directories exists in so much as files exists that are prefixed with the directory path followed by a forward slash. | ||||||||||
doCleanInternal ( $fullCont, $dir, array $params) | ||||||||||
doCopyInternal (array $params) | ||||||||||
doCreateInternal (array $params) | ||||||||||
doDeleteInternal (array $params) | ||||||||||
doDescribeInternal (array $params) | ||||||||||
doDirectoryExists ( $fullCont, $dir, array $params) | ||||||||||
doExecuteOpHandlesInternal (array $fileOpHandles) | ||||||||||
doGetFileContentsMulti (array $params) | ||||||||||
doGetFileSha1base36 (array $params) | ||||||||||
doGetFileStat (array $params) | ||||||||||
doGetFileStatMulti (array $params) | ||||||||||
Get file stat information (concurrently if possible) for several files. | ||||||||||
doGetFileXAttributes (array $params) | ||||||||||
doGetLocalCopyMulti (array $params) | ||||||||||
doMoveInternal (array $params) | ||||||||||
doPrepareInternal ( $fullCont, $dir, array $params) | ||||||||||
| ||||||||||
doPrimeContainerCache (array $containerInfo) | ||||||||||
Fill the backend-specific process cache given an array of resolved container names and their corresponding cached info. | ||||||||||
doPublishInternal ( $fullCont, $dir, array $params) | ||||||||||
doSecureInternal ( $fullCont, $dir, array $params) | ||||||||||
doStoreInternal (array $params) | ||||||||||
doStreamFile (array $params) | ||||||||||
extractMetadataHeaders (array $headers) | ||||||||||
extractMutableContentHeaders (array $headers) | ||||||||||
Filter/normalize a header map to only include mutable "content-"/"x-content-" headers. | ||||||||||
getAuthentication () | ||||||||||
Get the cached auth token. | ||||||||||
getContainerStat ( $container, $bypassCache=false) | ||||||||||
Get a Swift container stat map, possibly from process cache. | ||||||||||
getMetadataFromHeaders (array $headers) | ||||||||||
getStatFromHeaders (array $rhdrs) | ||||||||||
headersFromParams (array $params) | ||||||||||
Get headers to send to Swift when reading a file based on a FileBackend params array, e.g. | ||||||||||
resolveContainerPath ( $container, $relStoragePath) | ||||||||||
Resolve a relative storage path, checking if it's allowed by the backend. | ||||||||||
setContainerAccess ( $container, array $readUsers, array $writeUsers) | ||||||||||
Set read/write permissions for a Swift container. | ||||||||||
storageUrl (array $creds, $container=null, $object=null) | ||||||||||
![]() | ||||||||||
deleteContainerCache ( $container) | ||||||||||
Delete the cached info for a container. | ||||||||||
deleteFileCache ( $path) | ||||||||||
Delete the cached stat info for a file path. | ||||||||||
doClean (array $params) | ||||||||||
doClearCache (?array $paths=null) | ||||||||||
Clears any additional stat caches for storage paths. | ||||||||||
doConcatenate (array $params) | ||||||||||
doGetFileSha1Base36 (array $params) | ||||||||||
doGetLocalReferenceMulti (array $params) | ||||||||||
doOperationsInternal (array $ops, array $opts) | ||||||||||
doPrepare (array $params) | ||||||||||
| ||||||||||
doPublish (array $params) | ||||||||||
doQuickOperationsInternal (array $ops, array $opts) | ||||||||||
doSecure (array $params) | ||||||||||
fullContainerName ( $container) | ||||||||||
Get the full container name, including the domain ID prefix. | ||||||||||
getContainerHashLevels ( $container) | ||||||||||
Get the sharding config for a container. | ||||||||||
getContainerShard ( $container, $relPath) | ||||||||||
Get the container name shard suffix for a given path. | ||||||||||
getContainerSuffixes ( $container) | ||||||||||
Get a list of full container shard suffixes for a container. | ||||||||||
getContentType ( $storagePath, $content, $fsPath) | ||||||||||
Get the content type to use in HEAD/GET requests for a file. | ||||||||||
ingestFreshFileStats (array $stats, $latest) | ||||||||||
Ingest file stat entries that just came from querying the backend (not cache) | ||||||||||
primeContainerCache (array $items) | ||||||||||
Do a batch lookup from cache for container stats for all containers used in a list of container names or storage paths objects. | ||||||||||
primeFileCache (array $items) | ||||||||||
Do a batch lookup from cache for file stats for all paths used in a list of storage paths or FileOp objects. | ||||||||||
resolveContainerName ( $container) | ||||||||||
Resolve a container name, checking if it's allowed by the backend. | ||||||||||
resolveStoragePath ( $storagePath) | ||||||||||
Splits a storage path into an internal container name, an internal relative file name, and a container shard suffix. | ||||||||||
resolveStoragePathReal ( $storagePath) | ||||||||||
Like resolveStoragePath() except null values are returned if the container is sharded and the shard could not be determined or if the path ends with '/'. | ||||||||||
sanitizeOpHeaders (array $op) | ||||||||||
Normalize and filter HTTP headers from a file operation. | ||||||||||
setConcurrencyFlags (array $opts) | ||||||||||
Set the 'concurrency' option from a list of operation options. | ||||||||||
setContainerCache ( $container, array $val) | ||||||||||
Set the cached info for a container. | ||||||||||
setFileCache ( $path, array $val) | ||||||||||
Set the cached stat info for a file path. | ||||||||||
![]() | ||||||||||
callNowOrLater (callable $update) | ||||||||||
header ( $header) | ||||||||||
newStatus ( $message=null,... $params) | ||||||||||
Yields the result of the status wrapper callback on either: | ||||||||||
resetOutputBuffer () | ||||||||||
resolveFSFileObjects (array $ops) | ||||||||||
Convert FSFile 'src' paths to string paths (with an 'srcRef' field set to the FSFile) | ||||||||||
scopedProfileSection ( $section) | ||||||||||
wrapStatus (StatusValue $sv) | ||||||||||
Protected Attributes | |
array null | $authCreds |
int null | $authErrorTimestamp = null |
UNIX timestamp. | |
int | $authTTL |
TTL in seconds. | |
bool | $canShellboxGetTempUrl |
MapCacheLRU | $containerStatCache |
Container stat cache. | |
MultiHttpClient | $http |
bool | $isRGW = false |
Whether the server is an Ceph RGW. | |
array | $readUsers |
Additional users (account:user) with read permissions on public containers. | |
string | $rgwS3AccessKey |
S3 access key (RADOS Gateway) | |
string | $rgwS3SecretKey |
S3 authentication key (RADOS Gateway) | |
array | $secureReadUsers |
Additional users (account:user) with read permissions on private containers. | |
array | $secureWriteUsers |
Additional users (account:user) with write permissions on private containers. | |
string null | $shellboxIpRange |
BagOStuff | $srvCache |
string | $swiftAuthUrl |
Authentication base URL (without version) | |
string | $swiftKey |
Secret key for user. | |
string | $swiftStorageUrl |
Override of storage base URL. | |
string | $swiftTempUrlKey |
Shared secret value for making temp URLs. | |
string | $swiftUser |
Swift user (account:user) to authenticate as. | |
array | $writeUsers |
Additional users (account:user) with write permissions on public containers. | |
![]() | |
MapCacheLRU | $cheapCache |
Map of paths to small (RAM/disk) cache items. | |
MapCacheLRU | $expensiveCache |
Map of paths to large (RAM/disk) cache items. | |
int | $maxFileSize = 32 * 1024 * 1024 * 1024 |
Size in bytes, defaults to 32 GiB. | |
WANObjectCache | $memCache |
callable null | $mimeCallback |
Method to get the MIME type of files. | |
array< string, array > | $shardViaHashLevels = [] |
Map of container names to sharding config. | |
BagOStuff | $srvCache |
const | CACHE_CHEAP_SIZE = 500 |
const | CACHE_EXPENSIVE_SIZE = 5 |
const | CACHE_TTL = 10 |
![]() | |
int | $concurrency |
How many operations can be done in parallel. | |
string | $domainId |
Unique domain name. | |
LockManager | $lockManager |
LoggerInterface | $logger |
string | $name |
Unique backend name. | |
string | $parallelize |
When to do operations in parallel. | |
callable null | $profiler |
string | $readOnly |
Read-only explanation message. | |
callable null | $statusWrapper |
array | $streamerOptions |
Option map for use with HTTPFileStreamer. | |
TempFSFileFactory | $tmpFileFactory |
Additional Inherited Members | |
![]() | |
static | extensionFromPath ( $path, $case='lowercase') |
Get the final extension from a storage or FS path. | |
static | isPathTraversalFree ( $path) |
Check if a relative path has no directory traversals. | |
static | isStoragePath ( $path) |
Check if a given path is a "mwstore://" path. | |
static | makeContentDisposition ( $type, $filename='') |
Build a Content-Disposition header value per RFC 6266. | |
static | normalizeStoragePath ( $storagePath) |
Normalize a storage path by cleaning up directory separators. | |
static | parentStoragePath ( $storagePath) |
Get the parent storage directory of a storage path. | |
static | resetOutputBufferTheDefaultWay () |
Default behavior of resetOutputBuffer(). | |
static | splitStoragePath ( $storagePath) |
Split a storage path into a backend name, a container name, and a relative file path. | |
![]() | |
const | ATTR_HEADERS = 1 |
Bitfield flags for supported features. | |
const | ATTR_METADATA = 2 |
const | ATTR_UNICODE_PATHS = 4 |
![]() | |
static | isValidContainerName ( $container) |
Check if a full container name is valid. | |
static | isValidShortContainerName ( $container) |
Check if a short container name is valid. | |
static | normalizeXAttributes (array $xattr) |
Normalize file headers/metadata to the FileBackend::getFileXAttributes() format. | |
![]() | |
static | normalizeContainerPath ( $path) |
Validate and normalize a relative storage path. | |
Class for an OpenStack Swift (or Ceph RGW) based file backend.
StatusValue messages should avoid mentioning the Swift account name. Likewise, error suppression should be used to avoid path disclosure.
Definition at line 54 of file SwiftFileBackend.php.
Wikimedia\FileBackend\SwiftFileBackend::__construct | ( | array | $config | ) |
array | $config | Params include:
|
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 146 of file SwiftFileBackend.php.
|
protected |
Fill in any missing object metadata and save it to Swift.
array | $objHdrs | Object response headers |
string | $path | Storage path to object |
Definition at line 817 of file SwiftFileBackend.php.
References $path, Wikimedia\FileBackend\FileBackendStore\deleteFileCache(), Wikimedia\FileBackend\SwiftFileBackend\extractMetadataHeaders(), Wikimedia\FileBackend\SwiftFileBackend\extractMutableContentHeaders(), Wikimedia\FileBackend\FileBackend\getLocalCopy(), Wikimedia\FileBackend\FileBackend\getScopedFileLocks(), Wikimedia\FileBackend\FileBackend\newStatus(), Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal(), and Wikimedia\FileBackend\FileBackend\scopedProfileSection().
Referenced by Wikimedia\FileBackend\SwiftFileBackend\doGetFileStatMulti().
Wikimedia\FileBackend\SwiftFileBackend::addShellboxInputFile | ( | BoxedCommand | $command, |
string | $boxedName, | ||
array | $params ) |
Add a file to a Shellbox command as an input file.
BoxedCommand | $command | |
string | $boxedName | |
array | $params | Parameters include:
|
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 1307 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\SwiftFileBackend\$shellboxIpRange, $url, Wikimedia\FileBackend\SwiftFileBackend\getFileHttpUrl(), and Wikimedia\FileBackend\FileBackend\newStatus().
|
protected |
array | $creds | From getAuthentication() |
Definition at line 1884 of file SwiftFileBackend.php.
|
protected |
Convert dates like "Tue, 03 Jan 2012 22:01:04 GMT"/"2013-05-11T07:37:27.678360Z".
Dates might also come in like "2013-05-11T07:37:27.678360" from Swift listings, missing the timezone suffix (though Ceph RGW does not appear to have this bug).
string | $ts | |
int | $format | Output format (TS_* constant) |
FileBackendError |
Definition at line 798 of file SwiftFileBackend.php.
Referenced by Wikimedia\FileBackend\SwiftFileBackend\getStatFromHeaders().
|
protected |
Create a Swift container.
string | $container | Container name |
array | $params |
Definition at line 1558 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\SwiftFileBackend\$readUsers, Wikimedia\FileBackend\SwiftFileBackend\$writeUsers, Wikimedia\FileBackend\FileBackend\newStatus(), and Wikimedia\FileBackend\SwiftFileBackend\onError().
Referenced by Wikimedia\FileBackend\SwiftFileBackend\doPrepareInternal().
|
protected |
Delete a Swift container.
string | $container | Container name |
array | $params |
Definition at line 1602 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackend\newStatus(), and Wikimedia\FileBackend\SwiftFileBackend\onError().
Referenced by Wikimedia\FileBackend\SwiftFileBackend\doCleanInternal().
|
protected |
Is this a key/value store where directories are just virtual? Virtual directories exists in so much as files exists that are prefixed with the directory path followed by a forward slash.
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 1396 of file SwiftFileBackend.php.
|
protected |
string | $container | |
string | $dir | |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 756 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\SwiftFileBackend\deleteContainer(), Wikimedia\FileBackend\SwiftFileBackend\getContainerStat(), and Wikimedia\FileBackend\FileBackend\newStatus().
|
protected |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 450 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackendStore\executeOpHandlesInternal(), Wikimedia\FileBackend\SwiftFileBackend\extractMutableContentHeaders(), Wikimedia\FileBackend\FileBackend\newStatus(), Wikimedia\FileBackend\SwiftFileBackend\onError(), and Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal().
|
protected |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 304 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackendStore\executeOpHandlesInternal(), Wikimedia\FileBackend\SwiftFileBackend\extractMutableContentHeaders(), Wikimedia\FileBackend\FileBackendStore\getContentType(), Wikimedia\FileBackend\FileBackend\newStatus(), Wikimedia\FileBackend\SwiftFileBackend\onError(), and Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal().
|
protected |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 575 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackendStore\executeOpHandlesInternal(), Wikimedia\FileBackend\FileBackend\newStatus(), Wikimedia\FileBackend\SwiftFileBackend\onError(), and Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal().
|
protected |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 618 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackend\$name, Wikimedia\FileBackend\SwiftFileBackend\doGetFileStat(), Wikimedia\FileBackend\FileBackendStore\executeOpHandlesInternal(), Wikimedia\FileBackend\SwiftFileBackend\extractMutableContentHeaders(), Wikimedia\FileBackend\FileBackendStore\getFileStat(), Wikimedia\FileBackend\FileBackend\newStatus(), Wikimedia\FileBackend\SwiftFileBackend\onError(), and Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal().
|
protected |
string | $container | Resolved container name |
string | $dir | Resolved path relative to container |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 925 of file SwiftFileBackend.php.
|
protected |
FileBackendStoreOpHandle[] | $fileOpHandles |
FileBackendError |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 1417 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackend\newStatus().
|
protected |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 867 of file SwiftFileBackend.php.
References $path, Wikimedia\FileBackend\SwiftFileBackend\headersFromParams(), Wikimedia\FileBackend\SwiftFileBackend\onError(), and Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal().
|
protected |
Definition at line 1155 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackendStore\getFileStat().
|
protected |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 780 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\SwiftFileBackend\doGetFileStatMulti().
Referenced by Wikimedia\FileBackend\SwiftFileBackend\doDescribeInternal().
|
protected |
Get file stat information (concurrently if possible) for several files.
array | $params | Parameters include:
|
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 1684 of file SwiftFileBackend.php.
References $path, Wikimedia\FileBackend\SwiftFileBackend\addMissingHashMetadata(), Wikimedia\FileBackend\SwiftFileBackend\getContainerStat(), Wikimedia\FileBackend\SwiftFileBackend\getStatFromHeaders(), Wikimedia\FileBackend\SwiftFileBackend\headersFromParams(), Wikimedia\FileBackend\SwiftFileBackend\onError(), and Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal().
Referenced by Wikimedia\FileBackend\SwiftFileBackend\doGetFileStat().
|
protected |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 1140 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackendStore\clearCache(), and Wikimedia\FileBackend\FileBackendStore\getFileStat().
|
protected |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 1235 of file SwiftFileBackend.php.
References $path, Wikimedia\FileBackend\FileBackend\extensionFromPath(), Wikimedia\FileBackend\SwiftFileBackend\getStatFromHeaders(), Wikimedia\FileBackend\SwiftFileBackend\headersFromParams(), Wikimedia\FileBackend\SwiftFileBackend\onError(), and Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal().
|
protected |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 506 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackendStore\executeOpHandlesInternal(), Wikimedia\FileBackend\SwiftFileBackend\extractMutableContentHeaders(), Wikimedia\FileBackend\FileBackend\newStatus(), Wikimedia\FileBackend\SwiftFileBackend\onError(), and Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal().
|
protected |
string | $container | |
string | $dir | |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 681 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\SwiftFileBackend\createContainer(), Wikimedia\FileBackend\SwiftFileBackend\getContainerStat(), and Wikimedia\FileBackend\FileBackend\newStatus().
|
protected |
Fill the backend-specific process cache given an array of resolved container names and their corresponding cached info.
Only containers that actually exist should appear in the map.
array | $containerInfo | Map of resolved container names to cached info |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 1678 of file SwiftFileBackend.php.
|
protected |
string | $container | |
string | $dir | |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 726 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\SwiftFileBackend\$readUsers, Wikimedia\FileBackend\SwiftFileBackend\$writeUsers, Wikimedia\FileBackend\SwiftFileBackend\getContainerStat(), Wikimedia\FileBackend\FileBackend\newStatus(), and Wikimedia\FileBackend\SwiftFileBackend\setContainerAccess().
|
protected |
string | $container | |
string | $dir | |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 700 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\SwiftFileBackend\$readUsers, Wikimedia\FileBackend\SwiftFileBackend\$writeUsers, Wikimedia\FileBackend\SwiftFileBackend\getContainerStat(), Wikimedia\FileBackend\FileBackend\newStatus(), and Wikimedia\FileBackend\SwiftFileBackend\setContainerAccess().
|
protected |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 360 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackendStore\executeOpHandlesInternal(), Wikimedia\FileBackend\SwiftFileBackend\extractMutableContentHeaders(), Wikimedia\FileBackend\FileBackendStore\getContentType(), Wikimedia\FileBackend\FileBackend\newStatus(), Wikimedia\FileBackend\SwiftFileBackend\onError(), and Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal().
|
protected |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 1168 of file SwiftFileBackend.php.
References $header, Wikimedia\FileBackend\FileBackendStore\clearCache(), Wikimedia\FileBackend\FileBackendStore\deleteFileCache(), Wikimedia\FileBackend\FileBackendStore\fileExists(), Wikimedia\FileBackend\SwiftFileBackend\getContainerStat(), Wikimedia\FileBackend\FileBackend\header(), Wikimedia\FileBackend\SwiftFileBackend\headersFromParams(), Wikimedia\FileBackend\FileBackend\newStatus(), Wikimedia\FileBackend\SwiftFileBackend\onError(), Wikimedia\FileBackend\FileBackend\resetOutputBuffer(), Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal(), Wikimedia\FileBackend\HTTPFileStreamer\send404Message(), and Wikimedia\FileBackend\HTTPFileStreamer\STREAM_HEADLESS.
|
protected |
string[] | $headers | Map of (header => value) for a swift object |
Definition at line 276 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackend\$name.
Referenced by Wikimedia\FileBackend\SwiftFileBackend\addMissingHashMetadata(), and Wikimedia\FileBackend\SwiftFileBackend\getMetadataFromHeaders().
|
protected |
Filter/normalize a header map to only include mutable "content-"/"x-content-" headers.
Mutable headers can be changed via HTTP POST even if the file content is the same
string[] | $headers | Map of (header => value) for a swift object |
Definition at line 236 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackend\$name.
Referenced by Wikimedia\FileBackend\SwiftFileBackend\addMissingHashMetadata(), Wikimedia\FileBackend\SwiftFileBackend\doCopyInternal(), Wikimedia\FileBackend\SwiftFileBackend\doCreateInternal(), Wikimedia\FileBackend\SwiftFileBackend\doDescribeInternal(), Wikimedia\FileBackend\SwiftFileBackend\doMoveInternal(), Wikimedia\FileBackend\SwiftFileBackend\doStoreInternal(), and Wikimedia\FileBackend\SwiftFileBackend\getStatFromHeaders().
|
protected |
Get the cached auth token.
Definition at line 1770 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\SwiftFileBackend\$authCreds, and Wikimedia\FileBackend\SwiftFileBackend\$authErrorTimestamp.
Referenced by Wikimedia\FileBackend\SwiftFileBackend\getFileHttpUrl().
|
protected |
Get a Swift container stat map, possibly from process cache.
Use $reCache if the file count or byte count is needed.
string | $container | Container name |
bool | $bypassCache | Bypass all caches and load from Swift |
Definition at line 1512 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\SwiftFileBackend\onError(), Wikimedia\FileBackend\FileBackendStore\primeContainerCache(), Wikimedia\FileBackend\FileBackend\scopedProfileSection(), and Wikimedia\FileBackend\FileBackendStore\setContainerCache().
Referenced by Wikimedia\FileBackend\SwiftFileBackend\doCleanInternal(), Wikimedia\FileBackend\SwiftFileBackend\doGetFileStatMulti(), Wikimedia\FileBackend\SwiftFileBackend\doPrepareInternal(), Wikimedia\FileBackend\SwiftFileBackend\doPublishInternal(), Wikimedia\FileBackend\SwiftFileBackend\doSecureInternal(), Wikimedia\FileBackend\SwiftFileBackend\doStreamFile(), and Wikimedia\FileBackend\SwiftFileBackend\isPathUsableInternal().
Wikimedia\FileBackend\SwiftFileBackend::getDirectoryListInternal | ( | $fullCont, | |
$dir, | |||
array | $params ) |
string | $fullCont | |
string | $dir | |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 942 of file SwiftFileBackend.php.
Wikimedia\FileBackend\SwiftFileBackend::getDirListPageInternal | ( | $fullCont, | |
$dir, | |||
& | $after, | ||
$limit, | |||
array | $params ) |
Do not call this function outside of SwiftFileBackendFileList.
string | $fullCont | Resolved container name |
string | $dir | Resolved storage directory with no trailing slash |
string | null | &$after | Resolved container relative path used for continuation paging |
int | $limit | Max number of items to list |
array | $params | Parameters for getDirectoryList() |
FileBackendError |
Definition at line 968 of file SwiftFileBackend.php.
References $path, and Wikimedia\FileBackend\FileBackend\scopedProfileSection().
Wikimedia\FileBackend\SwiftFileBackend::getFeatures | ( | ) |
Get the a bitfield of extra features supported by the backend medium.
Reimplemented from Wikimedia\FileBackend\FileBackend.
Definition at line 200 of file SwiftFileBackend.php.
Wikimedia\FileBackend\SwiftFileBackend::getFileHttpUrl | ( | array | $params | ) |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 1324 of file SwiftFileBackend.php.
References $url, Wikimedia\FileBackend\SwiftFileBackend\getAuthentication(), Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal(), and Wikimedia\FileBackend\SwiftFileBackend\storageUrl().
Referenced by Wikimedia\FileBackend\SwiftFileBackend\addShellboxInputFile().
Wikimedia\FileBackend\SwiftFileBackend::getFileListInternal | ( | $fullCont, | |
$dir, | |||
array | $params ) |
string | $fullCont | |
string | $dir | |
array | $params |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 953 of file SwiftFileBackend.php.
Wikimedia\FileBackend\SwiftFileBackend::getFileListPageInternal | ( | $fullCont, | |
$dir, | |||
& | $after, | ||
$limit, | |||
array | $params ) |
Do not call this function outside of SwiftFileBackendFileList.
string | $fullCont | Resolved container name |
string | $dir | Resolved storage directory with no trailing slash |
string | null | &$after | Resolved container relative path of file to list items after |
int | $limit | Max number of items to list |
array | $params | Parameters for getFileList() |
FileBackendError |
Definition at line 1051 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackend\scopedProfileSection().
|
protected |
string[] | $headers | Map of (header => value) for a swift object |
Definition at line 293 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackend\$name, and Wikimedia\FileBackend\SwiftFileBackend\extractMetadataHeaders().
Referenced by Wikimedia\FileBackend\SwiftFileBackend\getStatFromHeaders().
|
protected |
array | $rhdrs |
Definition at line 1747 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\SwiftFileBackend\convertSwiftDate(), Wikimedia\FileBackend\SwiftFileBackend\extractMutableContentHeaders(), and Wikimedia\FileBackend\SwiftFileBackend\getMetadataFromHeaders().
Referenced by Wikimedia\FileBackend\SwiftFileBackend\doGetFileStatMulti(), and Wikimedia\FileBackend\SwiftFileBackend\doGetLocalCopyMulti().
|
protected |
Get headers to send to Swift when reading a file based on a FileBackend params array, e.g.
that of getLocalCopy(). $params is currently only checked for a 'latest' flag.
array | $params |
Definition at line 1408 of file SwiftFileBackend.php.
Referenced by Wikimedia\FileBackend\SwiftFileBackend\doGetFileContentsMulti(), Wikimedia\FileBackend\SwiftFileBackend\doGetFileStatMulti(), Wikimedia\FileBackend\SwiftFileBackend\doGetLocalCopyMulti(), and Wikimedia\FileBackend\SwiftFileBackend\doStreamFile().
Wikimedia\FileBackend\SwiftFileBackend::isPathUsableInternal | ( | $storagePath | ) |
Check if a file can be created or changed at a given storage path in the backend.
FS backends should check that the parent directory exists, files can be written under it, and that any file already there is both readable and writable. Backends using key/value stores should check if the container exists.
string | $storagePath |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 218 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\SwiftFileBackend\getContainerStat(), and Wikimedia\FileBackend\FileBackendStore\resolveStoragePathReal().
Wikimedia\FileBackend\SwiftFileBackend::loadListingStatInternal | ( | $path, | |
array | $val ) |
Do not call this function outside of SwiftFileBackendFileList.
string | $path | Storage path |
array | $val | Stat value |
Definition at line 1136 of file SwiftFileBackend.php.
References $path.
Wikimedia\FileBackend\SwiftFileBackend::onError | ( | $status, | |
$func, | |||
array | $params, | ||
$err = '', | |||
$code = 0, | |||
$desc = '', | |||
$body = '' ) |
Log an unexpected exception for this backend.
This also sets the StatusValue object to have a fatal error.
StatusValue | null | $status | To add fatal errors to |
string | $func | |
array | $params | |
string | $err | Error string |
int | $code | HTTP status |
string | $desc | HTTP StatusValue description |
string | $body | HTTP body |
Definition at line 2011 of file SwiftFileBackend.php.
Referenced by Wikimedia\FileBackend\SwiftFileBackend\createContainer(), Wikimedia\FileBackend\SwiftFileBackend\deleteContainer(), Wikimedia\FileBackend\SwiftFileBackend\doCopyInternal(), Wikimedia\FileBackend\SwiftFileBackend\doCreateInternal(), Wikimedia\FileBackend\SwiftFileBackend\doDeleteInternal(), Wikimedia\FileBackend\SwiftFileBackend\doDescribeInternal(), Wikimedia\FileBackend\SwiftFileBackend\doGetFileContentsMulti(), Wikimedia\FileBackend\SwiftFileBackend\doGetFileStatMulti(), Wikimedia\FileBackend\SwiftFileBackend\doGetLocalCopyMulti(), Wikimedia\FileBackend\SwiftFileBackend\doMoveInternal(), Wikimedia\FileBackend\SwiftFileBackend\doStoreInternal(), Wikimedia\FileBackend\SwiftFileBackend\doStreamFile(), and Wikimedia\FileBackend\SwiftFileBackend\getContainerStat().
|
protected |
Resolve a relative storage path, checking if it's allowed by the backend.
This is intended for internal use, such as encoding illegal chars or perhaps getting absolute paths (e.g. FS based backends). Note that the relative path may be the empty string (e.g. the path is simply to the container).
string | $container | Container name |
string | $relStoragePath | Storage path relative to the container |
Reimplemented from Wikimedia\FileBackend\FileBackendStore.
Definition at line 208 of file SwiftFileBackend.php.
|
protected |
Set read/write permissions for a Swift container.
In general, we don't allow listings to end-users. It's not useful, isn't well-defined (lists are truncated to 10000 item with no way to page), and is just a performance risk.
string | $container | Resolved Swift container |
array | $readUsers | List of the possible criteria for a request to have access to read a container. Each item is one of the following formats:
|
array | $writeUsers | A list of the possible criteria for a request to have access to write to a container. Each item is of the following format:
|
Definition at line 1483 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\SwiftFileBackend\$readUsers, Wikimedia\FileBackend\SwiftFileBackend\$writeUsers, and Wikimedia\FileBackend\FileBackend\newStatus().
Referenced by Wikimedia\FileBackend\SwiftFileBackend\doPublishInternal(), and Wikimedia\FileBackend\SwiftFileBackend\doSecureInternal().
Wikimedia\FileBackend\SwiftFileBackend::setLogger | ( | LoggerInterface | $logger | ) |
Reimplemented from Wikimedia\FileBackend\FileBackend.
Definition at line 195 of file SwiftFileBackend.php.
References Wikimedia\FileBackend\FileBackend\$logger.
|
protected |
array | $creds | From getAuthentication() |
string | null | $container | |
string | null | $object |
Definition at line 1868 of file SwiftFileBackend.php.
Referenced by Wikimedia\FileBackend\SwiftFileBackend\getFileHttpUrl().
|
protected |
Definition at line 96 of file SwiftFileBackend.php.
Referenced by Wikimedia\FileBackend\SwiftFileBackend\getAuthentication().
|
protected |
UNIX timestamp.
Definition at line 98 of file SwiftFileBackend.php.
Referenced by Wikimedia\FileBackend\SwiftFileBackend\getAuthentication().
|
protected |
TTL in seconds.
Definition at line 61 of file SwiftFileBackend.php.
|
protected |
Definition at line 73 of file SwiftFileBackend.php.
|
protected |
Container stat cache.
Definition at line 93 of file SwiftFileBackend.php.
|
protected |
Definition at line 59 of file SwiftFileBackend.php.
|
protected |
Whether the server is an Ceph RGW.
Definition at line 101 of file SwiftFileBackend.php.
|
protected |
Additional users (account:user) with read permissions on public containers.
Definition at line 81 of file SwiftFileBackend.php.
Referenced by Wikimedia\FileBackend\SwiftFileBackend\createContainer(), Wikimedia\FileBackend\SwiftFileBackend\doPublishInternal(), Wikimedia\FileBackend\SwiftFileBackend\doSecureInternal(), and Wikimedia\FileBackend\SwiftFileBackend\setContainerAccess().
|
protected |
S3 access key (RADOS Gateway)
Definition at line 77 of file SwiftFileBackend.php.
|
protected |
S3 authentication key (RADOS Gateway)
Definition at line 79 of file SwiftFileBackend.php.
|
protected |
Additional users (account:user) with read permissions on private containers.
Definition at line 85 of file SwiftFileBackend.php.
|
protected |
Additional users (account:user) with write permissions on private containers.
Definition at line 87 of file SwiftFileBackend.php.
|
protected |
Definition at line 75 of file SwiftFileBackend.php.
Referenced by Wikimedia\FileBackend\SwiftFileBackend\addShellboxInputFile().
|
protected |
Definition at line 90 of file SwiftFileBackend.php.
|
protected |
Authentication base URL (without version)
Definition at line 63 of file SwiftFileBackend.php.
|
protected |
Secret key for user.
Definition at line 69 of file SwiftFileBackend.php.
|
protected |
Override of storage base URL.
Definition at line 65 of file SwiftFileBackend.php.
|
protected |
Shared secret value for making temp URLs.
Definition at line 71 of file SwiftFileBackend.php.
|
protected |
Swift user (account:user) to authenticate as.
Definition at line 67 of file SwiftFileBackend.php.
|
protected |
Additional users (account:user) with write permissions on public containers.
Definition at line 83 of file SwiftFileBackend.php.
Referenced by Wikimedia\FileBackend\SwiftFileBackend\createContainer(), Wikimedia\FileBackend\SwiftFileBackend\doPublishInternal(), Wikimedia\FileBackend\SwiftFileBackend\doSecureInternal(), and Wikimedia\FileBackend\SwiftFileBackend\setContainerAccess().