MediaWiki  master
FindBadBlobs Class Reference

Maintenance script for finding and marking bad content blobs. More...

Inheritance diagram for FindBadBlobs:
Collaboration diagram for FindBadBlobs:

Public Member Functions

 __construct ()
 Default constructor. More...
 
 execute ()
 Do the actual work.All child classes will need to implement this
Returns
bool|null|void True for success, false for failure. Not returning a value, or returning null, is also interpreted as success. Returning false for failure will cause doMaintenance.php to exit the process with a non-zero exit status.
More...
 
 initializeServices (?RevisionStore $revisionStore=null, ?BlobStore $blobStore=null, ?LoadBalancer $loadBalancer=null, ?LBFactory $lbFactory=null)
 
- Public Member Functions inherited from Maintenance
 checkRequiredExtensions ()
 Verify that the required extensions are installed. More...
 
 cleanupChanneled ()
 Clean up channeled output. More...
 
 clearParamsAndArgs ()
 Clear all params and arguments. More...
 
 finalSetup ()
 Handle some last-minute setup here. More...
 
 getConfig ()
 
 getDbType ()
 Does the script need different DB access? By default, we give Maintenance scripts normal rights to the DB. More...
 
 getName ()
 Get the script's name. More...
 
 globals ()
 Potentially debug globals. More...
 
 isQuiet ()
 
 loadParamsAndArgs ( $self=null, $opts=null, $args=null)
 Process command line arguments $mOptions becomes an array with keys set to the option names $mArgs becomes a zero-based array containing the non-option arguments. More...
 
 loadSettings ()
 Generic setup for most installs. More...
 
 loadWithArgv ( $argv)
 Load params and arguments from a given array of command-line arguments. More...
 
 memoryLimit ()
 Normally we disable the memory_limit when running admin scripts. More...
 
 outputChanneled ( $msg, $channel=null)
 Message outputter with channeled message support. More...
 
 purgeRedundantText ( $delete=true)
 Support function for cleaning up redundant text records. More...
 
 runChild ( $maintClass, $classFile=null)
 Run a child maintenance script. More...
 
 setAgentAndTriggers ()
 Set triggers like when to try to run deferred updates. More...
 
 setConfig (Config $config)
 
 setDB (IMaintainableDatabase $db)
 Sets database object to be returned by getDB(). More...
 
 setup ()
 Do some sanity checking and basic setup. More...
 
 updateSearchIndex ( $maxLockTime, $callback, $dbw, $results)
 Perform a search index update with locking. More...
 
 updateSearchIndexForPage (int $pageId)
 Update the searchindex table for a given pageid. More...
 
 validateParamsAndArgs ()
 Run some validation checks on the params, etc Stable for overriding. More...
 

Private Member Functions

 checkRevision (RevisionRecord $rev)
 
 checkSlot (RevisionRecord $rev, SlotRecord $slot)
 
 getNextRevision (int $revId, string $comp, string $dir)
 Returns the revision ID next to $revId, according to $comp and $dir. More...
 
 getRevisionIds ()
 
 getStartTimestamp ()
 
 handleStatus (StatusValue $status)
 
 loadArchiveByRevisionId (int $afterId, int $uptoId, $batchSize)
 
 loadRevisionsById (array $ids)
 
 loadRevisionsByTimestamp (int $afterId, string $fromTimestamp, $batchSize)
 
 markBlob (RevisionRecord $rev, SlotRecord $slot, string $error=null)
 
 scanRevisionsById (array $ids)
 
 scanRevisionsByTimestamp ( $fromTimestamp, $total)
 
 waitForReplication ()
 

Private Attributes

BlobStore null $blobStore
 
LBFactory $lbFactory
 
LoadBalancer null $loadBalancer
 
RevisionStore null $revisionStore
 

Additional Inherited Members

- Static Public Member Functions inherited from Maintenance
static getTermSize ()
 Get the terminal size as a two-element array where the first element is the width (number of columns) and the second element is the height (number of rows). More...
 
static posix_isatty ( $fd)
 Wrapper for posix_isatty() We default as considering stdin a tty (for nice readline methods) but treating stout as not a tty to avoid color codes. More...
 
static readconsole ( $prompt='> ')
 Prompt the console for input. More...
 
static requireTestsAutoloader ()
 Call this to set up the autoloader to allow classes to be used from the tests directory. More...
 
static setLBFactoryTriggers (LBFactory $LBFactory, Config $config)
 
static shouldExecute ()
 Should we execute the maintenance script, or just allow it to be included as a standalone class? It checks that the call stack only includes this function and "requires" (meaning was called from the file scope) More...
 
- Public Attributes inherited from Maintenance
resource $fileHandle
 Used when creating separate schema files. More...
 
 $mDbPass
 
array $orderedOptions = []
 Used to read the options in the order they were passed. More...
 
const DB_ADMIN = 2
 
const DB_NONE = 0
 Constants for DB access type. More...
 
const DB_STD = 1
 
const STDIN_ALL = 'all'
 
- Protected Member Functions inherited from Maintenance
 activateProfiler ()
 Activate the profiler (assuming $wgProfiler is set) More...
 
 addArg ( $arg, $description, $required=true)
 Add some args that are needed. More...
 
 addDefaultParams ()
 Add the default parameters to the scripts. More...
 
 addDescription ( $text)
 Set the description text. More...
 
 addOption ( $name, $description, $required=false, $withArg=false, $shortName=false, $multiOccurrence=false)
 Add a parameter to the script. More...
 
 adjustMemoryLimit ()
 Adjusts PHP's memory limit to better suit our needs, if needed. More...
 
 afterFinalSetup ()
 Execute a callback function at the end of initialisation @stable for overriding. More...
 
 beginTransaction (IDatabase $dbw, $fname)
 Begin a transcation on a DB. More...
 
 commitTransaction (IDatabase $dbw, $fname)
 Commit the transcation on a DB handle and wait for replica DBs to catch up. More...
 
 countDown ( $seconds)
 Count down from $seconds to zero on the terminal, with a one-second pause between showing each number. More...
 
 deleteOption ( $name)
 Remove an option. More...
 
 error ( $err, $die=0)
 Throw an error to the user. More...
 
 fatalError ( $msg, $exitCode=1)
 Output a message and terminate the current script. More...
 
 getArg ( $argId=0, $default=null)
 Get an argument. More...
 
 getBatchSize ()
 Returns batch size. More...
 
 getDB ( $db, $groups=[], $dbDomain=false)
 Returns a database to be used by current maintenance script. More...
 
 getDir ()
 Get the maintenance directory. More...
 
 getHookContainer ()
 Get a HookContainer, for running extension hooks or for hook metadata. More...
 
 getHookRunner ()
 Get a HookRunner for running core hooks. More...
 
 getOption ( $name, $default=null)
 Get an option, or return the default. More...
 
 getStdin ( $len=null)
 Return input from stdin. More...
 
 hasArg ( $argId=0)
 Does a given argument exist? More...
 
 hasOption ( $name)
 Checks to see if a particular option exists. More...
 
 loadSpecialVars ()
 Handle the special variables that are global to all scripts @stable for overriding. More...
 
 maybeHelp ( $force=false)
 Maybe show the help. More...
 
 output ( $out, $channel=null)
 Throw some output to the user. More...
 
 parseIntList ( $text)
 Utility function to parse a string (perhaps from a command line option) into a list of integers (perhaps some kind of numeric IDs). More...
 
 requireExtension ( $name)
 Indicate that the specified extension must be loaded before the script can run. More...
 
 rollbackTransaction (IDatabase $dbw, $fname)
 Rollback the transcation on a DB handle. More...
 
 setAllowUnregisteredOptions ( $allow)
 Sets whether to allow unregistered options, which are options passed to a script that do not match an expected parameter. More...
 
 setBatchSize ( $s=0)
 Set the batch size. More...
 
 showHelp ()
 Definitely show the help. More...
 
 supportsOption ( $name)
 Checks to see if a particular option in supported. More...
 
- Protected Attributes inherited from Maintenance
 $mAllowUnregisteredOptions = false
 
 $mArgList = []
 
 $mArgs = []
 
int $mBatchSize = null
 Batch size. More...
 
 $mDbUser
 
 $mDescription = ''
 
 $mInputLoaded = false
 
 $mOptions = []
 
array[] $mParams = []
 Array of desired/allowed params. More...
 
 $mQuiet = false
 
 $mSelf
 
 $mShortParamsMap = []
 

Detailed Description

Maintenance script for finding and marking bad content blobs.

Definition at line 39 of file findBadBlobs.php.

Constructor & Destructor Documentation

◆ __construct()

FindBadBlobs::__construct ( )

Default constructor.

Children should call this first if implementing their own constructors

Stable for calling

Reimplemented from Maintenance.

Definition at line 61 of file findBadBlobs.php.

References Maintenance\addDescription(), Maintenance\addOption(), and Maintenance\setBatchSize().

Member Function Documentation

◆ checkRevision()

FindBadBlobs::checkRevision ( RevisionRecord  $rev)
private
Parameters
RevisionRecord$rev
Returns
int

Definition at line 430 of file findBadBlobs.php.

References checkSlot(), Revision\RevisionRecord\getSlots(), Maintenance\hasOption(), and Maintenance\output().

Referenced by scanRevisionsById(), and scanRevisionsByTimestamp().

◆ checkSlot()

FindBadBlobs::checkSlot ( RevisionRecord  $rev,
SlotRecord  $slot 
)
private
Parameters
RevisionRecord$rev
SlotRecord$slot
Returns
int

Definition at line 449 of file findBadBlobs.php.

References $type, Revision\SlotRecord\getAddress(), Maintenance\hasOption(), markBlob(), and Maintenance\output().

Referenced by checkRevision().

◆ execute()

FindBadBlobs::execute ( )

Do the actual work.All child classes will need to implement this

Returns
bool|null|void True for success, false for failure. Not returning a value, or returning null, is also interpreted as success. Returning false for failure will cause doMaintenance.php to exit the process with a non-zero exit status.

Reimplemented from Maintenance.

Definition at line 132 of file findBadBlobs.php.

References Maintenance\fatalError(), Maintenance\getOption(), getRevisionIds(), getStartTimestamp(), Maintenance\hasOption(), initializeServices(), Maintenance\output(), scanRevisionsById(), and scanRevisionsByTimestamp().

◆ getNextRevision()

FindBadBlobs::getNextRevision ( int  $revId,
string  $comp,
string  $dir 
)
private

Returns the revision ID next to $revId, according to $comp and $dir.

Parameters
int$revId
string$compthe comparator, either '<' or '>', to go with $dir
string$dirthe sort direction to go with $comp, either 'ARC' or 'DESC'
Returns
int

Definition at line 326 of file findBadBlobs.php.

References DB_REPLICA.

Referenced by scanRevisionsByTimestamp().

◆ getRevisionIds()

FindBadBlobs::getRevisionIds ( )
private
Returns
int[]

Definition at line 115 of file findBadBlobs.php.

References Maintenance\getOption(), and Maintenance\parseIntList().

Referenced by execute().

◆ getStartTimestamp()

FindBadBlobs::getStartTimestamp ( )
private
Returns
string

Definition at line 97 of file findBadBlobs.php.

References Maintenance\fatalError(), Maintenance\getOption(), and wfTimestamp().

Referenced by execute().

◆ handleStatus()

◆ initializeServices()

FindBadBlobs::initializeServices ( ?RevisionStore  $revisionStore = null,
?BlobStore  $blobStore = null,
?LoadBalancer  $loadBalancer = null,
?LBFactory  $lbFactory = null 
)

Definition at line 80 of file findBadBlobs.php.

References $blobStore, $lbFactory, $loadBalancer, and $revisionStore.

Referenced by execute().

◆ loadArchiveByRevisionId()

FindBadBlobs::loadArchiveByRevisionId ( int  $afterId,
int  $uptoId,
  $batchSize 
)
private
Parameters
int$afterId
int$uptoId
int$batchSize
Returns
RevisionArchiveRecord[]

Definition at line 294 of file findBadBlobs.php.

References DB_REPLICA, and handleStatus().

Referenced by scanRevisionsByTimestamp().

◆ loadRevisionsById()

FindBadBlobs::loadRevisionsById ( array  $ids)
private
Parameters
int[]$ids
Returns
RevisionRecord[]

Definition at line 373 of file findBadBlobs.php.

References DB_REPLICA, and handleStatus().

Referenced by scanRevisionsById().

◆ loadRevisionsByTimestamp()

FindBadBlobs::loadRevisionsByTimestamp ( int  $afterId,
string  $fromTimestamp,
  $batchSize 
)
private
Parameters
int$afterId
string$fromTimestamp
int$batchSize
Returns
RevisionStoreRecord[]

Definition at line 261 of file findBadBlobs.php.

References DB_REPLICA, and handleStatus().

Referenced by scanRevisionsByTimestamp().

◆ markBlob()

FindBadBlobs::markBlob ( RevisionRecord  $rev,
SlotRecord  $slot,
string  $error = null 
)
private
Parameters
RevisionRecord$rev
SlotRecord$slot
string | null$error
Returns
false|string

Definition at line 484 of file findBadBlobs.php.

References $args, DB_MASTER, Revision\SlotRecord\getAddress(), Revision\SlotRecord\getContentId(), Maintenance\getOption(), Maintenance\hasOption(), and wfArrayToCgi().

Referenced by checkSlot().

◆ scanRevisionsById()

FindBadBlobs::scanRevisionsById ( array  $ids)
private
Parameters
array$ids
Returns
int

Definition at line 343 of file findBadBlobs.php.

References checkRevision(), Maintenance\getBatchSize(), loadRevisionsById(), and Maintenance\output().

Referenced by execute().

◆ scanRevisionsByTimestamp()

FindBadBlobs::scanRevisionsByTimestamp (   $fromTimestamp,
  $total 
)
private
Parameters
string$fromTimestamp
int$total
Returns
int

Definition at line 183 of file findBadBlobs.php.

References checkRevision(), Maintenance\getBatchSize(), getNextRevision(), loadArchiveByRevisionId(), loadRevisionsByTimestamp(), Maintenance\output(), and waitForReplication().

Referenced by execute().

◆ waitForReplication()

FindBadBlobs::waitForReplication ( )
private

Definition at line 515 of file findBadBlobs.php.

Referenced by scanRevisionsByTimestamp().

Member Data Documentation

◆ $blobStore

BlobStore null FindBadBlobs::$blobStore
private

Definition at line 49 of file findBadBlobs.php.

Referenced by initializeServices().

◆ $lbFactory

LBFactory FindBadBlobs::$lbFactory
private

Definition at line 59 of file findBadBlobs.php.

Referenced by initializeServices().

◆ $loadBalancer

LoadBalancer null FindBadBlobs::$loadBalancer
private

Definition at line 54 of file findBadBlobs.php.

Referenced by initializeServices().

◆ $revisionStore

RevisionStore null FindBadBlobs::$revisionStore
private

Definition at line 44 of file findBadBlobs.php.

Referenced by initializeServices().


The documentation for this class was generated from the following file: