Job queue runner utility methods. More...

Inheritance diagram for JobRunner:

Collaboration diagram for JobRunner:

Public Member Functions
	__construct (LoggerInterface $logger=null)

	run (array $options)
	Run jobs of the specified number/type for the specified time. More...

	setDebugHandler ($debug)

	setLogger (LoggerInterface $logger)

Public Attributes
const	ERROR_BACKOFF_TTL = 1

const	LAG_CHECK_PERIOD = 1.0

const	MAX_ALLOWED_LAG = 3

Protected Attributes
callable null	$debug
	Debug output handler. More...

	$logger

Private Member Functions
	checkMemoryOK ()
	Make sure that this script is not too close to the memory usage limit. More...

	commitMasterChanges (Job $job)
	Issue a commit on all masters who are currently in a transaction and have made changes to the database. More...

	debugCallback ($msg)
	Log the job message. More...

	executeJob (Job $job, $stats, $popTime)

	getBackoffTimeToWait (Job $job)

	getMaxRssKb ()

	loadBackoffs (array $backoffs, $mode= 'wait')
	Get the previous backoff expiries from persistent storage On I/O or lock acquisition failure this returns the original $backoffs. More...

	syncBackoffDeltas (array $backoffs, array &$deltas, $mode= 'wait')
	Merge the current backoff expiries from persistent storage. More...

Detailed Description

Job queue runner utility methods.

Since: 1.24

Definition at line 34 of file JobRunner.php.

Constructor & Destructor Documentation

JobRunner::__construct ( LoggerInterface $logger = null )

Parameters

LoggerInterface $logger

Definition at line 65 of file JobRunner.php.

References $logger, and setLogger().

Member Function Documentation

JobRunner::checkMemoryOK ( )

private

Make sure that this script is not too close to the memory usage limit.

It is better to die in between jobs than OOM right in the middle of one.

Returns: bool

Definition at line 445 of file JobRunner.php.

References debugCallback(), and list.

Referenced by run().

JobRunner::commitMasterChanges ( Job $job )

private

Issue a commit on all masters who are currently in a transaction and have made changes to the database.

It also supports sometimes waiting for the local wiki's slaves to catch up. See the documentation for $wgJobSerialCommitThreshold for more.

Parameters

Job $job

Exceptions

DBError

Definition at line 488 of file JobRunner.php.

References $fname, debugCallback(), LoadBalancer\forEachOpenConnection(), global, IDatabase\query(), Job\toString(), use, wfGetLB(), wfGetLBFactory(), wfWikiID(), and IDatabase\writesOrCallbacksPending().

Referenced by executeJob().

JobRunner::debugCallback ( $msg )

private

Log the job message.

Parameters

string $msg The message to log

Definition at line 473 of file JobRunner.php.

References TS_DB, and wfTimestamp().

Referenced by checkMemoryOK(), commitMasterChanges(), and executeJob().

JobRunner::executeJob	(	Job	$job,
			$stats,
			$popTime
	)

private

Parameters

Job	$job
BufferingStatsdDataFactory	$stats
float	$popTime

Returns: array Map of status/error/timeMs

Definition at line 255 of file JobRunner.php.

References $e, $status, commitMasterChanges(), debugCallback(), DeferredUpdates\doUpdates(), Job\getLastError(), getMaxRssKb(), Job\getReadyTimestamp(), Job\getRootJobParams(), Job\getType(), MWExceptionHandler\logException(), MWExceptionHandler\rollbackMasterChangesAndLog(), Job\run(), LinkCache\singleton(), Job\teardown(), Job\toString(), TS_UNIX, wfGetLBFactory(), and wfTimestamp().

Referenced by run().

JobRunner::getBackoffTimeToWait ( Job $job )

private

Parameters

Job $job

Returns: int Seconds for this runner to avoid doing more jobs of this type

See also: $wgJobBackoffThrottling

Definition at line 334 of file JobRunner.php.

References Job\getType(), global, and Job\workItemCount().

Referenced by run().

JobRunner::getMaxRssKb ( )

private

Returns: int|null Max memory RSS in kilobytes

Definition at line 323 of file JobRunner.php.

References wfGetRusage().

Referenced by executeJob().

JobRunner::loadBackoffs	(	array	$backoffs,
			$mode = `'wait'`
	)

private

Get the previous backoff expiries from persistent storage On I/O or lock acquisition failure this returns the original $backoffs.

Parameters

array	$backoffs	Map of (job type => UNIX timestamp)
string	$mode	Lock wait mode - "wait" or "nowait"

Returns: array Map of (job type => backoff expiry timestamp)

Definition at line 368 of file JobRunner.php.

References $content, $timestamp, $type, as, and wfTempDir().

Referenced by syncBackoffDeltas().

JobRunner::run ( array $options )

Run jobs of the specified number/type for the specified time.

The response map has a 'job' field that lists status of each job, including:

type : the job type
status : ok/failed
error : any error message string
time : the job run time in ms The response map also has:
backoffs : the (job type => seconds) map of backoff times
elapsed : the total time spent running tasks in ms
reached : the reason the script finished, one of (none-ready, job-limit, time-limit, memory-limit)

This method outputs status information only if a debug handler was set. Any exceptions are caught and logged, but are not reported as output.

Parameters

array

$options

Map of parameters:

type : the job type (or false for the default types)
maxJobs : maximum number of jobs to run
maxTime : maximum time in seconds before stopping
throttle : whether to respect job backoff configuration

Returns: array Summary response that can easily be JSON serialized

Definition at line 96 of file JobRunner.php.

References $e, $job, $response, $type, $wait, checkMemoryOK(), executeJob(), false, getBackoffTimeToWait(), RequestContext\getMain(), global, Profiler\instance(), list, WebRequest\overrideRequestId(), JobQueueGroup\singleton(), syncBackoffDeltas(), JobQueueGroup\TYPE_DEFAULT, JobQueueGroup\USE_CACHE, wfGetLB(), wfGetLBFactory(), wfReadOnly(), and wfWikiID().

JobRunner::setDebugHandler ( $debug )

Parameters

callable $debug Optional debug output handler

Definition at line 50 of file JobRunner.php.

References $debug.

JobRunner::setLogger ( LoggerInterface $logger )

Parameters

LoggerInterface $logger

Returns: void

Definition at line 58 of file JobRunner.php.

References $logger.

Referenced by __construct().

JobRunner::syncBackoffDeltas	(	array	$backoffs,
		array &	$deltas,
			$mode = `'wait'`
	)

private

Merge the current backoff expiries from persistent storage.

The $deltas map is set to an empty array on success. On I/O or lock acquisition failure this returns the original $backoffs.

Parameters

array	$backoffs	Map of (job type => UNIX timestamp)
array	$deltas	Map of (job type => seconds)
string	$mode	Lock wait mode - "wait" or "nowait"

Returns: array The new backoffs account for $backoffs and the latest file data

Definition at line 405 of file JobRunner.php.

References $content, $timestamp, $type, as, loadBackoffs(), and wfTempDir().

Referenced by run().

Member Data Documentation

callable null JobRunner::$debug

protected

Debug output handler.

Definition at line 36 of file JobRunner.php.

Referenced by setDebugHandler().

LoggerInterface JobRunner::$logger

protected

Definition at line 41 of file JobRunner.php.

Referenced by __construct(), and setLogger().

const JobRunner::ERROR_BACKOFF_TTL = 1

Definition at line 45 of file JobRunner.php.

const JobRunner::LAG_CHECK_PERIOD = 1.0

Definition at line 44 of file JobRunner.php.

const JobRunner::MAX_ALLOWED_LAG = 3

Definition at line 43 of file JobRunner.php.

The documentation for this class was generated from the following file:

includes/jobqueue/JobRunner.php

Public Member Functions

Public Attributes

Protected Attributes

Private Member Functions

Detailed Description

Constructor & Destructor Documentation

Member Function Documentation

Member Data Documentation