throttle — Slow Down Wiki I/O

Mechanics to slow down wiki read and/or write rate.

class throttle.ProcEntry(module_id, pid, time, site)

Bases: tuple

Create new instance of ProcEntry(module_id, pid, time, site)

property module_id

Alias for field number 0

property pid

Alias for field number 1

property site

Alias for field number 3

property time

Alias for field number 2

class throttle.Throttle(site, *, mindelay=None, maxdelay=None, writedelay=None)

Bases: object

Control rate of access to wiki server.

Calling this object blocks the calling thread until at least 'delay' seconds have passed since the previous call.

Each Site initiates one Throttle object (site.throttle) to control the rate of access.

Parameters:

• site (Union[pywikibot.site.BaseSite, str]) – site or sitename for this Throttle. If site is an empty string, it will not be written to the throttle.ctrl file.

• mindelay (Optional[int]) – The minimal delay, also used for read access

• maxdelay (Optional[int]) – The maximal delay

• writedelay (Optional[Union[int, float]]) – The write delay

checkMultiplicity()

Count running processes for site and set process_multiplicity.

Changed in version 7.0: process is not written to throttle.ctrl file is site is empty

Return type:

None

drop()

Remove me from the list of running bot processes.

Return type:

None

getDelay(write=False)

Return the actual delay, accounting for multiple processes.

This value is the maximum wait between reads/writes, not taking into account of how much time has elapsed since the last access.

Parameters:

write (bool) –

get_pid(module)

Get the global pid if the module is running multiple times.

Parameters:

module (str) –

Return type:

int

lag(lagtime=None)

Seize the throttle lock due to server lag.

Usually the self.retry-after value from response_header of the last request if available which will be used for wait time. Otherwise lagtime from api maxlag is used. If neither self.retry_after nor lagtime is set, fallback to config.retry_wait.

If the lagtime is disproportionately high compared to self.retry_after value, the wait time will be increased.

This method is used by api.request. It will prevent any thread from accessing this site.

Parameters:

lagtime (Optional[float]) – The time to wait for the next request which is the last maxlag time from api warning. This is only used as a fallback if self.retry_after isn’t set.

Return type:

None

property multiplydelay: bool

Deprecated.

DEPRECATED attribute.

setDelays(delay=None, writedelay=None, absolute=False)

Set the nominal delays in seconds. Defaults to config values.

Parameters:

absolute (bool) –

Return type:

None

static wait(seconds)

Wait for seconds seconds.

Announce the delay if it exceeds a preset limit.

Parameters:

seconds (Union[int, float]) –

Return type:

None

waittime(write=False)

Return waiting time in seconds.

The result is for a query that would be made right now.

Parameters:

write (bool) –