Release Notes

wmflib Changelog

v3.0.0 (2026-02-25)

Dependencies breaking changes

  • Drop support for Python 3.7 and 3.8.

  • Update dependencies minimum version to match those in Debian Bullseye.

  • Drop support for Debian Buster.

New features

Minor improvements

  • Use importlib.metadata instead of pkg_resources, now deprecated/removed.

  • Fix some newly reported linting issues.

  • tests: remove fixture require_caplog

  • type hints: use standard types as type hints.

v2.0.0 (2025-06-17)

API breaking changes

  • config: make the raises argument keyword only for both load_yaml_config() and load_ini_config(). All current clients are already either not passing the argument or passing it as keyword, not positional.

  • phabricator: make the section and dry_run arguments of create_phabricator() keyword only and also the dry_run argument of the Phabricator class constructor to keyword only. All current clients are already either not passing the optional arguments or passing them as keyword, not positional.

New features

  • phabricator: expand support for Phabricator tasks:

    • Add a validate_task_id() function to validate the format of a task ID. Optionally allow empty strings as valid based on the allow_empty_identifiers argument so that clients can decide if a CLI argument that is optional with a default value of empty string is considered valid.

    • Add the allow_empty_identifiers also to the Phabricator class’s __init__() and the create_phabricator() helper function and support for it throughout the class.

    • Add a task_accessible() method to verify if a task ID is accessible with the given token. It return False if the task doesn’t exists or is not visible.

    • Add to the new methods and the existing task_comment() a raises boolean parameter that defaults to True (to keep backward compatibility) that when set to False allows to call those methods in a best-effort way, just logging errors in case of failures and not raising exceptions.

Minor improvements

dns: alias DnsNotFound to DnsNotFoundError:

  • The existing exception DnsNotFound was not having a proper exception name. Add a new DnsNotFoundError and alias the old one to the new one to allow for a smooth transition of clients.

  • The DnsNotFound exception will be removed in a future release.

Miscellanea

  • setup.py: pin prospector to a specific version.

  • doc: small improvements in the config file, add automatically the current year in the copyright end date.

  • Refactored tox/CI and code formatting to adopt ruff and ruff format:

    • Applied various automatic formatting to the code base, including the move to double quote strings.

    • Applied various code simplifications/best practices as reported by ruff linters.

    • Completely refactored static checkers/linters using ruff.

    • Drastically reduce the current run of prospector to just run the pyroma and vulture tools, to be re-evaluated if they could be dropped entirely.

    • Setup ruff with an extensive set of rules to be potentially reduce/expanded based on feedback and usability.

    • On a clean checkout without a prior .tox/ directory the time for a full tox run is now ~16% faster.

    • Add a new style checker and formatter tox environments. The checker will be run automatically both locally and in CI, while the formatter can be called manually or integrated into IDE, git commit or git review workflows. For now it formats and checks the whole repository, if at any point this will become annoying we can use the same logic currently used in spicerack to format and check only the modified files or the last commit, based on the presence of local modifications or not.

    • Add a .git-blame-ignore-revs file with the list of commits (SHA1) of autoformatted changes so that they can be avoided in git blame with the --ignore-revs-file CLI argument.

v1.3.2 (2025-05-13)

Minor improvements

  • Add support for Python 3.13 and Debian Trixie

Miscellanea

  • docstrings: update some examples to be more clear and up to date.

v1.3.1 (2025-03-26)

Bug fixes

  • interactive: add NullHandler to the notify logger to prevent the notify logger messages to be logged with the root logger handlers. Clients are free to call notify_logger.handlers.clear() if they want to start from an empty set of handlers.

v1.3.0 (2025-03-25)

New features

  • interactive: notify when waiting for user input

    • When asking for user input, if the user has not replied within 3 minutes, send a notification via a custom logger.

    • The notification is done via a threading.Timer that is canceled if the user replies in time.

    • Clients of this cose (e.g. spicerack) can setup a custom handler for this dedicated notification logger to make the notification alert the user running the code.

Bug fixes

  • tests: fix outstanding CI issues.

  • setup.py: pin types-setuptools for pkg_resources

Miscellanea

  • tox: add Jenkins settings to reduce its execution time reducing the number of environments executed.

  • tests: remove unnecessary vulture setting

v1.2.7 (2024-09-19)

Minor improvements

  • constants: add US_DATACENTERS constant.

v1.2.6 (2024-09-05)

Bug fixes

  • interactive: fix regression and log the user input only if is valid to prevent leaks in the logs of wrongly pasted inputs.

Miscellanea

  • setup.py: fix test dependency removed upstream.

v1.2.5 (2024-04-18)

Minor improvements

constants: add the new magru datacenter.

v1.2.4 (2023-11-28)

Bug fixes

  • constants: update ns2.wikimedia.org IP address as it was recently changed.

  • requests: fix import of urllib’s Retry to be imported directly instead of importing it from requests to avoid mypy confusion.

Miscellanea

  • documentation: extend the @retry decorator documentation adding the formula to calculate the total delay given the number of tries and the delay argument for the different backoff strategies.

  • tox.ini: use directly sphinx-build instead of setup.py to generate the documentation, this prevents a deprecation warning or failure with the newest Sphinx.

  • tox.ini: remove optimization for tox <4. Tox 4 will not re-use the environments because of the different names, so removing this tox <4 optimization as it’s making subsequent runs slower with tox 4+.

v1.2.3 (2023-07-31)

Bug fixes

  • irc: handle custom logging formatters, when set allow the message to be formatted according to them.

Miscellanea

  • irc: refactored code and tests to simplify the code and improve readability.

v1.2.2 (2023-04-27)

Bug fixes

  • dns: clarify the type of the nameserver_addresses argument of the Dns class to adhere to the dnspython one.

  • dns: convert the sequence of nameserver_addresses to list to adhere to what dnspython is expecting.

  • requests: rename the type alias TypeTimeout to TimeoutType to adhere to pylint naming formats.

Miscellanea

  • tox: disable bandit’s request_without_timeout check in tests due to false positives.

v1.2.1 (2023-02-02)

Minor improvements

  • interactive: log the response to ask_input for easier troubleshooting. Indirectly logs also the response to ask_confirmation and confirm_on_failure.

  • interactive: allow free responses in ask_input (T327408):

    • Allow the answer to ask_input to be free-form using a custom validator callable.

    • The choices argument must be set to an empty sequence when the custom validator is set.

    • Add additional validation to fail in case choices is empty and no validator is provided or if the choices argument is non empty and the validator one is also set.

  • requests: allow to skip the session retry logic. In some cases, for example when using the @retry decorator from the decorators module, a client code might want to just set the UA and the timeout without any retry logic.

Miscellanea

  • prometheus: fix typo in docstring.

  • doc: set default language.

  • doc: update URL to requests library timeouts documetation page.

  • Add configuration file for the WMF-specific release script.

  • flake8: move all flake8 config to setup.cfg.

  • tox: add --no-external-config to prospector.

  • tests: remove unnecessary pylint disable

  • setup.py: specify python_requires.

  • setup.py: add support for Python 3.10 and 3.11.

  • setup.py: force a newer sphinx_rtd_theme to avoid a rendering bug of the older version.

v1.2.0 (2022-04-04)

New features

  • prometheus: add support for Thanos

    • Extract the common functionalities into a PrometheusBase class.

    • Have the existing Prometheus class inherit from PrometheusBase.

    • Add a new Thanos class that inherits from PrometheusBase to query the Thanos endpoint.

    • For Thanos queries set the deduplicate parameter always to true and the partial response one always to false to ensure to have unique data and all the data, respectively.

    • See also the Thanos#Global_view Wikitech page.

Minor improvements

  • prometheus: allow to specify a different Prometheus instance from the default ops one, while keeping backward compatibility.

Bug fixes

  • interactive: catch Ctrl+c / Ctrl+d on ask_input() to handle them properly.

Miscellanea

  • requests: fix docstring regarding the timeout type.

v1.1.2 (2022-03-09)

Bug fixes

  • requests: fix backward compatibility with urllib3 also in the tests.

v1.1.1 (2022-03-09)

Bug fixes

  • requests: fix backward compatibility with urllib3

    • Versions before 1.26.0 accept only the old parameter name ‘method_whitelist’, that will be removed in version 2.0.

    • Keep backward compatibility with previous versions of urllib3.

v1.1.0 (2022-03-09)

Minor improvements

  • requests: allow to customize the list of HTTP methods and HTTP status codes that should trigger a retry as the existing generic values might need to be tweaked at times.

Miscellanea

  • prospector: ignore deprecation message

    • The latest prospector issues a deprecated message for the pep8 and pep257 tools that have been renamed to pycodestyle and pydocstyle respectively. The new names are incompatible with prospector < 1.7.0, so for now keep the old names and disable the deprecation warning.

v1.0.2 (2022-02-14)

Bug fixes

  • requests: fix timeout parameter of http_session() so that is gets always propagated to the underlying calls to the requests library as that was not always the case. Clarify in the documentation how to unset the timeout for a single call when using this session.

v1.0.1 (2022-02-09)

Minor improvements

  • requests: add support to specify connection and read timeouts separately.

    • Set the default connection timeout to 3s and keep the existing read timeout to 5s.

Miscellanea

  • setup.py: temporarily add upper limit to dnspython, the latest 2.2.0 version generates mypy issues.

v1.0.0 (2021-11-11)

Minor improvements

  • constants: add the new drmrs datacenter to existing constants.

  • constants: add CORE_DATACENTERS constant currently defined in Spicerack.

  • Adopt pathlib.Path everywhere in the project:

    • Accept both str and os.PathLike objects in the config and fileio modules for file name parameters.

    • Use pathlib.Path instead of the os.path functions across the project.

  • style: adopt f-strings, converting all format() calls to f-strings when feasible.

  • interactive: change input prefix to ==>:

    • Change the input prefix from >>> to ==> to allow for code examples in an interactive Python console to be used in docstrings as documentation without having issues with the syntax highlighter.

  • docs: add usage examples to all modules.

Miscellanea

  • versioning: fully adopt semantic versioning starting with this release.

  • pylint: fix newly reported issues.

v0.0.9 (2021-08-04)

Minor improvements

  • decorators: improve the @retry decorator.

    • Add a new optional dynamic_params_callbacks parameter to the @retry decorator.

    • This parameter accepts a tuple of callbacks that will be called by the decorator and allow them to modify the parameters of the decorator itself at runtime.

    • Fix the signature of retry now that the upstream bug in pylint has been fixed and the newer version is included in prospector. This allows to remove some type ingore that were required before.

  • idm: make the cn and uid arguments of logoutd_args() both required so that the logoutd scripts that adhere to this API can safely rely on both being present. The logout cookbook is already passing both parameters anyway.

Miscellanea

  • idm: fix typo in docstring.

v0.0.8 (2021-06-23)

New features

  • idm: add a new idm module with support for global logout (T283242):

    • To ensure that all Python logout scripts will have the same set of arguments and to reduce everyone repeating the same argparse block, a LogoutdBase abstract class was added.

    • It features also a logoutd_args() function that provides the common argparse setup for all the logoutd scripts.

    • See the module’s documentation for example usages.

Minor improvements

  • constants: add DATACENTER_NUMBERING_PREFIX constant to map datacenter names to their numbering prefix used in hostnames.

Bug fixes

  • interactive: also check term for tmux in ensure_shell_is_durable().

  • tests: fix pip backtracking moving prospector tests to their own virtual environments.

Miscellanea

  • Add official support for Python 3.9

  • fileio: uniform quotes used in the file.

  • setup.py: add types dependencies for mypy for the dependencies that don’t have yet type hints.

  • CHANGELOG: fix typo in the v0.0.7 release notes.

v0.0.7 (2021-02-18)

New features

  • dns: update DNS to support multiple namservers.

    • This allows cookbooks to configure the Dns with multiple nameservers, for example:

      dns = Dns(nameserver_addresses=['91.198.174.239', '208.80.153.231'])

      and thus allow users to get authoritative answers whiles also making use of DNS failover to account for any on going work on a specific nameserver while the cookbook is running.

      The PUBLIC_AUTHDNS constant holds the auth server ips, given that they change very infrequently.

  • fileio: add new module to manage file I/O operations.

    • Add a locked_open() context manager to open a file with an exclusive lock to be used like the buil-in open().

Miscellanea

  • tests: cover untested property in the irc module.

  • CHANGELOG: fix typo.

  • tests: pylint, remove unnecessary disable comments.

v0.0.6 (2021-01-04)

Miscellanea

  • doc: improve installation and introduction documentation pages and some modules documentation.

  • type hints: mark the package as type hinted so that mypy can recognize its type hints when imported in other projects.

v0.0.5 (2020-12-21)

New features

  • Port the decorators module from Spicerack (T257905).

  • Port the interactive module from Spicerack (T257905).

  • Port the prometheus module from Spicerack (T257905).

  • Port the IRC logger handler from Spickerack into an irc module (T257905).

  • interactive: improve confirmation capabilities

    • Add a ask_input() generic function to ask the user for input and check that the answer is among a list of allowed choices, returning the user’s choice.

    • Convert ask_confirmation() to use the ask_input() function.

    • Add an InputError and AbortError exception classes.

    • Add a confirm_on_failure() function to run any callable, and on failure ask the user to either retry, skip the step or abort the whole execution.

Miscellanea

  • docs: fix link to pywmflib Gerrit project.

  • tests: fix deprecated pytest argument.

v0.0.4 (2020-11-02)

New features

  • requests: add new requests module that exposes an http_session() function that instantiate a requests’s Session with configurable default timeout, retry logic on some failures as well as setting a well formatted User-Agent.

v0.0.3 (2020-10-23)

New features

  • Import the action module from Spicerack

  • Import the config module from Spicerack

  • Import the phabricator module from Spicerack

v0.0.2 (2020-09-22)

Miscellanea

  • Remove Spicerack references from docstrings.

v0.0.1 (2020-07-27)

New features

  • Initial version of the package.

  • Import the dns module and tests from Spicerack.