Release Notes¶
Spicerack Changelog¶
v0.0.54 (2021-06-21)¶
API breaking changes¶
icinga: rename some
IcingaHosts
methods:This is an API breaking change, but the newly introduced
IcingaHosts
API is not yet used widely, just one Cookbook uses it so far.Rename some methods of the
IcingaHosts
class to be more dry and explicit. Namely: *hosts_downtimed
->downtimed
(context manager) *downtime_hosts
->downtime
*host_command
->run_icinga_command
v0.0.53 (2021-06-10)¶
Bug fixes¶
icinga: use bash wrapper to allow sudo in the
IcingaHosts
class.
Miscellanea¶
doc: use
add_css_file()
instead ofadd_stylesheet()
.doc: fix parameter type in docstring.
v0.0.52 (2021-05-06)¶
New features¶
dhcp: Add module for manipulating dynamic DHCP entries on target data centers and restarting the DHCP server (T269855).
icinga: pass
verbatim_hosts
option to theicinga-status
script when using verbatim Icinga hostnames that are not real hosts.
Bug fixes¶
netbox: fix check for server role.
The physical devices and virtual machines objects in Netbox have different names for the role property (
device_role
vsrole
). Use the correct property each time.
icinga: fix typo in docstring.
v0.0.51 (2021-05-04)¶
Minor improvements¶
dnsdisc: do not configure DNS resolver. As the module is injecting the nameservers of the authoritative DNS, do not let the DNS module auto-configure itself with
/etc/resolv.conf
.
Bug fixes¶
tests: fix mock of the DNS module that was not in some cases properly mocked and the tests were relying on a properly configured
/etc/resolv.conf
.
v0.0.50 (2021-05-04)¶
Dependencies breaking changes¶
setup.py: relax elasticsearch dependencies:
In order to be able to build spicerack for Debian bullseye that ships
python3-elasticsearch
7.1.0
andpython3-elasticsearch-curator
5.8.1
, relax the related dependency constraints insetup.py
.Elasticsearch requires to bump the version above the suggested compatibility matrix, we'll test if all works as expected. See the elasticsearch compatibility matrix.
Elasticsearch curator matches upstream compatibility matrix, see the elasticsearch curator compatibility matrix.
As Spicerack is released via debian packages this will not affect the buster builds.
API breaking changes¶
netbox: improve
as_dict()
:Instead of calling
serialize()
for the conversion to dictionary, just callingdict()
on the object gives a more useful representation of the object because all the nested properties are converted to string or sub-dictionaries with useful values instead of just the IDs.As a result any usage of
as_dict()
that relied on the format of specific fields might break. At the moment no cookbook is using it.See also the "Casting the object as a dictionary" example in pynetbox.core.response.Record.
New features¶
netbox: add
NetboxServer
class:Add a
NetboxServer
class in the netbox module to give a higher level abstraction across physical servers and virtual machines.This is particularly useful to finally have an authoritative way to convert a hostname into a FQDN or get the managment FQDN of a host given its hostname (T240176).
The class also allow to update the device status only if it's a physical host and the status transition is approved.
Those new features will be used by the cookbook that will replace the reimage script and then the current usage of some of the existing methods in the
Netbox
class should be converted to use this class instead.
icinga: add new
IcingaHosts
class (T277740):Implements the TODO that wanted to move the
Icinga
class into a class that is initialized with the target hosts so that it's not necessary anymore to pass them to each method.Keep the existing
Icinga
class for now, but mark it as deprecated, both in the documentation ofspicerack.Spicerack.icinga()
andicinga.Icinga()
and emit also aDeprecationWarning
when instantiated. It will be removed in the next release once all the cookbooks have been migrated to the newspicerack.Spicerack.icinga_hosts()
accessor.Move the detection of the Icinga command file to its own class to allow to cache it across different instances, making the instantiation of multiple
IcingaHosts
class free after the first one.Allow to manage also non-servers that are defined as Icinga hosts passing the
verbatim_hosts
parameter, that will not extract the hostname from the given hosts assuming that they are already FQDNs.
toolforge.etcdctl: Allow getting the cluster health. This opens up being able to wait/stop if the cluster status is not what's expected when doing operations (T276338).
Minor improvements¶
icinga: use a bash command wrapper to allow sudo, otherwise the echo command will fail to output to the file.
icinga: use a sudo-friendly command to detect the Icinga
command_file
.netbox: improve
as_dict()
:Instead of calling
serialize()
for the conversion to dictionary, just callingdict()
on the object gives a more useful representation of the object because all the nested properties are converted to string or sub-dictionaries with useful values instead of just the IDs.See also the "Casting the object as a dictionary" example in pynetbox.core.response.Record.
Bug fixes¶
remote: fix
use_sudo
onsplit()
.netbox: fix object type returned for status. The status should be returned as string and not as a Netbox object.
doc: add documentation for the toolforge package.
doc: remove obsolete configuration
setup.py: add missing tag for Python 3.9, already supported.
tests: fix pip backtracking separating the prospector tests into its own virtualenv.
tests: fix format checking
If no Python files were modified at all, the latest isort would bail out. Skipping the checks if no Python files were modified at all.
doc: fix documentation checker for sub-packages
The existing checker was assuming a flat space of modules inside spicerack, while now we have also subpackages. Adapt the checker to detect those too.
Convert file operations to pathlib.
Miscellanea¶
doc: move ClusterShell URL to HTTPS
netbox: refactor unit tests
v0.0.49 (2021-03-04)¶
API breaking changes¶
icinga: changed the type for the
hosts
parameter in theget_status()
method fromspicerack.typing.TypeHosts
tocumin.NodeSet
.
New features¶
icinga: add
Icinga.wait_for_optimal()
method to pause while hosts converge to an optimal state.puppet: add
Puppet.get_ca_servers()
method to retrieve the configured Puppetca_server
on the target hosts.remote: allow prepending every command to execute on the target hosts with sudo. This is a first temporary iteration until Cumin will support it natively.
toolforge.etcdctl: add new toolforge package with an etcdctl module to run etcdctl commands and retrieve a parsed output. Focused on etcd member management only for now (T267412).
Minor improvements¶
config: allow to use paths relative to the user's
$HOME
directory expanding~
.logging: improve logging format
Add the
DRY-RUN
prefix also to file logs to allow to distinguish dry-run executions from the real ones just looking at the logs.Improve the execute cookbook log message including the whole arguments so that it includes also the global args such as
verbose
anddry-run
.
remote:
RemoteHosts.wait_reboot_since()
is now using a constant backoff. Previously, a linear backoff with a base delay of 10 seconds was used. Since we do expect the reboot of a server to take some time, by the time the server has rebooted, the retry interval has already grown to multiple minutes. A constant backoff should be appropriate and should increase the reactivity of this check significantly.mysql_legacy.py: Add the new
x2
database core section (T269324).
Bug fixes¶
cookbooks: force the title to be one line. When reading the title from the cookbooks, pick only the first line to prevent the UI to be cluttered by a title erroneously set to multi-line.
tox: fix for when the system setuptools is too old.
elasticsearch: Revert the return the cluster name in
ElasticsearchCluster.__str__
change added inv0.0.32
.remote: fix pylint typing confusion.
Miscellanea¶
gitignore: add vim swap files.
tests: temporary force
mypy
upper version to avoid a regression in release 0.800.tests: tox, enable python 3.9 support.
code style: introduced
black
andisort
as autoformatters (T211750).documentation: add a development page to highlight how the code is formatted and how to integrate the code formatters with an editor/IDE or in the git workflow (T211750).
git: allow exclude code auto formatters refactor commit from git blame adding the
.git-blame-ignore-revs
file.
v0.0.48 (2021-01-18)¶
Bug fixes¶
logging: fix base path and name to setup logging.
In the recent refactor to the new APIs, the paths passed to the setup_logging function were not anymore correct. Now that the cookbook items have a proper Spicerack-formatted path and name, use them directly.
v0.0.47 (2021-01-13)¶
API breaking changes¶
Use newly migrated code from wmflib:
Some additional functionalites were moved to wmflib (>= 0.0.5), remove the duplicated code from Spicerack and use the wmflib version instead.
interactive: convert all imports to use the wmflib version, remove the duplicated code. The module is for now left to hold the
get_management_password()
function.prometheus: moved entirely to wmflib.
_log: use the SAL (!log) IRC handler from wmflib.
The
@retry
decorator will be migrated in a separate patch to keep its dry-run awareness.
Minor improvements¶
administrative: Add getters for the other Reason fields.
Bug fixes¶
puppet: update
get_certificate_metadata()
so the pattern is more specific and prevent it to match other hosts.elasticsearch_cluster: fix call to
@retry
.
Miscellanea¶
dnsdisc: improve test coverage
tests: fix deprecated pytest argument
tox: Remove
--skip B322
from Bandit config not supported by newer Bandit versions.
v0.0.45 (2020-11-30)¶
API breaking changes¶
Removed config and phabricator modules migrated to wmflib and update imports.
remote: re-enabled Cumin's output removing its suppression. The work on T212783 will make it more flexible on a per-execution basis, but for now is better to just re-enable it and make the errors surface to the users.
New features¶
cookbook API: add class API
In addition to the simple cookbooks function API interface add support for a more integrated class-based API.
Spicerack will perform auto-detection of the API used by the cookbook and automatically convert the module-based API cookbooks into class-based cookbooks so that only one interface is actually supported internally.
The class API defines a
CookbookBase
class that cookbooks that want to use this API must extend creating a derived class. The derived class can have any name. Multiple cookbooks in the same module are supported.The class-based API allows a more in-depth integration with Spicerack:
Allow to perform additional initialization and validation steps in the class constructor before the cookbook execution starts, allowing the cookbook to bail out before execution and any related
!log-ging
.Allow to define a custom runtime description that will be included, for example, in the
START/END
logging messages that are also sent to IRC and!log-ed
into SAL.Refactor the Cookbook API documentation to be more detailed and following Sphinx standards to document the cookbooks module interfaces.
Refactor out from the private
_cookbook
module some functionalities to a_menu
and_module_api
modules.
spicerack: add
requests_session
accessor to get a requests'sSession
pre-configured bywmflib
with a default timeout, retry logic andUser-Agent
.decorators: Add an optional custom failure message to
@retry
:The
@retry
decorator logs the messages from exceptions raised during execution, but when there are chained exceptions ("raise from", etc.) only the top-level error is logged. For example, inMediaWiki._check_siteinfo
, we only logFailed to get siteinfo
and throw away the message from the underlyingRequestException
. Instead, this traverses the exception chain (using the same logic as the built-in default handler for uncaught exceptions) and includes each exception's message in the log entry.
Minor improvements¶
Convert all usage of the
requests
package to use thewmflib.requests.http_session
instead to have a niceUser-Agent
, a default timeout and a retry logic on some failures acrossSpicerack
.puppet: suppress deprecation warnings.
decorators: Log chained exception messages in
@retry
.
Miscellanea¶
doc: add missing link to the
wmflib
package.dependencies: remove temporary hacks.
dependencies: update min version to match the versions in Debian Buster.
tests: remove
require_*
decorators.Refactoring: renamed internal modules with a leading underscore:
Moved
cookbook.py
to_cookbook.py
andlog.py
to_log.py
as all their content is actually internal tospicerack
and no client should use any of that. They were already excluded from the generated documentation for the same purpose.
v0.0.44 (2020-10-13)¶
Breaking changes¶
dns: the
dns
module has been migrated towmflib
and removed from Spicerack. Its access via thespicerack.dns(()
accessor is unchanged, but any direct imports from thespicerack.dns
module in cookbooks must be replaced withwmflib.dns
(T257905).
Miscellanea¶
Spicerack now depends on the new
wmflib
package.log: adjust the return type of
FilterOutCumin.filter()
as required by mypy (upstream documentation incorrect).documentation: refactor and simplify its configuration.
pylint: allow
logger
as module-scope name given that is used throughout the project so that there is no need for a pylint disable comment.
v0.0.43 (2020-09-16)¶
Minor improvements¶
elasticsearch: Store which datacenters to query for metrics in Prometheus.
v0.0.41 (2020-08-31)¶
Bug Fixes¶
dnsdisc: change retry logic to wait up to 27 seconds with more frequent checks instead of the current 9 seconds.
v0.0.40 (2020-08-27)¶
New features¶
elasticsearch_cluster: verify all write queues are empty querying Prometheus (T261239).
Miscellanea¶
doc: improved logging documentation.
v0.0.39 (2020-08-18)¶
New features¶
Add native mysql spicerack module.
Bug Fixes¶
mysql_legacy: update Cumin queries for DB selection due to Puppet refactors.
icinga: fix bug for
recheck_all_services()
, the signature of the Icinga command requires a check time too.
Miscellanea¶
Remove support for Python 3.5 and 3.6.
actions: refactored to take advantage of more recent Python versions.
Add type hints for variables and attributes since the support for older Python versions has been dropped.
Pin to a working version of prospector as 1.3.0 was overenthusiastic with updating its dependencies.
actions: fix test for pytest regression in version 6.0.0.
v0.0.38 (2020-06-09)¶
Bug Fixes¶
ganeti: update the list of available rows in the
eqiad
andcodfw
datacenters.
Miscellanea¶
Add support for Python 3.8.
v0.0.37 (2020-05-18)¶
Bug Fixes¶
icinga: fix
get_status()
:The
icinga-status
script that returns the status can be run also in dry-run mode as it's a read-only tool.The
icinga-status
script exits with a non-zero exit status on non-optimal and missing hosts, accept any exit code.
v0.0.36 (2020-05-18)¶
Bug Fixes¶
tests: add
@require_caplog
to someactions
module tests to fix the build on Debian Stretch.
v0.0.35 (2020-05-18)¶
API breaking changes¶
Rename
mysql
module tomysql_legacy
:The existing
mysql
module uses remote execution of the mysql client to interact with mysqld's. Moving this out of the way to allow room for a newmysql
module which uses a native mysql client library.
New features¶
interactive: add
get_secret()
function for requesting secrets interactively with optional ask for confirmation.icinga: allow to check the status of a host:
Add a
get_status()
method that allows to get the current status of a set of hosts in Icinga.The returned status allow to quickly check if all the hosts are in optimal state, get a list of those that are not and the services that are failing on those hosts.
actions: new module to track cookbook actions:
Add a new actions module that contains an
Actions
class and anActionsDict
class that is an ordered dictionary with default dictionary functionalities ofActions
class instances.The
Actions
instances allow to keep track of actions performed by acookbook with the following features:Save the message of the action with different levels (
success
,warning
,failure
).Log the message of the action with the associated log level.
Keep track of the presence of any warning or failure.
Have a nice string representation of the actions, suitable to be used to update a Phabricator task.
The
ActionsDict
class has too a nice string representation of its items.This is a porting with some generalization of the code present in the sre.hosts.decommission cookbook.
Pre-create an
ActionsDict
instance in spicerack so that it can be accessed in the cookbooks directly asspicerack.actions
.
typing: add a
typing
module for custom type hints:Add a new typing module to hold all custom types useful across Spicerack.
Define a custom type
TypeHosts
that can be either aNodeSet
or a sequence of strings.Use the new type in the icinga module.
Bug Fixes¶
Miscellanea¶
icinga: refactor input parsing:
The Icinga class needs to use hostnames instead of FQDNs.
Move the conversion from FQDNs (or hostnames) to hostnames to a static method so that can be used across the class without repetition of code.
tests: fix newly reported flake8 issues.
tests: relax Prospector dependency
The upstream bug that required to set an upper limit on the version of Prospector has been fixed.
Removing the upper bound to get newer features.
Fix newly reported issues.
tests: relax Bandit dependency
The upstream bug that required to set an upper limit on the version of Bandit has now a workaround using a specific syntax for the exclude files.
Removing the upper bound to get newer features.
Fix newly reported issues.
Remove
nosec
comments not needed anymore and convert some of them into skipped checks intox.ini
. This way the affected lines are still checked for other issues.
v0.0.34 (2020-05-06)¶
API breaking changes¶
netbox: removed property
device_status_choices
of theNetbox
class, not currently used and removed from Netbox API starting from version 2.8.0.
Bug Fixes¶
netbox: adapt to new Netbox API:
Netbox API starting with Netbox 2.8.0 have removed the choices API endpoint. Given that it was used only for the status, removing its support completely for now given that is not directly supported by the pynetbox library yet.
Miscellanea¶
doc: set min version of sphinx_rtd_theme to 0.1.9 to match Debian Stetch.
doc: fix documentation generation for Sphinx 3
changelog: specify breaking change for v0.0.33.
v0.0.33 (2020-05-04)¶
API breaking changes¶
netbox: the default instance returned when calling
Spicerack.netbox()
uses a read-only token. To have read-write access to Netbox theread_write
parameter should be set toTrue
.
New features¶
netbox: add support for RW and RO tokens:
Use a RO token by default, allow to request a Netbox instance with a RW token.
Always use a RO token if in dry-run mode to allow to expose the Netbox API object directly to the clients.
netbox: expose the pynetbox API object:
To allow to perform additional operations not yet abstracted by the Netbox class, expose the pynetbox API object directly.
The dry-run mode support is ensured by the RO token.
Minor improvements¶
include the username in logfiles
v0.0.32 (2020-03-11)¶
Minor improvements¶
spicerack: allow to override Spicerack's instance parameters from the configuration file. See config.yaml.
spicerack: allow to cache the
Ipmi
instance so that it can be re-used without re-asking the management password.spicerack: expose to cookbooks the
_spicerack_config_dir
parameter via a getter.netbox: fine tune log and exception messages.
elasticsearch: return the cluster name in
ElasticsearchCluster.__str__
.mysql: update
CORE_SECTIONS
for external storage RW instances (T226704).
Bug Fixes¶
elasticsearch: add
https://
to relforge endpoints.
Miscellanea¶
tests: remove unused mypy type ignore comments.
v0.0.31 (2020-02-26)¶
New features¶
ganeti: add VM creation capability (T231068).
spicerack: add support for an HTTP proxy.
To perform calls to external endpoints it might be necessary to use an HTTP proxy, add support for it.
Read the
http_proxy
config from the main spicerack configuration file and inject it into Spicerack that will also expose it to the cookbooks.Add a getter for the
http_proxy
property to Spicerack.Add a helper that returns a
proxies
dictionary to be used by the Python Requests module.
v0.0.30 (2020-02-11)¶
API breaking changes¶
netbox: rename injected property in host details (T231068).
When fetching host details from Netbox, Spicerack injects some properties to distinguish between virtual and physical hosts. Renaming the
cluster_name
property toganeti_cluster
to avoid possible confusions.
New features¶
spicerack: add getter for the Netbox master host. In some cases is necessary to execute commands on the Netbox master host, add a getter to resolve its real hostname (T231068).
ganeti: add cluster to
instance()
(T231068).Allow to specify the Ganeti cluster name when calling
instance()
. If set the instance will be searched only in that cluster.Pass the cluster name to the
GntInstance
constructor and expose it via a getter to remove the necessity to look it up separately when cluster was not passed toinstance()
for auto-detection.
ganeti: add initial support for
gnt-instance
(T231068).Add initial support for
gnt-* commands
to be executed on the cluster master via remote execution.Add initial support for
gnt-instance
commands to perform Ganeti VMs decommissioning, in particular:shutdown
: to shutdown a Ganeti VM, with its optionaltimeout
parameter.remove
: to shutdown and remove a Ganeti VM, with its optionalshutdown_timeout
parameter.
Miscellanea¶
dnsdisc: fix typo in docstring.
v0.0.29 (2020-01-16)¶
Minor improvements¶
mediawiki: in
stop_cronjobs()
adapt for the migration fromhhvm
tophp-fpm
in production (T229792).dnsdisc: use port
5353
to query the resolvers. The authdns part is answering to port5353
from now on.dns: allow to specify a custom port for the resolver. The authdns part is answering to port
5353
from now on, allow to specify a custom port when instantiating a newDns
recursor.ganeti: Add
esams
,ulsfo
andeqsin
clusters and rows definitions.
Bug Fixes¶
ipmi: the change introduced via I4d4ade351493a548e9e7a578bf9a7acbb45a5c0 to use
subprocess.run()
created a regression causing theipmi
calls to no longer capture stdout. Restored normal behaviour (T147074).
Miscellanea¶
dns: remove unused type hint ignore comments.
remote: fix docstring return type.
documentation: updated link to the requests module documentation.
docstrings: fix pep257 reported errors.
mypy: Get rid of no longer needed
# type: ignore
annotations that are now detected automatically bymypy
.
v0.0.27 (2019-08-25)¶
Minor improvements¶
remote: Move splitting of a
RemoteHosts
instance to asplit()
method.netbox: Make host private and raise exception on not found.
netbox: Add method to return host information.
v0.0.26 (2019-08-06)¶
New features¶
Add Netbox module
Add the
LBRemoteCluster
class to manage cluster behind a load balancer
Minor improvements¶
icinga: Add a function to force a recheck of all sevices
confctl: Add
filter_objects
andupdate_objects
confctl: add
change_and_revert
contextmanager
Bug Fixes¶
elasticsearch_cluster: correct ports for relforge cluster
elasticsearch_cluster: fix
mypy
newly reported bugtests: fix
pytest
caplog
matchingtests: fix
pep257
newly reported issues
v0.0.25 (2019-05-10)¶
Bug Fixes¶
setup.py: fix
urllib3
dependencyIn order to build on Debian Stretch without backported packages, relax a bit the urllib3 dependency as the only goal for to specify it is to avoid conflicts with the latest version.
documentations: fix Sphinx configuration
In order to avoid issues while building the Debian package on Stretch where Sphinx
1.4.9
is available, change configuration to:Reduce minimum Sphinx version to
1.4.9
insetup.py
Remove the
warning-is-error
configuration fromsetup.cfg
that is applied to every Sphinx run, and move it directly intotox.ini
as a command line-W
option, that will be executed only bytox
and not during the Debian package build process.
v0.0.24 (2019-05-09)¶
Minor improvements¶
prometheus: add timeout support to
query()
methodganeti: add timeout support
cookbook API: drop
get_title()
supportNo current cookbook is using the dynamic way to provide a title through
get_title(args)
This abstraction has not proven to be useful and the fact to mangle dynamically the title of a cookbook based on the current parameter while you can then execute it with different ones doesn't seem very useful, dropping it completely from the Cookbook API
doc: mark Sphinx warnings as error
To make the documentation building process more robust make Sphinx fail on warnings too
This requires
Sphinx > 1.5
and will require to use the backport version while building the package on Debian Stretch
doc: add checker to ensure modules are documented
It's common when adding a new module to forget to add the few bits required to auto-generated its documentation
Add a check to ensure that all Spicerack modules are listed in the documentation API index and that the linked files exists
Bug Fixes¶
ganeti: Fix RAPI port
prometheus: fix base URL template
doc: autodoc missing API modules
Miscellanea¶
setup.py: force
urllib3
version due topip
bugAdd emacs ignores to gitignore
tests: temporarily force
bandit < 1.6.0
Due to a bug upstream bandit 1.6.0 doesn't honor the excluded directories, causing the failure of the bandit tox environments. Temporarily forcing its version
v0.0.23 (2019-04-19)¶
New features¶
Add basic Ganeti RAPI support
Add basic Prometheus support
Bug Fixes¶
elasticsearch: logging during shard allocation was too verbose, some messages lowered to debug level
Miscellanea¶
flake8: enforce import order and adopt
W504
Add
flake8-import-order
to enforce the import order using theedited
style that corresponds to our styleguide, see: mediawiki.org: Coding_conventions/PythonMark spicerack as local and do not specify any organization-specific packages to avoid to keep a manually curated list of packages
Fix all out of order imports
For line breaks around binary operators, adopt
W504
(breaking before the operator) and ignoreW503
, following PEP8 suggestion, see: PEP0008#line_break_binary_operatorFix all line breaks around binary operators to follow
W504
v0.0.21 (2019-04-03)¶
Minor improvements¶
elasticsearch: Retrieve hostname and fqdn from node attributes
elasticsearch: make unfreezing writes more robust (T219640)
elasticsearch: cleanup test by introducing a method to mock API calls
elasticsearch: rename elasticsearchclusters to elasticsearch_clusters
Bug Fixes¶
tox: fix typo in environment name
Miscellanea¶
Add Python type hints and mypy check, not for variables and properties as we're still supporting Python 3.5
setup.py: revert commit 3d7ab9b that forced the
urllib3
version installed as it's not needed anymoretests/docs: unify usage of
example.com
domain
v0.0.20 (2019-03-06)¶
New features¶
ipmi: add password reset functionality
Minor improvements¶
elasticsearch: upgrade rows one after the other
remote: suppress Cumin's output. As a workaround for a regression in colorama for stretch
Expose hostname from Reason.
elasticsearch: use the admin Reason to get current hostname
Bug Fixes¶
debmonitor: fix missing variable for logging line
elasticsearch: fix typo (xarg instead of xargs)
doc: fix reStructuredText formatting
Miscellanea¶
Drop support for Python 3.4
Add support for Python 3.7
tests: refactor tox environments
v0.0.19 (2019-02-21)¶
Bug Fixes¶
elasticsearch: support cluster names which have
-
in them.elasticsearch:
get_next_clusters_nodes()
raisesElasticsearchClusterError
.elasticsearch: systemctl iterates explicitly on elasticsearch instances.
Miscellanea¶
setup.py: add
long_description_content_type
.
v0.0.17 (2019-02-20)¶
Minor improvements¶
icinga: add
remove_on_error
parameter to thehosts_downtimed()
context manager to decide wether to remove the downtime or not on error.
Bug Fixes¶
elasticsearch: raise logging level to ERROR for elasticsearch
elasticsearch: retry on all urllib3 exceptions
v0.0.16 (2019-02-18)¶
Bug Fixes¶
elasticsearch: retry on TransportError while waiting for node to be up
Change !log formatting to match Stashbot expectations.
v0.0.14 (2019-02-13)¶
New features¶
icinga: add context manager for downtimed hosts:
Add a context manager to allow to execute other commands while the hosts are downtimed, removing the downtime at the end.
management: add management module:
Add a management module with a
Management
class to interact with the management console names.For now just add a
get_fqdn()
method to automatically calculate the management FQDN for a given hostname.
puppet: add
check_enabled()
andcheck_disabled()
methods.decorators: make
retry()
DRY-RUN aware:When running in DRY-RUN mode no real changes are done and usually the
@retry
decorated methods are checking for some action to be propagated or completed. Hence when in DRY-RUN mode they tend to fail and retry until the tries attempts are exhausted, adding unnecessary time to the DRY-RUN.With this patch the
retry()
decorator is able to automagically detect if it's a DRY-RUN mode when called by any instance method that has aself._dry_run
property or, in the special case ofRemoteHostsAdapter
derived instances, it has aself._remote_hosts._dry_run
property.
puppet: add
delete()
method to remove a host from PuppetDB and clean up everything on the Puppet master.spicerack: expose the
icinga_master_host
property.administrative: add
owner
getter to Reason class:Add a public getter for the owner part of a reason, that retuns in a standard format the user running the code and the host where it's running.
Minor improvements¶
decorators: improve tests.
documentation: fine-tune generated documentation.
Bug Fixes¶
dns: remove unused
dry_run
argument.Add missing timeout to requests calls.
dns: fix logging message.
elasticsearch_cluster: change
is_green()
implementation.elasticsearch_cluster: fix issues found during live tests.
spicerack: fix
__version__
.ipmi: fix typos in docstrings.
v0.0.12 (2019-01-10)¶
New features¶
ipmi: add support for DRY RUN mode
config: add load_ini_config() function to parse INI files.
debmonitor: use the existing configuration file
Instead of requiring a new configuration file, use the existing one already setup by Puppet for the debmonitor client.
Inject the path of the Debmonitor config into the ctor with a default value.
puppet: add default
batch_size
when running puppetAllow to specify the
batch_size
when running puppet on a set of hosts.Add a default
batch_size
to avoid to overload the Puppet master hosts.
Bug Fixes¶
phabricator: remove unneded pylint ignore
mediawiki: update maintenance host Cumin query
remote: add workaround for Cumin bug
To avoid unnecessary waiting on the most common use case of
reboot()
, that is with only one host, unset the defaultbatch_sleep
as a workaround for T213296.
puppet: fix regenerate_certificate()
When re-generating the certificate, Puppet will exit with status code
1
both if successful or on failure.Restrict the accepted exit codes to
1
.Detect errors in the output and raises if any.
v0.0.11 (2019-01-08)¶
New features¶
debmonitor: add debmonitor module
phabricator: add phabricator module
Bug Fixes¶
icinga: fix
command_file
propertypuppet: fix
subprocess
call tocheck_output()
dns: include
NXDOMAIN
in theDnsNotFound
exceptionadmin_reason: fix default value for task
v0.0.10 (2018-12-19)¶
API breaking changes¶
cookbook: split main into
argument_parser()
andrun()
.remote: refactor
Remote.query()
API.
New features¶
Add administrative module.
dns: add dns module.
Add elasticsearch_cluster module.
Add Icinga module.
Add ipmi module.
Add Puppet module.
puppet: add additional methods to
PuppetHosts
.puppet: add PuppetMaster class.
remote: add more host functionalities.
Minor improvements¶
doc: add documentation and its generation.
interactive: add
ensure_shell_is_durable()
.
Bug Fixes¶
administrative: fix Reason's signature
elasticsearch_cluster: fix tests for Python 3.5.
icinga: fix typo in test docstring.
interactive: check TTY in
ask_confirmation()
.mediawiki: kill also HHVM on stop_cronjobs.
Fix typo in README.rst.
tests: fix randomly failing pylint check.
Miscellanea¶
setup.py: update curator version to match our current elasticsearch version.
setup.py: force
urllib3
version.tests: fix lint ignore.
v0.0.9 (2018-09-12)¶
Minor improvements¶
mediawiki: improve siteinfo checks.
dnsdisc: improve TTL checks.
exceptions: add
SpicerackCheckError
.tests: improve prospector tests.
Bug Fixes¶
dnsdisc: catch dnspython exceptions.
setup.py: add missing fields and fix missing comma.
v0.0.8 (2018-09-10)¶
Minor improvements¶
mediawiki: ignore exit codes on stop_cronjobs.
logging: minor improvements and a fix.
v0.0.6 (2018-09-06)¶
Minor improvements¶
log: remove relic from switchdc.
mysql: refactor sync check to avoid GTID.
v0.0.4 (2018-09-04)¶
New features¶
Add redis_cluster module.
dnsdisc:
add methods for checking if a datacenter can be depooled.
add a
pool()
anddepool()
methods.
mediawiki:
improve
stop_cronjobs()
method.add
check_cronjobs_disabled()
method.refactor to use confctl's
set_and_verify()
.split
set_readonly()
and add checks.
mysql:
add
get_dbs()
method.rename the
ensure_core_masters_in_sync()
method.
confctl: add
set_and_verify()
method.