Puppet Class: aqs

Defined in:
modules/aqs/manifests/init.pp

Overview

SPDX-License-Identifier: Apache-2.0

Class: aqs

AQS is the Analytics Query Service, a service serving page view data

Parameters

cassandra_user

Cassandra user name.

cassandra_password

Cassandra password.

seeds

Array of cassandra hosts (IP or host names) to contact. Default: ['localhost']

cassandra_default_consistency

Default cassandra query consistency level. Typically 'one' or 'localQuorum'. Default: 'localQuorum'.

cassandra_local_dc

Which DC should be considered local. Default: 'datacenter1'.

cassandra_datacenters

The full list of member datacenters.

port

Port where to run the AQS service. Default: 7232

rsyslog_port

Rsyslog localhost port. Default: 10514

logging_level

The logging level. One of ['trace','debug','info','warn','error','fatal'] Default: 'warn'

statsd_host

statsd host name. Default: localhost

statsd_port

statsd port. Default: 8125

druid_properties

Dictionary containing configuration variables that will end up in the aqs config yaml file.

druid_datasources

Dictionary containing all the datasource names configured in Druid for any given AQS one. Rendered only if druid_properties is configured.

druid_uri_pattern

druid broker uri pattern for hyperswitch acceptance. Default: undef

git_deploy

Avoid scap and use git to deploy the repository. This is useful when dealing with testing environments like cloud where it is not easy to bootstrap a deployment server.

Parameters:

  • cassandra_user (Any) (defaults to: 'cassandra')
  • cassandra_password (Any) (defaults to: 'cassandra')
  • seeds (Any) (defaults to: [$::ipaddress])
  • cassandra_default_consistency (Any) (defaults to: 'localQuorum')
  • cassandra_local_dc (Any) (defaults to: 'datacenter1')
  • cassandra_datacenters (Any) (defaults to: [ 'datacenter1' ])
  • port (Any) (defaults to: 7232)
  • salt_key (Any) (defaults to: 'secretkey')
  • page_size (Any) (defaults to: 250)
  • rsyslog_port (Any) (defaults to: 10514)
  • logging_level (Any) (defaults to: 'warn')
  • statsd_host (Any) (defaults to: 'localhost')
  • statsd_port (Any) (defaults to: 8125)
  • druid_properties (Any) (defaults to: undef)
  • druid_datasources (Any) (defaults to: undef)
  • druid_uri_pattern (Any) (defaults to: undef)
  • contact_groups (Any) (defaults to: 'admins,team-data-platform')
  • git_deploy (Boolean) (defaults to: false) 


60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
 
# File 'modules/aqs/manifests/init.pp', line 60

class aqs(
    $cassandra_user                = 'cassandra',
    $cassandra_password            = 'cassandra',
    $seeds                         = [$::ipaddress],
    $cassandra_default_consistency = 'localQuorum',
    $cassandra_local_dc            = 'datacenter1',
    $cassandra_datacenters         = [ 'datacenter1' ],
    $port                          = 7232,
    $salt_key                      = 'secretkey',
    $page_size                     = 250,
    $rsyslog_port                  = 10514,
    $logging_level                 = 'warn',
    $statsd_host                   = 'localhost',
    $statsd_port                   = 8125,
    $druid_properties              = undef,
    $druid_datasources             = undef,
    $druid_uri_pattern             = undef,
    $contact_groups                = 'admins,team-data-platform',
    Boolean $git_deploy            = false,
) {

    $deployment = $git_deploy ? {
        true  => 'git',
        false => 'scap3',
    }

    service::node { 'aqs':
        # https://phabricator.wikimedia.org/T360522: we're stoppping AQS 1.0, but not the associated
        # Cassandra cluster
        enable          => false,

        port            => $port,
        repo            => 'analytics/aqs/deploy',
        config          => template('aqs/config.yaml.erb'),
        full_config     => true,
        no_file         => 200000,
        healthcheck_url => '/analytics.wikimedia.org/v1',
        has_spec        => true,
        local_logging   => false,
        auto_refresh    => false,
        init_restart    => false,
        deployment      => $deployment,
        contact_groups  => $contact_groups,
        # A ham-fisted break-fix for T349228
        environment     => {
            'NODE_PATH' => '/srv/deployment/analytics/aqs/deploy/node_modules:/srv/deployment/analytics/aqs/deploy/src',
        },
    }

}