Forge Home

proxysql

Module to install and configure ProxySQL

133,945 downloads

8,978 latest version

4.3 quality score

We run a couple of automated
scans to help you access a
module's quality. Each module is
given a score based on how well
the author has formatted their
code and documentation and
modules are also checked for
malware using VirusTotal.

Please note, the information below
is for guidance only and neither of
these methods should be considered
an endorsement by Puppet.

Version information

  • 6.0.0 (latest)
  • 5.1.0
  • 5.0.3
  • 5.0.2
  • 5.0.1
  • 5.0.0
  • 4.0.0
  • 3.1.0
  • 3.0.0
  • 2.0.0
  • 1.1.2
  • 1.1.1
  • 1.1.0
released Feb 11th 2017
This version is compatible with:
  • Puppet Enterprise 2017.2.x, 2017.1.x, 2016.5.x, 2016.4.x
  • Puppet >= 4.6.1 < 5.0.0

Start using this module

  • r10k or Code Manager
  • Bolt
  • Manual installation
  • Direct download

Add this module to your Puppetfile:

mod 'puppet-proxysql', '1.1.0'
Learn more about managing modules with a Puppetfile

Add this module to your Bolt project:

bolt module add puppet-proxysql
Learn more about using this module with an existing project

Manually install this module globally with Puppet module tool:

puppet module install puppet-proxysql --version 1.1.0

Direct download is not typically how you would use a Puppet module to manage your infrastructure, but you may want to download the module in order to inspect the code.

Download

Documentation

puppet/proxysql — version 1.1.0 Feb 11th 2017

Table of Contents

  1. Overview
  2. Setup - The basics of getting started with proxysql
  3. Usage - Configuration options and additional functionality
  4. Reference - An under-the-hood peek at what the module is doing and how
  5. Limitations - OS compatibility, etc.
  6. Development - Guide for contributing to the module

Overview

Build Status Code Coverage Puppet Forge Puppet Forge - downloads Puppet Forge - endorsement Puppet Forge - scores

The proxysql module installs, configures and manages the ProxySQL service.

This module will install the ProxySQL and manage it's configuration. It also extends Puppet to be able to manage mysql_users, mysql_servers, mysql_replication_hostgroups, mysql_query_rules, scheduler and global_variables.

Setup

Setup Requirements OPTIONAL

The module requires Puppet 4.x and currently supports only Debian 8 "Jessie" (and possibly Debian 7 "Wheezy").

Note: the ProxySQL-package is currently not in any public upstream package manager. So you should consider uploading it to a private package manager and manage that before calling the proxysql-class.

Beginning with proxysql

To install the ProxySQL software with all the default options:

include ::proxysql

You can customize options such as (but not limited to) listen_port, admin_password, monitor_password, ...

  class { '::proxysql':
    listen_port              => 3306,
    admin_password           => '654321',
    monitor_password         => '123456',
    override_config_settings => $override_settings,
    repo                     => {
      'debs_proxysql_repo' => {
        comment  => 'ProxySQL repo',
        location => 'http://debs.example.tld/debian',
        repos    => 'proxsql',
      },
    },
  }

Usage

Configuration is done by the proxysql class.

Customize config settings

You can override any configuration setting by using the override_config_settings hash. This hash resembles the structure of the proxysql.cnf file

{
    admin_variables => {
      refresh_interval => 2000,
      ...
    },
    mysql_variables => {
      monitor_writer_is_also_reader => false,
      ...
    },
    mysql_servers => {
      'mysql1' => {
         'address' => '127.0.0.1',
         'port'    => 33061,
       },
      'mysql2' => {
         'address' => '127.0.0.1',
         'port'    => 33062,
       },
      ...
    },
    mysql_users => { ... },
    mysql_query_rules => { ... },
    scheduler => { ... },
    mysql_replication_hostgroups => { ... },

}

Reference

Public classes

  • proxysql: Installs and configures ProxySQL

Private classes

  • proxysql::install: Installs the package(s)
  • proxysql::config: Manages the configuration files and global_variables
  • proxysql::repo: Manages the repo's where ProxySQL might be in.
  • proxysql::service: Manages the service

parameters

proxysql

package_name

The name of the ProxySQL package in your package manager. Defaults to 'proxysql'

service_name

The name of the ProxySQL service resource. Defaults to 'proxysql'

datadir

The directory where ProxySQL will store it's data. defaults to '/var/lib/proxysql'

listen_ip

The ip where the ProxySQL service will listen on. Defaults to '0.0.0.0' aka all configured IP's on the machine

listen_port

The port where the ProxySQL service will listen on. Defaults to '6033'

listen_socket

The socket where the ProxySQL service will listen on. Defaults to '/tmp/proxysql.sock'

admin_username

The username to connect to the ProxySQL admin interface. Defaults to 'admin'

admin_password

The password to connect to the ProxySQL admin interface. Defaults to 'admin'

admin_listen_ip

The ip where the ProxySQL admin interface will listen on. Defaults to '127.0.0.1'

admin_listen_port

The port where the ProxySQL admin interface will listen on. Defaults to '6032'

admin_listen_socket

The socket where the ProxySQL admin interface will listen on. Defaults to '/tmp/proxysql_admin.sock'

monitor_username

The username ProxySQL will use to connect to the configured mysql_servers. Defaults to 'monitor'

monitor_password

The password ProxySQL will use to connect to the configured mysql_servers. Defaults to 'monitor'

config_file

The file where the ProxySQL configuration is saved. This will only be configured if manage_config_file is set to true. Defaults to '/etc/proxysql.cnf'

manage_config_file

Determines wheter this module will configure the ProxySQL configuration file. Defaults to 'true'

mycnf_file_name

Path of the my.cnf file where the connections details for the admin interface is save. This is required for the providers to work. This will only be configured if manage_mycnf_file is set to true. Defaults to '/root/.my.cnf'

manage_mycnf_file

Determines wheter this module will configure the my.cnf file to connect to the admin interface. Defaults to 'true'

restart

Determines wheter this module will restart ProxySQL after reconfiguring the config file. Defaults to 'false'

load_to_runtime

Specifies wheter te managed ProxySQL resources should be immediately loaded to the active runtime. Boolean, defaults to 'true'.

save_to_disk

Specifies wheter te managed ProxySQL resources should be immediately save to disk. Boolean, defaults to 'true'.

repo

These are the repo's we will configure. Currently only Debian is supported. This hash will be passed on to apt::source. Defaults to {}.

manage_repo

Boolean to determine wheter we want to configure the repo management. Defaults to true.

override_config_settings

Which configuration variables should be overriden. Hash, defaults to {} (empty hash).

Types

proxy_global_variable

proxy_global_variable manages a variable in the ProxySQL global_variables admin table.

name

The name of the variable.

load_to_runtime

Specifies wheter the resource should be immediately loaded to the active runtime. Boolean, defaults to 'true'.

save_to_disk

Specifies wheter the resource should be immediately save to disk. Boolean, defaults to 'true'.

value

The value of the variable.

proxy_mysql_replication_hostgroup

proxy_mysql_replication_hostgroup manages an entry in the ProxySQL mysql_replication_hostgroups admin table.

ensure

Whether the resource is present. Valid values are 'present', 'absent'. Defaults to 'present'.

name

Name to describe the hostgroup config. Must be in a 'writer_hostgroup-reader_hostgroup' format.

load_to_runtime

Specifies wheter the resource should be immediately loaded to the active runtime. Boolean, defaults to 'true'.

save_to_disk

Specifies wheter the resource should be immediately save to disk. Boolean, defaults to 'true'.

writer_hostgroup

Id of the writer hostgroup. Required.

reader_hostgroup

Id of the reader hostgroup. Required.

comment

Optional comment.

proxy_mysql_server

proxy_mysql_server manages an entry in the ProxySQL mysql_servers admin table.

ensure

Whether the resource is present. Valid values are 'present', 'absent'. Defaults to 'present'.

name

Name to describe the hostgroup config. Must be in a 'hostname:port-hostgroup_id' format.

load_to_runtime

Specifies wheter the resource should be immediately loaded to the active runtime. Boolean, defaults to 'true'.

save_to_disk

Specifies wheter the resource should be immediately save to disk. Boolean, defaults to 'true'.

hostgroup_id

Id of the hostgroup this server wil be configured to be part of. Integer value, required.

hostname

Hostname of the server. Required.

port

Port of the server. Required. Defaults to 3306.

status

Status of the server. Should be one of the following values: 'ONLINE', 'OFFLINE_SOFT', 'OFFLINE_HARD', 'SHUNNED'. Defaults to 'ONLINE'.

weight

Weight value of the server. The higher the value, the higher the probability this server will be chosen from the hostgroup. Integer, defaults to 0.

compression

Compression value of the serer. If the value is greater than 0, new connections to that server will use compression. Integer, defaults to 0.

max_connections

The maximum number of connections ProxySQL will open to this backend server. Even though this server will have the highest weight, no new connections will be opened to it once this limit is hit. Please ensure that the backend is configured with a correct value of max_connections to avoid that ProxySQL will try to go beyond that limit. Integer, defaults to 1000.

max_replication_lag

If greater and 0, ProxySQL will reguarly monitor replication lag and if it goes beyond such threshold it will temporary shun the host until replication catch ups. Integer, defaults to 0.

use_ssl

If set to 1, connections to the backend will use SSL. Values 0 or 1. Defaults to 0.

max_latency_ms

Ping time is regularly monitored. If a host has a ping time greater than max_latency_ms it is excluded from the connection pool (although the server stays ONLINE. Integer, defaults to 0.

comment

Optional comment.

proxy_mysql_user

proxy_mysql_user manages an entry in the ProxySQL mysql_users admin table.

ensure

Whether the resource is present. Valid values are 'present', 'absent'. Defaults to 'present'.

name

Username for the user. Required.

load_to_runtime

Specifies wheter the resource should be immediately loaded to the active runtime. Boolean, defaults to 'true'.

save_to_disk

Specifies wheter the resource should be immediately save to disk. Boolean, defaults to 'true'.

encrypt_password

Specifies wheter the user password should be encrypted (requires ProxySQL setting admin-hash_password = true). Boolean, defaults to 'true'.

password

Password for the user. Required. Note: you should make sure that the global variable admin-hashed_passwords is set to true and then encrypt this password using the mysql_password() function.

active

Flag to determine if this user is active or not. Values 0 or 1. Defaults to 1.

use_ssl

Flag to determine if this user uses SSL or not. Values 0 or 1. Defaults to 0.

default_hostgroup

Default hostgroup for the user. Integer, defaults to 0.

default_schema

Default schema for the user. String, defaults to ''.

schema_locked

Is the user locked in the default_schema or not. Values 0 or 1. Defaults to 0.

transaction_persistent

Disable routing across hostgroups once a transaction has started for a specific user. Values 0 or 1. Defaults to 0.

fast_forward

Flag to determine fast forward or not. Values 0 or 1. Defaults to 0.

backend

Is this a backend user. Values 0 or 1. Defaults to 1.

frontend

Is this a frontend user. Values 0 or 1. Defaults to 1.

proxy_mysql_query_rule

proxy_mysql_query_rule manages an entry in the ProxySQL mysql_query_rules admin table.

ensure

Whether the resource is present. Valid values are 'present', 'absent'. Defaults to 'present'.

name

The name of the query rule entry, Must be in a 'mysql_query_rule-rule_id' format.

load_to_runtime

Specifies wheter the resource should be immediately loaded to the active runtime. Boolean, defaults to 'true'.

save_to_disk

Specifies wheter the resource should be immediately save to disk. Boolean, defaults to 'true'.

rule_id

Id of the scheduler entry. Integer value, required.

active

Is the rule active or not. Boolean value 0 or 1, defaults to 0.

username

Username to apply this rule to. String, defaults to NULL.

schemaname

Schema to apply this rule to. String, defaults to NULL.

flag_in

Used to chain rules. This is the id of the previous rule to apply. Integer, defaults to 0.

flag_out

Used to chain rules. This is the id of the next rule to apply, Integer, defaults to NULL

apply

Used to chain rules.

client_addr

Match traffic from a certain address. String, defaults to NULL.

proxy_addr

Match incoming traffic on a specific local address. String, defaults to NULL.

proxy_port

Match incoming traffic on a specific local port. Integer, defaults to NULL.

digest

match queries with a specific digest, as returned by stats_mysql_query_digest.digest. String, defaults to NULL.

match_digest

regular expression that matches the query digest. String, defaults to NULL.

match_pattern

regular expression that matches the query text. String, defaults to NULL.

replace_pattern

this is the pattern with which to replace the matched pattern. String, defaults to NULL.

negate_match_pattern

if this is set to 1, only queries not matching the query text will be considered as a match. This acts as a NOT operator in front of the regular expression matching against match_pattern or match_digest. Boolean value 0 or 1, defaults to 0.

destination_hostgroup

The hostgroup to send this query to. Integer, defaults to NULL.

cache_ttl

The amount of miliseconds to cache the result of this query. Integer, defaults to NULL.

reconnect

feature currently not in use.

timeout

The maximum amount of miliseconds in which the matched or rewritten query should be executed. Integer, defaults to NULL.

retries

The maximum number of times a query needs to be re-executed in case of detected failure during the execution of the query. Integer, defaults to NULL.

delay

The number of milliseconds to delay the execution of the query. Integer, defaults to NULL.

error_msg

The query will be blocked, and the specified error_msg will be returned to the client. String, defaults to NULL.

log

The query will be logged. Boolean value 0 or 1, defaults to NULL.

mirror_hostgroup

see https://github.com/sysown/proxysql/blob/master/doc/mirroring.md. Integer, defaults to NULL.

mirror_flag_out

see https://github.com/sysown/proxysql/blob/master/doc/mirroring.md. Integer, defaults to NULL.

comment

Optional free form text field, usable for a descriptive comment of the query rule.

proxy_scheduler

proxy_scheduler manages an entry in the ProxySQL scheduler admin table.

ensure

Whether the resource is present. Valid values are 'present', 'absent'. Defaults to 'present'.

name

The name of the scheduler entry, Must be in a 'scheduler-scheduler_id' format.

load_to_runtime

Specifies wheter the resource should be immediately loaded to the active runtime. Boolean, defaults to 'true'.

save_to_disk

Specifies wheter the resource should be immediately save to disk. Boolean, defaults to 'true'.

scheduler_id

Id of the scheduler entry. Integer value, required.

filename

The filename of the scheduler script to run. Required.

interval_ms

Interval in which to run this scheduler. In miliseconds, Integer, defaults to 10000 (10sec).

arg1

The 1st argument for the scheduler script to run. Optional, defaults to NULL.

arg2

The 2nd argument for the scheduler script to run. Optional, defaults to NULL.

arg3

The 3rd argument for the scheduler script to run. Optional, defaults to NULL.

arg4

The 4th argument for the scheduler script to run. Optional, defaults to NULL.

arg5

The 5th argument for the scheduler script to run. Optional, defaults to NULL.

comment

Optional comment.

Limitations

The module requires Puppet 4.x and currently supports only Debian 8 "Jessie" (and possibly Debian 7 "Wheezy"). It depends on the puppetlabs/mysql module (>= 3.x)

Development

This module is originally developed by Matthias Crauwels for use at Ghent University, Belgium. This module is published under the Apache 2.0 license.

We are open to feature requests, bug reports, contributions, etc...

Contributors

Original author: Matthias Crauwels