Forge Home

Modules

Resources

PuppetEcosystemPuppet CommunityUpdates

algosec

DevOps-ify network security management, leveraging AlgoSec's business-driven security policy management solution
Project URLRSS FeedReport issues

4,914 downloads

4,914 latest version

5.0 quality score

We run a couple of automated
scans to help you access a
module's quality. Each module is
given a score based on how well
the author has formatted their
code and documentation and
modules are also checked for
malware using VirusTotal.

Please note, the information below
is for guidance only and neither of
these methods should be considered
an endorsement by Puppet.

Version information

  • 0.1.2 (latest)
released Nov 14th 2018
This version is compatible with:
  • Puppet Enterprise 2019.8.x, 2019.7.x, 2019.5.x, 2019.4.x, 2019.3.x, 2019.2.x, 2019.1.x, 2019.0.x, 2018.1.x, 2017.3.x, 2017.2.x, 2017.1.x, 2016.5.x, 2016.4.x
  • Puppet >= 4.7.0 < 7.0.0
  • , , , , , , , , , ,
Tasks:
  • apply_drafts

Start using this module

  • r10k or Code Manager
  • Bolt
  • Manual installation
  • Direct download

Add this module to your Puppetfile:

mod 'algosec-algosec', '0.1.2'
Learn more about managing modules with a Puppetfile

Add this module to your Bolt project:

bolt module add algosec-algosec
Learn more about using this module with an existing project

Manually install this module globally with Puppet module tool:

puppet module install algosec-algosec --version 0.1.2

Direct download is not typically how you would use a Puppet module to manage your infrastructure, but you may want to download the module in order to inspect the code.

Download

Documentation

algosec/algosec — version 0.1.2 Nov 14th 2018

algosec Build Status codecov

Table of Contents

  1. Module Description - What the module does and why it is useful
  2. Setup - The basics of getting started with AlgoSec
  3. Usage - Configuration options and additional functionality
  4. Reference - An under-the-hood peek at what the module is doing and how
  5. Limitations - OS compatibility, etc.
  6. Development - Guide for contributing to the module

Module Description

Through its application-centric approach, AlgoSec extends security policy management into existing DevOps practices and tools to support the entire DevOps lifecycle — from build, through QA and to deployment into production. This allows for better collaboration between security and the DevOps teams right from the start, and enables faster deployment into production while ensuring that the development and production environments are always secure and compliant.

This module implements the 'Connectivity as Code' approach. It allows application developers to define their application's connectivity requirements as a manifest file, describing the required flows in an abstract way - from point A to point B with port P. Then, the module facilitate a connection to the AlgoSec server and automatically translate these abstract application flows to the underlying network infrastructure. AlgoSec assess which security constructs - firewalls, routers, cloud or SDN security groups, etc. - are in the path, and automatically design the required changes, while ensuring regulatory and corporate compliance is retained.

The module leverages AlgoSec BusinessFlow for application connectivity management, and (indirectly) AlgoSec FireFlow for automated zero-touch security policy change management. This turns network security and connectivity to be DevOps-friendly, and no longer a bottleneck to business agility.

Setup

Install the module on either a Puppet master or Puppet agent machine, by running puppet module install algosec-algosec. To install from source, download the tar file from GitHub and run puppet module install <file_name>.tar.gz --force.

Setup Requirements

The AlgoSec module requires access to the AlgoSec server API. You will also need to install the dependencies.

The module has a dependency on the resource_api puppet module - it will be installed when the module is installed. Alternatively, it can be manually installed by running puppet module install puppetlabs-resource_api, or by following the setup instructions in the Resource API README.

The module also depend upon the algosec-sdk ruby gem that will installed on the agent if using the algosec::agent class provided with this module. Please see the next section for more details.

Manual Test Setup

Once the module has been installed, classify the appropriate class:

  • On each puppetserver or PE master that needs to communicate with the AlgoSec API, classify or apply the algosec::server by running puppet apply -e 'include algosec::server'.
  • On each Puppet agent that needs to communicate with the AlgoSec API, classify or apply the algosec::agent class by running puppet apply -e 'include algosec::agent'.

Getting started with AlgoSec

To get started, create or edit /etc/puppetlabs/puppet/device.conf, add a section for the device (this will become the device's certname), specify a type of algosec, and specify a url to a credentials file. For example:

[local.algosec.com]
type algosec
url file:////etc/puppetlabs/puppet/devices/local.algosec.com.conf

Next, create a credentials file. See the HOCON documentation for information on quoted/unquoted strings and connecting the device.

The credential file should look like this:

  • The basic configuration file contains the host, user, password in plain text, for example:

      host: 10.0.0.10
  user: admin
  password: algosec

  • Two additional fields are optionally available for configuration in the credentials file:

    • ssl_enabled - used in demo environments and can be set to false to allow non certified ssl connections.
    • managed_applications - Used to limit the applications managed by this device to a specific list. If this is not defined, all applications are available to the puppet module.
      host: 10.0.0.10
  user: admin
  password: algosec
  ssl_enabled: false
  managed_applications: [ puppet-app1 puppet-app2 ]

NOTE: Be very careful to define the managed applications when using the automatic purge metadata option to make sure you don't accident delete all of your apps :)

Test your setup and get the certificate signed:

puppet device --verbose --target local.algosec.com

This will sign the certificate and set up the device for Puppet.

See the puppet device documentation

Usage

Now you can manage applications and flows on AlgoSec BusinessFlow and apply application drafts. Full and exact reference can be found at REFERENCE.md.

The repo's acceptance test examples contain a useful reference on the use of the module's Types.

Puppet Device

Simple Usage

To get information from the device, use the puppet device --resource command. For example, to retrieve available BusinessFlow applications on the AlgoSec server, run the following:

puppet device --resource --target local.algosec.com algosec_flow

Note: This will fetch all applications if no managed_applications were defined in the device config. Otherwise, only managed applications will be fetched.

To manage one application and it's flows, write a manifest. Start by making a file named manifest.pp with the following content:

algosec_application { 'some-application':
  ensure => 'present',
} -> algosec_flow {
   'some-application/some flow name':
     sources      => ['192.168.1.1', '10.0.0.1/16'],
     destinations => ['192.168.2.2', '10.0.0.2/16'],
     services     => ['HTTP', 'tcp/456'];
 }

Once this manifest is executed, puppet will ensure that both this application exists and that the flow with this name defined within it with the attributes defined here.

Note: The algosec_application resource currently support only name attribute. Wider support for other application attributes is planned.

Execute the following command:

puppet device --target local.algosec.com --apply manifest.pp

This will apply the manifest. Puppet will check if the address already exists and if it is absent it will create it (idempotency check). When you query for addresses you will see that the new BusinessFlow application is available. To do this, run the following command again:

puppet device --resource --target local.algosec.com algosec_application

Note that if you get errors, run the above commands with --verbose - this will give you error message output.

Applying application drafts

Any changes to AlgoSec BusinessFlow's applications and flows made by puppet through AlgoSec's API will be first staged in what is called application drafts. In that mode, no changes are propagated down the pipeline (e.g. changes will not propagate to AlgoSec FireFlow). Changes will be made "active" when the application draft is applied.

Automatically applying the application drafts following the changes occur by puppet is possible using the algosec_apply_draft resource. This resource is defined within the manifest file and is always defined in the same way. This resource is set to automatically run after all other algosec resources are applied upon the AlgoSec server. To use it, simply add this resource definition to your manifest file:

algosec_apply_draft {
  'apply':
    apply => true
}

Unmanaged Flows / Applications

Experienced Puppet users will notice that the previous example will only ensure that the managed resources exist on AlgoSec BusinessFlow as defined in the manifest.pp.

This section is intended to help users who wish to configure puppet in a way that the flows/applications on AlgoSec will exclusively match those defined in the manifest.pp file. Such a configuration will cause the previous example to not just make sure the defined flow is present, but to also delete all flows which are not defined in the manifest.pp file and are currently defined on the server.

Note: Again, please be very careful to define the managed_applications in the device config when using the automatic purge metadata option. Otherwise, ALL all flows/apps which are not defined in your manifest will be deleted from BusinessFlow.

To properly configure puppet we use the built-in puppet purge method. A good working example for a manifest that trigger deletion of all undefined flows can be found in the module's acceptance tests

To take from our previous example in this README, a manifest that will delete all flows which are not defined in it will look like this:

resources { 'algosec_flow':
  purge => true
}

algosec_application { 'some-application':
  ensure => 'present',
} -> algosec_flow {
   'some-application/some flow name':
     sources      => ['192.168.1.1', '10.0.0.1/16'],
     destinations => ['192.168.2.2', '10.0.0.2/16'],
     services     => ['HTTP', 'tcp/456'];
 }

Tasks

The AlgoSec module define currently one task algosec::apply_drafts. When executed, it will apply any outstanding drafts of the managed applications (as defined in the device.conf). To execute the task against the AlgoSec server using the device config, run:

Before running this task, install the module on your machine, along with Puppet Bolt. When complete, execute the following command:

bolt task run algosec::apply_drafts --nodes localhost --transport local --modulepath <module_installation_dir> --params @credentials.json

The --modulepath param can be retrieved by typing puppet config print modulepath. The credentials file needs to be valid JSON parallel to the fields defined in the device.conf described in the Getting started section.

Reference

For full type reference documentation, see the REFERENCE.md

Limitations

This module has only been tested with AlgoSec 2017.2 and up.

Development

Contributions are welcome, especially if they can be of use to other users.

Checkout the repo by forking and creating your feature branch.

Type

Use the pdk tool to create new types/providers as you fit. Good candidates are BusinessFlow's Network Objects, Network Services and the similar if you find it useful for your organization. We use the Resource API format.

The first command to start creating new types is pdk new provider type_name. This will create 4 new files - one for the provider, the type and corresponding unit test files.

Provider

See the Type section above. We use the Puppet Resource API for types and providers.

Testing

There are two levels of testing found under spec.

To test this module's with acceptance tests you will need to have an AlgoSec machine available. The demo machine from our download area work fine in VirtualBox and VMware.

Unit Testing

Unit tests test the parsing and command generation logic, executed locally.

First execute pdk bundle exec rake spec to ensure that the local types are made available to the spec tests. Then execute with bundle exec rake spec.

Acceptance Testing

Acceptance tests are executed on actual AlgoSec running server.

Use test application and make sure that these are non-destructive.

The acceptance tests locate AlgoSec box that is used for testing through environment variables:

  • Set ALGOSEC_TEST_HOST to the FQDN/IP of the box.
  • To specify the username and password used to connect to the box:
    • ALGOSEC_TEST_USER
    • ALGOSEC_TEST_PASSWORD.

AlgoSec's Demo VMs default to admin/algosec, which is also used as a default, if you don't specify anything.

After you have configured the system under test, you can run the acceptance tests directly using:

pdk bundle exec rspec spec/acceptance

Cutting a release

To cut a new release, from a current master checkout:

pdk bundle exec rake 'strings:generate[,,,,,REFERENCE.md,true]'
  • Make sure that all PRs are tagged appropriately