Forge Home

hadoop

Base install of Hadoop Common/Core Package

8,184 downloads

8,184 latest version

3.1 quality score

Version information

  • 0.1.0 (latest)
released Sep 18th 2015
This version is compatible with:
  • Puppet Enterprise 3.x
  • Puppet >=2.7.20 <4.0.0
  • , , ,

Start using this module

  • r10k or Code Manager
  • Bolt
  • Manual installation
  • Direct download

Add this module to your Puppetfile:

mod 'swizzley88-hadoop', '0.1.0'
Learn more about managing modules with a Puppetfile

Add this module to your Bolt project:

bolt module add swizzley88-hadoop
Learn more about using this module with an existing project

Manually install this module globally with Puppet module tool:

puppet module install swizzley88-hadoop --version 0.1.0

Direct download is not typically how you would use a Puppet module to manage your infrastructure, but you may want to download the module in order to inspect the code.

Download
Tags: common, hadoop, core

Documentation

swizzley88/hadoop — version 0.1.0 Sep 18th 2015

hadoop

Puppet Forge

Table of Contents

  1. Overview
  2. Setup
  3. Usage
  4. Requirements
  5. Compatibility
  6. Limitations
  7. Development

Overviw

Hadoop Module for setup of Core/Common Hadoop Package on Linux systems.

Setup

This could take a while to run, the current version is 200MB, others are smaller and you can specify which to use in params as well as the url for the mirror that works best. The latest version of artifact has no exec timeout, so that the file will eventually download.

include ::hadoop

Usage

New fact $::java_home added for finding and setting $JAVA_HOME

  • $version: [default: 2.7.1] which is current stable at the time of this module release

  • $package: Specify Core or Common Package [default: common]

  • target: Download directory [default: /tmp]

  • install_dir: Installation path [default: /opt/hadoop]

  • java_dist: Java installation for use when installing java via puppetlabs/java [default: undef] which is effectively jdk

  • java_pkg: Specify a java package to pass to puppetlabs/java [default: undef]

  • java_ver: Specify a java version to pass to puppetlabs/java [default: 'present']

  • owner: Owner of hadoop directory and files [default: hadoop]

  • group: Group of hadoop directory and files [default: hadoop]

Requirements

  • pupptlabs/java
  • puppetlabs/stdlib
  • swizzley88/artifact

Compatibility

Linux:

  • RHEL/CentOS/Fedora/Oracle/Scientific
  • Debian/Ubuntu

Tested On: CentOS 6.6 (used in production)

Limitations

If installing java using this module which uses the puppetlabs/java module, puppet will need to run twice before $JAVA_HOME can be set to the valid value of $::java_home, because facter gets read before java is installed. If java is already installed, it will work the first run.

Development

I'd like to add zookeeper, hbase, hive, pig and other parameters and manifests, but there are other modules for that already, and the cloudera modules is already puppet approved, so we'll just see where this goes.