hadoop

Base install of Hadoop Common/Core Package

Dustin Morgan

swizzley88

7,484 downloads

7,484 latest version

3.1 quality score

Version information

  • 0.1.0 (latest)
released Sep 18th 2015
This version is compatible with:
  • Puppet Enterprise 3.x
  • Puppet >=2.7.20 <4.0.0
  • RedHat
    ,
    CentOS
    ,
    Debian
    ,
    Ubuntu

Start using this module

Documentation

swizzley88/hadoop — version 0.1.0 Sep 18th 2015

hadoop

Puppet Forge

Table of Contents

  1. Overview
  2. Setup
  3. Usage
  4. Requirements
  5. Compatibility
  6. Limitations
  7. Development

Overviw

Hadoop Module for setup of Core/Common Hadoop Package on Linux systems.

Setup

This could take a while to run, the current version is 200MB, others are smaller and you can specify which to use in params as well as the url for the mirror that works best. The latest version of artifact has no exec timeout, so that the file will eventually download.

include ::hadoop

Usage

New fact $::java_home added for finding and setting $JAVA_HOME

  • $version: [default: 2.7.1] which is current stable at the time of this module release

  • $package: Specify Core or Common Package [default: common]

  • target: Download directory [default: /tmp]

  • install_dir: Installation path [default: /opt/hadoop]

  • java_dist: Java installation for use when installing java via puppetlabs/java [default: undef] which is effectively jdk

  • java_pkg: Specify a java package to pass to puppetlabs/java [default: undef]

  • java_ver: Specify a java version to pass to puppetlabs/java [default: 'present']

  • owner: Owner of hadoop directory and files [default: hadoop]

  • group: Group of hadoop directory and files [default: hadoop]

Requirements

  • pupptlabs/java
  • puppetlabs/stdlib
  • swizzley88/artifact

Compatibility

Linux:

  • RHEL/CentOS/Fedora/Oracle/Scientific
  • Debian/Ubuntu

Tested On: CentOS 6.6 (used in production)

Limitations

If installing java using this module which uses the puppetlabs/java module, puppet will need to run twice before $JAVA_HOME can be set to the valid value of $::java_home, because facter gets read before java is installed. If java is already installed, it will work the first run.

Development

I'd like to add zookeeper, hbase, hive, pig and other parameters and manifests, but there are other modules for that already, and the cloudera modules is already puppet approved, so we'll just see where this goes.