All Projects → voxpupuli → puppet-kafka

voxpupuli / puppet-kafka

Licence: MIT license
The kafka module for managing the installation and configuration of Apache Kafka

Programming Languages

Puppet
460 projects
ruby
36898 projects - #4 most used programming language
shell
77523 projects
HTML
75241 projects
Dockerfile
14818 projects

Projects that are alternatives of or similar to puppet-kafka

puppet-logstash
Puppet module to manage Logstash
Stars: ✭ 193 (+543.33%)
Mutual labels:  puppet, linux-puppet-module
puppet-network
Types and providers to manage network interfaces
Stars: ✭ 69 (+130%)
Mutual labels:  puppet, linux-puppet-module
puppet-stash
A puppet module to install atlassian stash
Stars: ✭ 19 (-36.67%)
Mutual labels:  puppet, linux-puppet-module
puppet-dhcp
Puppet module for deploying dhcp
Stars: ✭ 41 (+36.67%)
Mutual labels:  puppet, linux-puppet-module
puppet-hiera
Hiera hierarchy module for templating `hiera.yaml`
Stars: ✭ 32 (+6.67%)
Mutual labels:  puppet, linux-puppet-module
puppet-postfix
Puppet postfix module
Stars: ✭ 72 (+140%)
Mutual labels:  puppet, linux-puppet-module
puppet-mrepo
Puppet module for creating and managing RPM based repository mirrors.
Stars: ✭ 17 (-43.33%)
Mutual labels:  puppet, linux-puppet-module
puppet-jira
Atlassian JIRA Puppet Module
Stars: ✭ 62 (+106.67%)
Mutual labels:  puppet, linux-puppet-module
puppet-kmod
manage kernel module with puppet
Stars: ✭ 18 (-40%)
Mutual labels:  puppet, linux-puppet-module
puppet-kibana
Kibana Puppet module by Elastic.
Stars: ✭ 17 (-43.33%)
Mutual labels:  puppet, linux-puppet-module
puppet-vmwaretools
Puppet module to manage VMware Operating System Specific Packages for VMware tools installation.
Stars: ✭ 34 (+13.33%)
Mutual labels:  puppet, linux-puppet-module
puppet-keepalived
Puppet Module to manage Keepalived
Stars: ✭ 47 (+56.67%)
Mutual labels:  puppet, linux-puppet-module
puppet-rundeck
Module for managing the installatation and configuration of the rundeck orchestration tool
Stars: ✭ 37 (+23.33%)
Mutual labels:  puppet, linux-puppet-module
puppet-openldap
Manage OpenLDAP with Puppet
Stars: ✭ 35 (+16.67%)
Mutual labels:  puppet, linux-puppet-module
puppet-snmp
Puppet module to manage Net-SNMP.
Stars: ✭ 33 (+10%)
Mutual labels:  puppet, linux-puppet-module
puppet-puppetserver
Puppet module for puppetserver
Stars: ✭ 21 (-30%)
Mutual labels:  puppet, linux-puppet-module
puppet-posix acl
A puppet module for POSIX ACLs
Stars: ✭ 15 (-50%)
Mutual labels:  puppet, linux-puppet-module
puppet-prometheus
Puppet module for prometheus
Stars: ✭ 56 (+86.67%)
Mutual labels:  puppet, linux-puppet-module
puppet-elasticsearch
Elasticsearch Puppet module
Stars: ✭ 406 (+1253.33%)
Mutual labels:  puppet, linux-puppet-module
puppet-healthcheck
Puppet resources to evaluate the health and status of things.
Stars: ✭ 22 (-26.67%)
Mutual labels:  puppet, linux-puppet-module

Kafka module for Puppet

Build Status Release Puppet Forge Puppet Forge - downloads Puppet Forge - endorsement Puppet Forge - scores puppetmodule.info docs MIT License Donated by Liam Bennett

Table of Contents

  1. Overview
  2. Module Description - What the module does and why it is useful
  3. Setup - The basics of getting started with Kafka
  4. Usage - Configuration options and additional functionality
  5. Reference - An under-the-hood peek at what the module is doing and how
  6. Limitations - OS compatibility, etc.
  7. Development - Guide for contributing to the module

Overview

The Kafka module for managing the installation and configuration of Apache Kafka.

Module Description

The Kafka module for managing the installation and configuration of Apache Kafka: it's brokers, producers and consumers.

Setup

What Kafka affects

Installs the Kafka package and creates a new service.

Setup requirements

This module has the following dependencies:

Beginning with Kafka

To successfully install Kafka using this module you need to have Apache ZooKeeper already running at localhost:2181. You can specify another ZooKeeper host:port configuration using the config hash of the kafka::broker class.

The default configuration installs Kafka 0.11.0.3 binaries with Scala 2.11:

  class { 'kafka': }

If you want a Kafka broker server that connects to ZooKeeper listening on port 2181:

  class { 'kafka::broker':
    config => {
      'broker.id'         => '0',
      'zookeeper.connect' => 'localhost:2181'
    }
  }

Usage

You can specify different Kafka binaries packages versions to install. Please take a look at the different Scala and Kafka versions combinations at the Apache Kafka Website

Installing Kafka version 1.1.0 with scala 2.12

We first install the binary package with:

  class { 'kafka':
    version => '1.1.0',
    scala_version => '2.12'
  }

Then we set a minimal Kafka broker configuration with:

  class { 'kafka::broker':
    config => {
      'broker.id'         => '0',
      'zookeeper.connect' => 'localhost:2181'
    }
  }

Reference

The reference documentation of this module is generated using puppetlabs/puppetlabs-strings.

Limitations

This module only supports Kafka >= 0.9.0.0.

This module is tested on the following platforms:

  • Debian 8
  • Debian 9
  • Debian 10
  • Ubuntu 16.04
  • Ubuntu 18.04
  • CentOS 7

It is tested with the OSS version of Puppet (>= 5.5) only.

Development

This module has grown over time based on a range of contributions from people using it. If you follow these contributing guidelines your patch will likely make it into a release a little more quickly.

Author

This module is maintained by Vox Pupuli. It was originally written and maintained by Liam Bennett.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].