Kafka-Operator

The Banzai Cloud Kafka operator is a Kubernetes operator to automate provisioning, management, autoscaling and operations of Apache Kafka clusters deployed to K8s.

Overview

Apache Kafka is an open-source distributed streaming platform, and some of the main features of the Kafka-operator are:

• the provisioning of secure and production ready Kafka clusters
• fine grained broker configuration support
• advanced and highly configurable External Access via LoadBalancers using Envoy
• graceful Kafka cluster scaling and rebalancing
• monitoring via Prometheus
• encrypted communication using SSL
• automatic reaction and self healing based on alerts (plugin system, with meaningful default alert plugins) using Cruise Control
• graceful rolling upgrade
• advanced topic and user management via CRD

We took a different approach to what's out there - we believe for a good reason - please read on to understand more about our design motivations and some of the scenarios which were driving us to create the Banzai Cloud Kafka operator.

The Banzai Cloud Kafka operator is a core part of Banzai Cloud Supertubes that helps you create production-ready Kafka cluster on Kubernetes, with scaling, rebalancing, and alerts based self healing. While the Kafka operator itself is an open-source project, the Banzai Cloud Supertubes product extends the functionality of the Kafka operator with commercial features (for example, built-in monitoring and multiple ways of disaster recovery). Read a detailed comparison of Supertubes and the Kafka operator.

Installation

For detailed installation instructions, see the Banzai Cloud Documentation Page.

Documentation

The documentation of the Kafka operator project is available at the Banzai Cloud Documentation Page.

Support

The Banzai Cloud Kafka operator is a core part of Banzai Cloud Supertubes that helps you create production-ready Kafka cluster on Kubernetes, with scaling, rebalancing, and alerts based self healing. While the Kafka operator itself is an open-source project, the Banzai Cloud Supertubes product extends the functionality of the Kafka operator with commercial features (for example, built-in monitoring and multiple ways of disaster recovery). Read a detailed comparison of Supertubes and the Kafka operator.

Community support

If you encounter problems while using the Kafka operator the documentation does not address, open an issue or talk to us on the Banzai Cloud Slack channel #kafka-operator.

Commercial support

If you are using the Kafka operator in a production environment and require commercial support, contact Banzai Cloud, the company backing the development of the Kafka operator.

Engineering blog

To be up-to-date with the Kafka operator and the other open source and commercial products of Banzai Cloud, subscribe to our blog.

Contributing

If you find this project useful, help us:

• Support the development of this project and star this repo! ⭐️
• If you use the Kafka operator in a production environment, add yourself to the list of production adopters.🤘
  
• Help new users with issues they may encounter 💪
• Send a pull request with your new features and bug fixes 🚀

When you are opening a PR to Kafka operator the first time we will require you to sign a standard CLA. Check out the developer docs.

License

Copyright (c) 2019 Banzai Cloud, Inc.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.