All Projects → karafka → Karafka

karafka / Karafka

Licence: mit
Framework for Apache Kafka based Ruby and Rails applications development.

Programming Languages

ruby
36898 projects - #4 most used programming language

Projects that are alternatives of or similar to Karafka

Kq
Kafka-based Job Queue for Python
Stars: ✭ 530 (-56.66%)
Mutual labels:  apache-kafka, kafka, kafka-client, kafka-producer, kafka-consumer
Kukulcan
A REPL for Apache Kafka
Stars: ✭ 103 (-91.58%)
Mutual labels:  apache-kafka, kafka, kafka-producer, kafka-consumer
Apachekafkatutorials
Example Code for Kafka Tutorials @ Learning Journal
Stars: ✭ 155 (-87.33%)
Mutual labels:  apache-kafka, kafka-client, kafka-producer, kafka-consumer
Waterdrop
WaterDrop is a standalone Karafka component library for generating Kafka messages
Stars: ✭ 136 (-88.88%)
Mutual labels:  apache-kafka, kafka, rubygem, rubygems
Strimzi Kafka Bridge
Apache Kafka bridge
Stars: ✭ 137 (-88.8%)
Mutual labels:  kafka, kafka-client, kafka-producer, kafka-consumer
Kattlo Cli
Kattlo CLI Project
Stars: ✭ 58 (-95.26%)
Mutual labels:  apache-kafka, kafka, kafka-producer, kafka-consumer
Rafka
Kafka proxy with a simple API, speaking the Redis protocol
Stars: ✭ 49 (-95.99%)
Mutual labels:  kafka, kafka-client, kafka-producer, kafka-consumer
Kafka Ui
Open-Source Web GUI for Apache Kafka Management
Stars: ✭ 230 (-81.19%)
Mutual labels:  apache-kafka, kafka, kafka-client, kafka-producer
Librdkafka
The Apache Kafka C/C++ library
Stars: ✭ 5,617 (+359.28%)
Mutual labels:  apache-kafka, kafka, kafka-producer, kafka-consumer
kafka-0.11-examples
Code snippets that demonstrate how to leverage the new Kafka 0.11 APIs
Stars: ✭ 17 (-98.61%)
Mutual labels:  kafka-consumer, kafka-producer, kafka-client
Qbusbridge
The Apache Kafka Client SDK
Stars: ✭ 272 (-77.76%)
Mutual labels:  kafka, kafka-producer, kafka-consumer
Trubka
A CLI tool for Kafka
Stars: ✭ 296 (-75.8%)
Mutual labels:  kafka, kafka-producer, kafka-consumer
Vueonrails
💎 Rails gem with the power of Vue.js components
Stars: ✭ 250 (-79.56%)
Mutual labels:  rails, ruby-on-rails, rubygems
Tapping device
TappingDevice makes objects tell you what they do, so you don't need to track them yourself.
Stars: ✭ 296 (-75.8%)
Mutual labels:  rails, ruby-on-rails, rubygem
Racecar
Racecar: a simple framework for Kafka consumers in Ruby
Stars: ✭ 327 (-73.26%)
Mutual labels:  kafka, kafka-consumer, rails
Debezium
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
Stars: ✭ 5,937 (+385.45%)
Mutual labels:  apache-kafka, kafka, kafka-producer
Dry Rails
The official dry-rb railtie
Stars: ✭ 142 (-88.39%)
Mutual labels:  rails, ruby-on-rails, rubygem
Matestack Ui Core
Matestack enables you to create sophisticated, reactive UIs in pure Ruby, without touching JavaScript and HTML. You end up writing 50% less code while increasing productivity, maintainability and developer happiness.
Stars: ✭ 469 (-61.65%)
Mutual labels:  rails, ruby-on-rails, rubygem
Materialize Sass
Materializecss rubygem for Rails Asset Pipeline / Sprockets
Stars: ✭ 785 (-35.81%)
Mutual labels:  rails, rubygem, rubygems
Leaky Gems
A list of Ruby gems that have known memory leaks (and issues)
Stars: ✭ 895 (-26.82%)
Mutual labels:  rails, ruby-on-rails, rubygems

karafka logo

Build Status Gem Version Join the chat at https://gitter.im/karafka/karafka

Note: We're finishing the new Karafka 2.0 but for now, please use 1.4. All the documentation presented here refers to 1.4 .. Documentation presented here refers to Karafka 1.4.

About Karafka

Framework used to simplify Apache Kafka based Ruby applications development.

Karafka allows you to capture everything that happens in your systems in large scale, providing you with a seamless and stable core for consuming and processing this data, without having to focus on things that are not your business domain.

Karafka not only handles incoming messages but also provides tools for building complex data-flow applications that receive and send messages.

How does it work

Karafka provides a higher-level abstraction that allows you to focus on your business logic development, instead of focusing on implementing lower level abstraction layers. It provides developers with a set of tools that are dedicated for building multi-topic applications similar to how Rails applications are being built.

Some things you might wonder about:

  • You can integrate Karafka with any Ruby-based application.
  • Karafka does not require Sidekiq or any other third party software (apart from Kafka itself).
  • Karafka works with Ruby on Rails but it is a standalone framework that can work without it.
  • Karafka has a minimal set of dependencies, so adding it won't be a huge burden for your already existing applications.
  • Karafka processes can be executed for a given subset of consumer groups and/or topics, so you can fine tune it depending on your business logic.

Karafka based applications can be easily deployed to any type of infrastructure, including those based on:

  • Heroku
  • Capistrano
  • Docker
  • Terraform

Support

Karafka has a Wiki pages for almost everything and a pretty decent FAQ. It covers the whole installation, setup, and deployment along with other useful details on how to run Karafka.

If you have any questions about using Karafka, feel free to join our Gitter chat channel.

Getting started

If you're completely new to the subject, you can start with our "Kafka on Rails" articles series, that will get you up and running with the terminology and basic ideas behind using Kafka:

If you want to get started with Kafka and Karafka as fast as possible, then the best idea is to just clone our example repository:

git clone https://github.com/karafka/example-app ./example_app

then, just bundle install all the dependencies:

cd ./example_app
bundle install

and follow the instructions from the example app Wiki.

Note: you need to ensure, that you have Kafka up and running and you need to configure Kafka seed_brokers in the karafka.rb file.

If you need more details and know how on how to start Karafka with a clean installation, read the Getting started page section of our Wiki.

Notice

Karafka framework and Karafka team are not related to Kafka streaming service called CloudKarafka in any matter. We don't recommend nor discourage usage of their platform.

References

Note on contributions

First, thank you for considering contributing to Karafka! It's people like you that make the open source community such a great community!

Each pull request must pass all the RSpec specs and meet our quality requirements.

To check if everything is as it should be, we use Coditsu that combines multiple linters and code analyzers for both code and documentation. Once you're done with your changes, submit a pull request.

Coditsu will automatically check your work against our quality standards. You can find your commit check results on the builds page of Karafka organization.

coditsu

Contributors

This project exists thanks to all the people who contribute.

Sponsors

We are looking for sustainable sponsorship. If your company is relying on Karafka framework or simply want to see Karafka evolve faster to meet your requirements, please consider backing the project.

Please contact Maciej Mensfeld directly for more details.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].