All Projects → OryxProject → Oryx

OryxProject / Oryx

Licence: apache-2.0
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

Programming Languages

java
68154 projects - #9 most used programming language
scala
5932 projects
shell
77523 projects

Projects that are alternatives of or similar to Oryx

Awesome Kafka
A list about Apache Kafka
Stars: ✭ 397 (-77.76%)
Mutual labels:  apache-kafka, kafka, apache-spark
Wirbelsturm
Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.
Stars: ✭ 332 (-81.4%)
Mutual labels:  apache-kafka, kafka, apache-spark
Kafka Storm Starter
Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.
Stars: ✭ 728 (-59.22%)
Mutual labels:  apache-kafka, kafka, apache-spark
Agile data code 2
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
Stars: ✭ 413 (-76.86%)
Mutual labels:  apache-kafka, kafka, apache-spark
Storm Dynamic Spout
A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.
Stars: ✭ 40 (-97.76%)
Mutual labels:  apache-kafka, kafka
Real Time Stream Processing Engine
This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.
Stars: ✭ 37 (-97.93%)
Mutual labels:  kafka, apache-spark
Kowl
Apache Kafka Web UI for exploring messages, consumers, configurations and more with a focus on a good UI & UX.
Stars: ✭ 1,036 (-41.96%)
Mutual labels:  apache-kafka, kafka
Kattlo Cli
Kattlo CLI Project
Stars: ✭ 58 (-96.75%)
Mutual labels:  apache-kafka, kafka
Kq
Kafka-based Job Queue for Python
Stars: ✭ 530 (-70.31%)
Mutual labels:  apache-kafka, kafka
Pykafka
Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.
Stars: ✭ 1,079 (-39.55%)
Mutual labels:  apache-kafka, kafka
Docker Kafka
Apache Kafka on Docker
Stars: ✭ 143 (-91.99%)
Mutual labels:  apache-kafka, kafka
Kt
Kafka command line tool that likes JSON
Stars: ✭ 799 (-55.24%)
Mutual labels:  apache-kafka, kafka
Meetup
Kafka 한국 사용자 모임에서 운영하는 meetup repository
Stars: ✭ 106 (-94.06%)
Mutual labels:  apache-kafka, kafka
Kafka Workshop
Materials (slides and code) for Kafka and Kafka Streams Workshop
Stars: ✭ 44 (-97.54%)
Mutual labels:  apache-kafka, kafka
Librdkafka
The Apache Kafka C/C++ library
Stars: ✭ 5,617 (+214.68%)
Mutual labels:  apache-kafka, kafka
Awesome Pulsar
A curated list of Pulsar tools, integrations and resources.
Stars: ✭ 57 (-96.81%)
Mutual labels:  apache-kafka, apache-spark
Kukulcan
A REPL for Apache Kafka
Stars: ✭ 103 (-94.23%)
Mutual labels:  apache-kafka, kafka
Azure Event Hubs Spark
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Stars: ✭ 140 (-92.16%)
Mutual labels:  kafka, apache-spark
Waterdrop
WaterDrop is a standalone Karafka component library for generating Kafka messages
Stars: ✭ 136 (-92.38%)
Mutual labels:  apache-kafka, kafka
Debezium
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
Stars: ✭ 5,937 (+232.61%)
Mutual labels:  apache-kafka, kafka

Oryx 2 is a realization of the lambda architecture built on Apache Spark and Apache Kafka, but with specialization for real-time large scale machine learning. It is a framework for building applications, but also includes packaged, end-to-end applications for collaborative filtering, classification, regression and clustering.

Proceed to the Oryx 2 site for full documentation.

Just looking to deploy a ready-made, end-to-end application for collaborative filtering, clustering or classification? Easy. Proceed directly to:

Developers can consume Oryx 2 as a framework for building custom applications as well. Following the architecture overview below, proceed to Making an Oryx App to learn how to create a new application. You can review a module diagram as well to understand the project structure.


Build Status Coverity codecov.io

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].