All Projects → vectorizedio → Redpanda

vectorizedio / Redpanda

Redpanda is the real-time engine for modern apps. Kafka API Compatible; 10x faster 🚀 See more at vectorized.io/redpanda

Programming Languages

C++
36643 projects - #6 most used programming language
go
31211 projects - #10 most used programming language
python
139335 projects - #7 most used programming language
typescript
32286 projects
java
68154 projects - #9 most used programming language
CMake
9771 projects

Projects that are alternatives of or similar to Redpanda

Jocko
Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)
Stars: ✭ 4,445 (+42.74%)
Mutual labels:  kafka, streaming
Hydra
A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.
Stars: ✭ 68 (-97.82%)
Mutual labels:  kafka, streaming
Sparta
Real Time Analytics and Data Pipelines based on Spark Streaming
Stars: ✭ 513 (-83.53%)
Mutual labels:  kafka, streaming
Chartjs Plugin Streaming
Chart.js plugin for live streaming data
Stars: ✭ 310 (-90.04%)
Mutual labels:  streaming, realtime
Flink Learning
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
Stars: ✭ 11,378 (+265.38%)
Mutual labels:  kafka, streaming
Kafka Connect Hdfs
Kafka Connect HDFS connector
Stars: ✭ 400 (-87.15%)
Mutual labels:  kafka, streaming
Stream Reactor
Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.
Stars: ✭ 753 (-75.82%)
Mutual labels:  kafka, streaming
traffic
Massively real-time traffic streaming application
Stars: ✭ 25 (-99.2%)
Mutual labels:  streaming, realtime
Bigdata Notebook
Stars: ✭ 100 (-96.79%)
Mutual labels:  kafka, streaming
Streamx
kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
Stars: ✭ 96 (-96.92%)
Mutual labels:  kafka, streaming
Pushpin
Proxy server for adding push to your API
Stars: ✭ 3,050 (-2.06%)
Mutual labels:  streaming, realtime
Azure Event Hubs Spark
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Stars: ✭ 140 (-95.5%)
Mutual labels:  kafka, streaming
mobius
Mobius is an AI infra platform including realtime computing and training.
Stars: ✭ 22 (-99.29%)
Mutual labels:  streaming, realtime
Real Time Stock Market Prediction
In this repository, I have developed the entire server-side principal architecture for real-time stock market prediction with Machine Learning. I have used Tensorflow.js for constructing ml model architecture, and Kafka for real-time data streaming and pipelining.
Stars: ✭ 414 (-86.71%)
Mutual labels:  kafka, streaming
vue-input-streaming
A Vue2 Input Streaming RealTime And Two Way Data Binding Broadcasting with Pusher
Stars: ✭ 24 (-99.23%)
Mutual labels:  streaming, realtime
Kafka Connect Jdbc
Kafka Connect connector for JDBC-compatible databases
Stars: ✭ 698 (-77.59%)
Mutual labels:  kafka, streaming
Data Accelerator
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Stars: ✭ 247 (-92.07%)
Mutual labels:  kafka, streaming
live-cryptocurrency-streaming-flutter
A Flutter app with live cryptocurrency updates, powered by Ably
Stars: ✭ 26 (-99.17%)
Mutual labels:  streaming, realtime
Fs2 Kafka
Kafka client for functional streams for scala (fs2)
Stars: ✭ 75 (-97.59%)
Mutual labels:  kafka, streaming
Samsara
Samsara is a real-time analytics platform
Stars: ✭ 132 (-95.76%)
Mutual labels:  kafka, realtime

Redpanda

Documentation Slack Twitter Go C++

redpanda sitting

Redpanda is a streaming platform for mission critical workloads. Kafka® compatible, No Zookeeper®, no JVM, and no code changes required. Use all your favorite open source tooling - 10x faster.

We are building a real-time streaming engine for modern applications - from the enterprise to the solo dev prototyping a react application on her laptop. We go beyond the Kafka protocol, into the future of streaming with inline WASM transforms and geo-replicated hierarchical storage. A new platform that scales with you from the smallest projects to petabytes of data distributed across the globe.

Community

Slack is the main way the community interacts with one another in real time :)

Github Discussion is preferred for longer, async, thoughtful discussions

GitHub Issues is reserved only for actual issues. Please use the mailing list for discussions.

Code of conduct code of conduct for the community

Contributing docs

Getting Started

Prebuilt Packages

We recommend using our free & prebuilt stable releases below.

On MacOS

Simply download our rpk binary here. We require Docker on MacOS

brew install vectorizedio/tap/redpanda && rpk container start

On Debian/Ubuntu

curl -1sLf \
  'https://packages.vectorized.io/nzc4ZYQK3WRGd9sy/redpanda/cfg/setup/bash.deb.sh' \
  | sudo -E bash
  
sudo apt-get install redpanda

On Fedora/RedHat/Amazon Linux

curl -1sLf \
  'https://packages.vectorized.io/nzc4ZYQK3WRGd9sy/redpanda/cfg/setup/bash.rpm.sh' \
  | sudo -E bash
  
sudo yum install redpanda

Build Manually

We provide a very simple build system that uses your system libraries. We recommend users leverage our pre-built stable releases which are vetted, tested, and reproducible with exact versions of the entire transitive dependency graph, including exact compilers all built from source. The only thing we do not build yet is the Linux Kernel, but soon!

For hackers, here is the short and sweet:

sudo ./install-dependencies.sh && CC=clang CXX=clang++ ./build.sh

For quicker dev setup, we provide a docker image with the toolchain installed.

Beta builds

For those of us who like to live on the edge!

We can cut a release at any point from the /dev branch if you want to test a particular feature. Simply let us know you would like to test a feature from dev and we're happy to cut a beta release.

Beta releases on Debian/Ubuntu

curl -1sLf \
  'https://packages.vectorized.io/HxYRCzL4xbbaEtPi/redpanda-beta/setup.deb.sh' \
  | sudo -E bash
  
sudo apt-get install redpanda

Beta releases on Fedora/RedHat/Amazon Linux

curl -1sLf \
  'https://packages.vectorized.io/HxYRCzL4xbbaEtPi/redpanda-beta/setup.rpm.sh' \
  | sudo -E bash
  
sudo yum install redpanda

Beta releases on Docker

This is an example with the v21.3.5-beta3 version prior to the 21.3.5 release.

docker.vectorized.io/vectorized/redpanda:v21.3.5-beta3
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].