All Projects → pravega → Pravega

pravega / Pravega

Licence: apache-2.0
Pravega is 100% open source and community-driven. All components are available under Apache 2 License on GitHub.

Programming Languages

java
68154 projects - #9 most used programming language

Projects that are alternatives of or similar to Pravega

Smart open
Utils for streaming large files (S3, HDFS, gzip, bz2...)
Stars: ✭ 2,306 (+39.5%)
Mutual labels:  streaming-data, streaming
River
🌊 Online machine learning in Python
Stars: ✭ 2,980 (+80.28%)
Mutual labels:  streaming-data, streaming
Saber
Window-Based Hybrid CPU/GPU Stream Processing Engine
Stars: ✭ 35 (-97.88%)
Mutual labels:  streaming-data, streaming
Kafka Streams In Action
Source code for the Kafka Streams in Action Book
Stars: ✭ 167 (-89.9%)
Mutual labels:  streaming-data, streaming
Data Accelerator
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Stars: ✭ 247 (-85.06%)
Mutual labels:  streaming-data, streaming
Sparta
Real Time Analytics and Data Pipelines based on Spark Streaming
Stars: ✭ 513 (-68.97%)
Mutual labels:  streaming-data, streaming
Eventql
Distributed "massively parallel" SQL query engine
Stars: ✭ 1,121 (-32.18%)
Mutual labels:  distributed-storage, streaming
Streamx
kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
Stars: ✭ 96 (-94.19%)
Mutual labels:  streaming
Fiflow
flink-sql 在 flink 上运行 sql 和 构建数据流的平台 基于 apache flink 1.10.0
Stars: ✭ 100 (-93.95%)
Mutual labels:  streaming
Incubator Hop
Hop Orchestration Platform
Stars: ✭ 94 (-94.31%)
Mutual labels:  streaming
Mastodon Api
Mastodon API Client Library
Stars: ✭ 89 (-94.62%)
Mutual labels:  streaming
Nivirtualcam
OpenNI 2 Virtual Webcam - Directshow Filter
Stars: ✭ 95 (-94.25%)
Mutual labels:  streaming
Pulsar Dotpulsar
The official .NET client library for Apache Pulsar
Stars: ✭ 101 (-93.89%)
Mutual labels:  streaming
Rtmp Rtsp Stream Client Java
Library to stream in rtmp and rtsp for Android. All code in Java
Stars: ✭ 1,338 (-19.06%)
Mutual labels:  streaming
Flixerr
The best free movie torrent streaming app.
Stars: ✭ 103 (-93.77%)
Mutual labels:  streaming
Gpac
Modular Multimedia framework for packaging, streaming and playing your favorite content.
Stars: ✭ 1,321 (-20.08%)
Mutual labels:  streaming
Nymphcast
Audio and video casting system with support for custom applications.
Stars: ✭ 2,010 (+21.6%)
Mutual labels:  streaming
Twitch Channel Points Miner V2
A simple script that will watch a stream for you and earn the channel points.
Stars: ✭ 100 (-93.95%)
Mutual labels:  streaming
Kit Kat
kit-kat (Toolkit-kat) is a FREE Wireless Capture-card to stream your 3DS screen to your PC!
Stars: ✭ 100 (-93.95%)
Mutual labels:  streaming
Node Tcp Streaming Server
Experimental TCP video streaming server written in node.js. Streaming over TCP and redistributing using WebSockets.
Stars: ✭ 100 (-93.95%)
Mutual labels:  streaming

Pravega Build Status codecov License Version CII Best Practices

Pravega is an open source distributed storage service implementing Streams. It offers Stream as the main primitive for the foundation of reliable storage systems: a high-performance, durable, elastic, and unlimited append-only byte stream with strict ordering and consistency.

To learn more about Pravega, visit https://pravega.io

Prerequisites

  • Java 11+

In spite of the requirements of using JDK 11+ to build this project, client artifacts (and its dependencies) must be compatible with a Java 8 runtime. All other components are built and ran using JDK11+.

The clientJavaVersion project property determines the version used to build the client (defaults to 8).

Building Pravega

Checkout the source code:

git clone https://github.com/pravega/pravega.git
cd pravega

Build the pravega distribution:

./gradlew distribution

Install pravega jar files into the local maven repository. This is handy for running the pravega-samples locally against a custom version of pravega.

./gradlew install

Running unit tests:

./gradlew test

Setting up your IDE

Pravega uses Project Lombok so you should ensure you have your IDE setup with the required plugins. Using IntelliJ is recommended.

To import the source into IntelliJ:

  1. Import the project directory into IntelliJ IDE. It will automatically detect the gradle project and import things correctly.
  2. Enable Annotation Processing by going to Build, Execution, Deployment -> Compiler > Annotation Processors and checking 'Enable annotation processing'.
  3. Install the Lombok Plugin. This can be found in Preferences -> Plugins. Restart your IDE.
  4. Pravega should now compile properly.

For eclipse, you can generate eclipse project files by running ./gradlew eclipse.

Note: Some unit tests will create (and delete) a significant amount of files. For improved performance on Windows machines, be sure to add the appropriate 'Microsoft Defender' exclusion.

Releases

The latest pravega releases can be found on the Github Release project page.

Snapshot artifacts

All snapshot artifacts from master and release branches are available in GitHub Packages Registry

Add the following to your repositories list and import dependencies as usual.

maven {
    url "https://maven.pkg.github.com/pravega/pravega"
    credentials {
        username = "pravega-public"
        password = "\u0067\u0068\u0070\u005F\u0048\u0034\u0046\u0079\u0047\u005A\u0031\u006B\u0056\u0030\u0051\u0070\u006B\u0079\u0058\u006D\u0035\u0063\u0034\u0055\u0033\u006E\u0032\u0065\u0078\u0039\u0032\u0046\u006E\u0071\u0033\u0053\u0046\u0076\u005A\u0049"
    }
}

Note GitHub Packages requires authentication to download packages thus credentials above are required. Use the provided password as is, please do not decode it.

If you need a dedicated token to use in your repository (and GitHub Actions) please reach out to us.

As alternative option you can use JitPack (https://jitpack.io/#pravega/pravega) to get pre-release artifacts.

Quick Start

Read Getting Started page for more information, and also visit sample-apps repo for more applications.

Running Pravega

Pravega can be installed locally or in a distributed environment. The installation and deployment of pravega is covered in the Running Pravega guide.

Support

Don’t hesitate to ask! Contact the developers and community on slack (signup) if you need any help. Open an issue if you found a bug on Github Issues.

Documentation

The Pravega documentation is hosted on the website: https://pravega.io/docs/latest or in the documentation directory of the source code.

Contributing

Become one of the contributors! We thrive to build a welcoming and open community for anyone who wants to use the system or contribute to it. Here we describe how to contribute to Pravega! You can see the roadmap document here.

About

Pravega is 100% open source and community-driven. All components are available under Apache 2 License on GitHub.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].