452 Open source projects that are alternatives of or similar to Oap

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

Parquet file generator

Iceberg is a table format for large, slow-moving tabular data

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

A large-scale entity and relation database supporting aggregation of properties

Bucketing and partitioning system for Parquet

Spark SQL index for Parquet tables

Code examples for my blog posts

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

Create clusters of VMs on the cloud and configure them with Ansible.

本项目收藏这些年来看过或者听过的一些不错的书籍，在整理文件时看见这些，发现删掉有点可惜，放着又太浪费空间，本着分享的原则，就把它们共享出来，一方面给需要的读者提供这些书籍，另一方面也是一种像知识库的积累吧

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

A curated list of awesome resources related to the Ada and SPARK programming language

Profile Photo Camera support for Laravel Spark

Fair job scheduler on Kubernetes and Mesos for batch workloads and Spark

spark structured streaming via HTTP communication

Interactive and Reactive Data Science using Scala and Spark.

Kylo integration with PDND (previously DAF).

UC Berkeley team's submission for RecSys Challenge 2018

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

酷玩 Spark: Spark 源代码解析、Spark 类库等

A tool for data sampling, data generation, and data diffing

Developing Spark External Data Sources using the V2 API

Minikube for big data with Scala and Spark

Spark RDD to read, write and delete from HBase

A Robinhood style COVID-19 🦠 Android tracking app for the US. Open source and built with Kotlin.

Create full-fledged APIs for static datasets without writing a single line of code.

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

Enabling queries on compressed data.

A tool for monitoring and tuning Spark jobs for efficiency.

Spark structured streaming examples with using of version 3.0.0

A tool for batch loading data files (json, parquet, csv, tsv) into ElasticSearch

Template for Spark Projects

Apache Parquet

One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)

Connect Spark to HBase for reading and writing data with ease

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

ClickHouse Native Protocol JDBC implementation

dllib is a distributed deep learning library running on Apache Spark

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

尚硅谷大数据Spark-2019版最新 Spark 学习

A Scala wrapper for Deeplearning4j, inspired by Keras. Scala + DL + Spark + GPUs

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

blog entries

🏐 Apache Parquet for modern .NET

🤖⚡ | The most POWERFUL multipurpose chat/meme bot that will boost the activity in your server.

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

Simple framework agnostic UI router for SPAs

ETL Library for Machine Learning - data pipelines, data munging and wrangling

Model complex data transformation pipelines easily

A library that provides useful extensions to Apache Spark and PySpark.

The Hunting ELK

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

A complete (distributed) BigData stack, running in containers

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.