505 Open source projects that are alternatives of or similar to confluent-spark-avro

Vagrant projects for various use-cases with Spark, Zeppelin, IPython / Jupyter, SparkR

Make record oriented data to columnar format.

Easy CPU Profiling for Apache Spark applications

Julia binding for Apache Spark

Some class materials for a data processing course using PySpark

High performance HBase / Spark SQL engine

Distributed t-SNE via Apache Spark

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

Apache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

Library for generating avro schema files (.avsc) based on DB tables structure

Feature engineering toolkit for Spark MLlib.

Fundamentals of Spark with Python (using PySpark), code examples

A heterogeneous Apache Spark framework.

Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

Updated repository

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

MLeap: Deploy ML Pipelines to Production

Scala toolchain for InfluxDB

DataStax Spark Cassandra Connector

Java Convolutional Neural Network example for Hand Writing Digit Recognition

A collection of Apache Parquet add-on modules

A free tutorial for Apache Spark.

Fast, Scientific and Numerical Computing for the JVM (NDArrays)

Parquet file generator

基于Spark2.2新闻网大数据实时系统项目

Sparkling Water provides H2O functionality inside Spark cluster

Geospatial Raster support for Spark DataFrames

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

A scalable nearest neighbor search library in Apache Spark

Visualize data using relative ordering

A connector for Spark that allows reading and writing to/from Redis cluster

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

A Flexible and Powerful Parameter Server for large-scale machine learning

A client UI to inspect Kafka topics, consume, produce and much more

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

JDBC driver for Apache Kafka

Expressive types for Spark.

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

HL7 Apache Spark Datasource

电商用户行为分析大数据平台

Node.js bindings for Apache Spark DataFrame APIs

A cohesive & pragmatic framework of FP centric Scala libraries

How to use Parquet in Flink

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

Internet of Things Integration Example => Apache Kafka + Kafka Connect + MQTT Connector + Sensor Data

Hybrid model of Gradient Boosting Trees and Logistic Regression (GBDT+LR) on Spark

Language definition and parser for AVRO (.avdl) files.

Realtime calculation distributed system. AKA distributed lodash

A simple Spark-powered ETL framework that just works 🍺

🚢 Docker image for Apache Spark

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs

ApacheCN 开源组织：公告、介绍、成员、活动、交流方式

Apache Spark Website

A Robinhood style COVID-19 🦠 Android tracking app for the US. Open source and built with Kotlin.