505 Open source projects that are alternatives of or similar to confluent-spark-avro

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Code Library for My Blog

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

⚡A supercharged, interactive Kafka shell built on top of the existing Kafka CLI tools.

A complete (distributed) BigData stack, running in containers

CLI and Go Clients to manage Kafka components (Kafka Connect & SchemaRegistry)

low-level helpers for Apache Spark libraries and tests

PHP Kafka producer / consumer library with PHP Avro support, based on php-rdkafka

Apache Avro serializer for .NET

Some class materials for a data processing course using PySpark

Apache Spark Sentry Integration

Spark functions to run popular phonetic and string matching algorithms

Book recommender system using collaborative filtering based on Spark

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

基于Docker构建的Hadoop开发测试环境，包含Hadoop，Hive，HBase，Spark

A collection of Apache Parquet add-on modules

基于Spark2.2新闻网大数据实时系统项目

Comparison and benchmark of JavaScript serialization libraries (Protocol Buffer, Avro, BSON, etc.)

The Internals of Spark SQL

A client UI to inspect Kafka topics, consume, produce and much more

JDBC driver for Apache Kafka

HL7 Apache Spark Datasource

How to use Parquet in Flink

Internet of Things Integration Example => Apache Kafka + Kafka Connect + MQTT Connector + Sensor Data

Applying Data Science and Machine Learning to Solve Real World Business Problems

▁▂▄▆▇█▇▆▄▂▁

ACID Data Source for Apache Spark based on Hive ACID

An Avro Library that emphasizes testability and ease of use.

Apache Spark™ and Scala Workshops

An extensive non-reactive Typescript framework that eases the development experience in Spark AR

REST job server for Apache Spark

Code examples for my blog posts

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)

Apache Spark docker container image (Standalone mode)

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Implementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters

Python clone of Spark, a MapReduce alike framework in Python

Collection of different demo applications using Apache Spark

A Jupyter notebook using some standard techniques for data science and data engineering to analyze data for the 2017 flooding in Houston, TX.

☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs

人生苦短 我用Python

Installations for Data Science. Anaconda, RStudio, Spark, TensorFlow, AWS (Amazon Web Services).

Goavro translates between Go native types and binary and textual Avro data

Model complex data transformation pipelines easily

A library for strong, schema based conversion between 'natural' JSON documents and Avro

Ruby wrapper for Apache Spark

A Spark library for Amazon SageMaker.

A Spark plugin for reading Excel files via Apache POI

TypeScript Code Generator for Apache Avro Schema Types

https://medium.com/xebia-france/getting-started-with-scala-and-apache-kafka-62bb1ca6a77f

Big Data Processing Framework - Unified Data API or SQL on Any Storage

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

An avro converter for Kafka Connect without a Schema Registry

MLOps Platform

Spark, Spark Streaming and Spark SQL unit testing strategies

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Visualize column-level data lineage in Spark SQL

Wrangler Transform: A DMD system for transforming Big Data

k-Nearest Neighbors algorithm on Spark