296 Open source projects that are alternatives of or similar to columnify

Amas is recursive acronym for “Amas, monitor alert system”.

Confluent Schema Registry for Kafka

一道面试题的思考 - 6000万数据包和300万数据包在50M内存使用环境中求交集

All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above

TiDB connectors for Flink/Hive/Presto

A library for strong, schema based conversion between 'natural' JSON documents and Avro

An avro converter for Kafka Connect without a Schema Registry

大数据生态圈学习

Kafka backed service library.

Library to read a subset of Parquet files

Albis: High-Performance File Format for Big Data Systems

Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

Demo applications and code examples for Confluent Platform and Apache Kafka

Hayabusa: Simple and Fast Full-Text Search Engine for Massive System Log Data

Avrocado is a convenience library to handle Avro in Golang

bigdata note

☀️ Avro, Protobuf, Thrift on Swagger

Avro Serialisation/Deserialisation (SerDe) library for PHP 7.3+ & 8.0 with a Symfony Serializer integration

Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.

Convert XSD -> AVSC and XML -> AVRO

A collection of tools for extracting FHIR resources and analytics services on top of that data.

MongoDB Kafka Connector

Language definition and parser for AVRO (.avdl) files.

Count records in Avro files efficiently

Examples for gauravbytes.com

A robust web archive analytics toolkit

☀️ A tool for validating data using JSON Schema and converting JSON Schema documents into different data-interchange formats

What's in your data? Extract schema, statistics and entities from datasets

Divolte Collector

This is a learning note | Java基础，JVM，源码，大数据，面经

A SQL-like language for performing ETL transformations.

A PHP 7.3+ API client for the Confluent Schema Registry REST API based on Guzzle 6 - http://docs.confluent.io/current/schema-registry/docs/index.html

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

Масштабируемое машинное обучение и анализ больших данных с Apache Spark

Goal: create a Spring Boot application that handles users using Event Sourcing. So, whenever a user is created, updated, or deleted, an event informing this change is sent to Kafka. Also, we will implement another application that listens to those events and saves them in Cassandra. Finally, we will use Testcontainers for integration testing.

An Avro implementation for .NET

Measuring the performance of popular streaming engines with Yahoo's Streaming Benchmark

TypeScript Code Generator for Apache Avro Schema Types

Uber-project for standard Jackson binary format backends: avro, cbor, ion, protobuf, smile

A client UI to inspect Kafka topics, consume, produce and much more

大数据学习笔记，学习路线，技术案例整理。

Goavro translates between Go native types and binary and textual Avro data

Command Line Tool for managing Apache Kafka

Scalable package delivery logistics simulator built using SingleStore and Vectorized Redpanda

Wrangler Transform: A DMD system for transforming Big Data

A Gradle plugin to allow easily performing Java code generation for Apache Avro. It supports JSON schema declaration files, JSON protocol declaration files, and Avro IDL files.

Compile Apache Avro schema files to TypeScript classes

编程路上加油站！------【持续更新中...欢迎star,欢迎常回来看看......】【内容：编程/学习/阅读资源，开源项目,面试题,网站,书,博客,教程等等】

A library that makes it easier to use the Avro serialization format from Ruby.

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

📙 json & avro http schema registry backed by Kafka

大数据采集,抽取平台

Record Query - A tool for doing record analysis and transformation

Flexible, Fast & Compact Serialization with RPC

Python package to manage Google Cloud Data Catalog tags, loading metadata from external sources -- currently supports the CSV file format

Kafka De/Serializer using avro and Confluent's Schema Registry

Automatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.

A pure Java HDF5 library

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.