422 Open source projects that are alternatives of or similar to Avro Hadoop Starter

phData Pulse application log aggregation and monitoring

Windows Rregistry Linking Utility

A facebook for data

Open-source software to play the board game Hive.

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

Apache Hadoop docker image

Library for generating avro schema files (.avsc) based on DB tables structure

Computes and visualizes the sentiment analysis of tweets of US States in real-time using Storm.

TiDB connectors for Flink/Hive/Presto

Apiary provides modules which can be combined to create a federated cloud data lake

No description or website provided.

Hive Ruby API Client

A Simple and Efficient Distributed Multidimensional BI Analysis Engine.

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

C# and F# language binding and extensions to Apache Spark

Template repository to work on the labs from MIT 6.824 Distributed Systems course.

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

A library provides consumer/producer to work with kafka, avro and schema registry

基于 scrapy-redis 的通用分布式爬虫框架

A library that makes it easier to use the Avro serialization format from Ruby.

Scalable data processing pipelines in JavaScript

DTail is a distributed DevOps tool for tailing, grepping, catting logs and other text files on many remote machines at once.

Simple Java Framework,designed for easily develop Spring based java program.Support Bigdata And metadata management.A common elasticsearch comm query tool and so on.

Docker containers for Hadoop.

Management and automation platform for Stateful Distributed Systems

Apache Avro serializer for .NET

Install hadoop cluster with ansible

A collection of Magnolia add-on modules

Avro Serialisation/Deserialisation (SerDe) library for PHP 7.3+ & 8.0 with a Symfony Serializer integration

Dockerfiles and Docker Compose for HDP 2.6 with Blueprints

Kafka Connect FileSystem Connector

An Avro implementation for .NET

Big Data for Data Engineers Coursera Specialization from Yandex

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

UEBA Solution for Insider Security. This repo is archived. Thanks!

bigdatatutorial

ACID Data Source for Apache Spark based on Hive ACID

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

TypeScript Code Generator for Apache Avro Schema Types

A framework for rapid reporting API development; with out of the box support for high cardinality dimension lookups with druid.

Multiple node cluster on Docker for self development.

A big data platform for analyzing web access logs

Apache Ignite

SQL backend to dplyr for Impala

Docker image for Apache Hive Metastore

Java开发者或者大数据开发者面试知识点整理

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

实践源码库：https://github.com/jast90/bigdata 。 微信搜索Jast关注公众号，获取最新技术分享😯。

Code Library for My Blog

Library for per-file client-side encyption in Hadoop FileSystems such as HDFS or S3.

Building Large-Scale AI Applications for Distributed Big Data

Hadoop utility to compact small files

Data self exporting and monitoring platform based on Hive data warehouse. https://hc.smartloli.org

零基础学习spark，大数据学习

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Java library for running Serverless MapReduce jobs

Teradata Distribution of Presto -- A Distributed SQL Query Engine for Big Data