382 Open source projects that are alternatives of or similar to darwin

A PHP 7.3+ API client for the Confluent Schema Registry REST API based on Guzzle 6 - http://docs.confluent.io/current/schema-registry/docs/index.html

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

A set of commands for managing CDH clusters using Cloudera Manager REST API.

基于hadoop+hbase+springboot实现分布式网盘系统

一个对用户行为日志进行分析的大数据项目

Iceberg is a table format for large, slow-moving tabular data

Apache Ignite

💎🔥大数据学习笔记

Lego bricks to build Apache Kafka serializers and deserializers

Axibase Time Series Database Documentation

Convert XSD -> AVSC and XML -> AVRO

An avro converter for Kafka Connect without a Schema Registry

Confluent Schema Registry for Kafka

A convenient Elixir library to work with Avro schemas and Confluent® Schema Registry

A complete (distributed) BigData stack, running in containers

Docker build project to setup a lightweight hadoop cluster containing hadoop, pig, zookeeper, hbase, phoenix, storm, kafka, kafka manager

Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.

云计算之hadoop、hive、hue、oozie、sqoop、hbase、zookeeper环境搭建及配置文件

零基础学习spark，大数据学习

A big data platform for analyzing web access logs

Cookbook to install Hadoop 2.0+ using Chef

AntsDB is a low latency, high concurrency, MySQL compliant SQL layer for HBase

大数据入门指南 ⭐

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

Big Data Ecosystem Docker

Example projects for 'BigInsights for Apache Hadoop' on IBM Bluemix

Apache Phoenix / Hbase Spring Boot Microservices

Avro Serialisation/Deserialisation (SerDe) library for PHP 7.3+ & 8.0 with a Symfony Serializer integration

An Avro Library that emphasizes testability and ease of use.

A large-scale entity and relation database supporting aggregation of properties

Library for generating avro schema files (.avsc) based on DB tables structure

TypeScript Code Generator for Apache Avro Schema Types

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

基于Spark2.2新闻网大数据实时系统项目

Code Library for My Blog

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

Open-source distribute workflow schedule tools, also support streaming task.

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse

Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, Hue, Mesos, ... )

HBase客户端数据管理软件

All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

基于wifi抓取信息的大数据查询分析系统

80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc.

深圳地铁大数据客流分析系统🚇🚄🌟

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

Management and automation platform for Stateful Distributed Systems

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

Teradata Distribution of Presto -- A Distributed SQL Query Engine for Big Data

PHP Kafka producer / consumer library with PHP Avro support, based on php-rdkafka

Kafka De/Serializer using avro and Confluent's Schema Registry

Data model generator based on Scala case classes