661 Open source projects that are alternatives of or similar to Waimak

Apache Hive

💎🔥大数据学习笔记

A library that provides useful extensions to Apache Spark and PySpark.

This repository contains Machine-Learning MapReduce codes for Hadoop which are written from scratch (without using any package or library). E.g. Prediction (Linear and Logistic Regression), Clustering (K-Means), Classification (KNN) etc.

The Internals of Spark Structured Streaming

Import data from clickhouse to hadoop with pure SQL

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

High Performance HTTP Sidecar Load Balancer

Code examples on Apache Spark using python

IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.

Avro Schema Evolution made easy

A simplified, lightweight ETL Framework based on Apache Spark

An alternative to the "hive standalone" jar for connecting Java applications to Apache Hive via JDBC

Source code accompanying book: Data Science on the Google Cloud Platform, Valliappa Lakshmanan, O'Reilly 2017

The GIS Tools for Hadoop are a collection of GIS tools for spatial analysis of big data.

Beneath is a serverless real-time data platform ⚡️

Library for per-file client-side encyption in Hadoop FileSystems such as HDFS or S3.

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

An easy way to deploy your Akka services to a distributed environment.

ETH PhD Program course

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

Clean APIs for data cleaning. Python implementation of R package Janitor

R interface for Apache Spark

Liquibase extension to add Impala Database support

Qubole Sparklens tool for performance tuning Apache Spark

General Architecture for Text Engineering

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

An ad hoc query service based on the spark sql engine.(基于spark sql引擎的即席查询服务)

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等

dbt-sugar is a CLI tool that allows users of dbt to have fun and ease performing actions around dbt models

Scalable, redundant, and distributed object store for Apache Hadoop

An Elasticsearch client tailored to data science workflows.

Jupyter magics and kernels for working with remote Spark clusters

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

Python package for Customizable Data Preprocessing Pipelines

CTR prediction model based on spark(LR, GBDT, DNN)

An ORC File Scheme for the Cascading data processing platform.

Cascading is a feature rich API for defining and executing complex and fault tolerant data processing flows locally or on a cluster. See https://github.com/Cascading/cascading for the release repository.

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

When Apache Pulsar meets Apache Spark

基于hadoop+hbase+springboot实现分布式网盘系统

Apache Tez

论坛日志分析系统清洗程序(包含IP规则库，UDF开发，MapReduce程序，日志数据)

hadoop各组件使用，持续更新

ETL (extract, transform and load) tools for ingesting Polygon blockchain data to Google BigQuery and Pub/Sub

ClickHouse Native Protocol JDBC implementation

大数据生态圈学习

At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

Open Source Feature Flagging and A/B Testing Platform

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

A compiler for automatically re-targeting sequential Java code to Apache Spark.

HL7 Apache Spark Datasource

Type System for Data Analysis in Python

ELT Code for your Data Warehouse

Accumulated knowledge and experience in the field of Data Engineering