795 Open source projects that are alternatives of or similar to big_data

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

The metrics layer for your data. Join us at https://metriql.com/slack

an open source dataworks platform

Service for automatically managing and cleaning up unreferenced data

Open Source Phasor Data Concentrator

Wrangler Transform: A DMD system for transforming Big Data

My journey to learn and grow in the domain of Machine Learning and Artificial Intelligence by performing the #100DaysofMLCode Challenge.

Distributed stream processing model and its implementation

Mirror of Apache Metamodel

☁️ nodejs kafka connect connector for Google BigQuery

Machine Learning Course @ Santa Clara University

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

Open and collaborative content from leet hackers!

Apache Spark on AWS Lambda

Avro Schema Evolution made easy

Mirror of Apache Apex malhar

General Architecture for Text Engineering

TiDB connectors for Flink/Hive/Presto

Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .

The Distributed Computing library for python implemented using PyCOMPSs programming model for HPC.

Docker file for Hadoop 3

swissgeol.ch gives you insight in geoscientific data - above and below the surface.

Mirror of Apache Tajo

Detect common phrases in large amounts of text using a data-driven approach. Size of discovered phrases can be arbitrary. Can be used in languages other than English

Hive Storage Handler for interoperability between BigQuery and Apache Hive

High-performance Terrain and Hydrology Analysis

云计算之hadoop、hive、hue、oozie、sqoop、hbase、zookeeper环境搭建及配置文件

Hazelcast IMDG Node.js Client

A pure Java HDF5 library

Project for James' Apache Spark with Scala course

Apache Arrow DataFusion SQL Query Engine

Node.js WebHDFS REST API client

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse

A lightweight data processing framework for Apache Spark

Collaborative Datacenter Simulation and Exploration for Everybody

Apache Phoenix Query Server

CMAK is a tool for managing Apache Kafka clusters

Love your Data. Love the Environment. Love VULKИ.

RECSM-UPF Summer School: Social Media and Big Data Research

Library for per-file client-side encyption in Hadoop FileSystems such as HDFS or S3.

Albis: High-Performance File Format for Big Data Systems

Apache CouchDB Packaging support files

Flink: Stateful Computations over Data Streams

Real-world Spark pipelines examples

PredictionIO E-Commerce Recommendation Engine Template (Scala-based parallelized engine)

Hadoop utility to compact small files

A robust web archive analytics toolkit

Graph Sampling is a python package containing various approaches which samples the original graph according to different sample sizes.

bigdata note

🔥 One of the most comprehensive open-source data annotation platform.

An open-source, real-time Security Information & Event Management tool based on big data technologies, providing a scalable, advanced security analytics framework.

cdp数据平台，帮助企业充分了解客户，实现千人千面的精准营销。

Apache Spark for data engineers

(Latest semester at https://github.com/kmader/Quantitative-Big-Imaging-2019) The material for the Quantitative Big Imaging course at ETHZ for the Spring Semester 2018

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

Workspace for China local user group.

用Python爬取安居客房源信息，并用高德地图进行可视化

subsemble R package for ensemble learning on subsets of data

An R package for large scale estimation with stochastic gradient descent

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.