432 Open source projects that are alternatives of or similar to big-data-exploration

gomrjob - a Go Framework for Hadoop Map Reduce Jobs

Install hadoop cluster with ansible

Dagpi is a powerful and fast api that does image manipulation as well as serves datasets. It is fast and written in rust and python. Perfect for discord bots, social media apps, camera apps and more.

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

Source code and dataset for paper "CBMR: An optimized MapReduce for item‐based collaborative filtering recommendation algorithm with empirical analysis"

基于Hadoop的分布式云存储系统 🌴

NPM package for copying and converting Cloud Firestore data to BigQuery.

Data pipeline project

⚽️ Extract, prepare and publish Transfermarkt datasets.

大数据学习笔记，学习路线，技术案例整理。

Data package for accessing GeoDa datasets using R

Apache Phoenix / Hbase Spring Boot Microservices

Information of public available data sets for biomechanics.

🚓 Crime dataset for the City of Buenos Aires, Argentina

திருக்குறள் by திருவள்ளுவர்.

Scalable data processing pipelines in JavaScript

SIXray : A Large-scale Security Inspection X-ray Benchmark in CVPR 2019

A research data management plugin for the Git version control system.

TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data

No description or website provided.

Companion to Learning Hadoop and Learning Spark courses on Linked In Learning

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above

Papers, Datasets, Algorithms, SOTA for STR. Long-time Maintaining

Official repository of Learning Multi-Human Optical Flow (IJCV 2019)

A Curated List of Computational Biology Datasets Suitable for Machine Learning

R library for data.world

Information Inference Service of the OpenAIRE system

Python package for data.world

大数据生态圈学习

Export Hadoop YARN (resource-manager) metrics in prometheus format

同步Hive数据仓库数据到Elasticsearch的小工具

Clothing detection dataset

论坛日志分析系统清洗程序(包含IP规则库，UDF开发，MapReduce程序，日志数据)

A curated list of datasets, publically available for machine learning research in the area of manufacturing

Machine Learning eXchange (MLX). Data and AI Assets Catalog and Execution Engine

Simple Java Framework,designed for easily develop Spring based java program.Support Bigdata And metadata management.A common elasticsearch comm query tool and so on.

Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, Hue, Mesos, ... )

Distributed Java micro-services using ZooKeeper

Smart Automation Tool for building modern Data Lakes and Data Pipelines

Management and automation platform for Stateful Distributed Systems

Tool for autodownloading recommendation systems datasets

A python package for scraping oddsportal.com

Functional data science

Collection of NLP model explanations and accompanying analysis tools

Google PlayStore App dataset. (2.3 million App Data) and 24 attributes

A collection of resources on dynamic/streaming/temporal/evolving graph processing systems, databases, data structures, datasets, and related academic and industrial work

Meta-analytic datasets for R

Useful links of different content related to AI, Computer Vision, and Robotics.

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Dockerfiles and Docker Compose for HDP 2.6 with Blueprints

Open Source Phasor Data Concentrator

Kafka Connect FileSystem Connector

Hive Storage Handler for interoperability between BigQuery and Apache Hive

Node.js WebHDFS REST API client

おーぷん2ちゃんねるをクロールして作成した対話コーパス

A collection of publicly available bug reports

Discourse Based Evaluation of Language Understanding

Scripts to run and benchmark scRNA-seq cell cluster labeling methods

大数据相关内容汇总，包括分布式存储引擎、分布式计算引擎、数仓建设等。关键词：Hadoop、HBase、ES、Kudu、Hive、Presto、Spark、Flink、Kylin、ClickHouse