677 Open source projects that are alternatives of or similar to Mare

MapReduce, Spark, Java, and Scala for Data Algorithms Book

Fast, Scientific and Numerical Computing for the JVM (NDArrays)

大数据入门指南 ⭐

C# and F# language binding and extensions to Apache Spark

Python clone of Spark, a MapReduce alike framework in Python

Big Data for Data Engineers Coursera Specialization from Yandex

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

An open source framework for building data analytic applications.

A Flexible and Powerful Parameter Server for large-scale machine learning

mathext implements basic elementary functions not included in the Go standard library [DEPRECATED]

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

🚀 R package: future: Unified Parallel and Distributed Processing in R for Everyone

Spark (http://sparkjava.com/) support for Swagger (https://swagger.io/)

Fast and distributed workflow runner using ActiveJob and Redis

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

CasADi is a symbolic framework for numeric optimization implementing automatic differentiation in forward and reverse modes on sparse matrix-valued computational graphs. It supports self-contained C-code generation and interfaces state-of-the-art codes such as SUNDIALS, IPOPT etc. It can be used from C++, Python or Matlab/Octave.

Parquet file generator

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

Tracking the progress of mc*apply with progress bar.

Scala toolchain for InfluxDB

Sparkling Water provides H2O functionality inside Spark cluster

Lightweight, general, scalable C++ library for finite element methods

R interface for Apache Spark

A free tutorial for Apache Spark.

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等

CTR prediction model based on spark(LR, GBDT, DNN)

Extreme-scale Discontinuous Galerkin Environment (EDGE)

hadoop各组件使用，持续更新

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

Expressive types for Spark.

Scalable genomic data analysis.

A language and runtime for distributed, incremental data processing in the cloud

Coursera's big data course with Scala and Spark

Learn Julia the hard way!

ruptures: change point detection in Python

distributed_computing include mapreduce kvstore etc.

Binding to the ODEPACK FORTRAN library

A simple Spark TDD example

🐎 A serverless MapReduce framework written for AWS Lambda

深圳地铁大数据客流分析系统🚇🚄🌟

电商用户行为分析大数据平台

Example project implementing best practices for PySpark ETL jobs and applications.

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

A cohesive & pragmatic framework of FP centric Scala libraries

VexCL is a C++ vector expression template library for OpenCL/CUDA/OpenMP

The core source repository for the Cherab project.

Java Convolutional Neural Network example for Hand Writing Digit Recognition

A Rust machine learning framework.

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Insight Toolkit (ITK) -- Official Repository. ITK builds on a proven, spatially-oriented architecture for processing, segmentation, and registration of scientific images in two, three, or more dimensions.

DataFusion has now been donated to the Apache Arrow project

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.