677 Open source projects that are alternatives of or similar to Mare

R interface for Apache Spark

Training of Locally Optimized Product Quantization (LOPQ) models for approximate nearest neighbor search of high dimensional data in Python and Spark.

A free tutorial for Apache Spark.

Real Time Analytics and Data Pipelines based on Spark Streaming

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等

💎🔥大数据学习笔记

CTR prediction model based on spark(LR, GBDT, DNN)

😎 Curated list of awesome software for numerical analysis and scientific computing

Extreme-scale Discontinuous Galerkin Environment (EDGE)

Cross-platform real-time collaboration client optimized for business and organizations.

hadoop各组件使用，持续更新

poliastro - 🚀 Astrodynamics in Python

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

Expressive types for Spark.

The Internals of Spark Structured Streaming

DataFusion has now been donated to the Apache Arrow project

mlpack: a scalable C++ machine learning library --

大数据博客、笔试题、教程、项目、面经的整理

Scalable genomic data analysis.

Examples for High Performance Spark

Tool-box for efficient build and debug in Python. Especially for Scientific Computing and Computer Vision.

A language and runtime for distributed, incremental data processing in the cloud

Deep learning library for solving differential equations and more

Coursera's big data course with Scala and Spark

Javascript Pure Implementation of Statistical R "core" numerical libRmath.so

Learn Julia the hard way!

A Scala feature transformation library for data science and machine learning

High Performance HTTP Sidecar Load Balancer

Server for the ListenBrainz project

distributed_computing include mapreduce kvstore etc.

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Binding to the ODEPACK FORTRAN library

Generic Data Ingestion & Dispersal Library for Hadoop

🐎 A serverless MapReduce framework written for AWS Lambda

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

A simple Spark TDD example

一个大数据架构师应该掌握的技能

Example project implementing best practices for PySpark ETL jobs and applications.

C++ library for solving large sparse linear systems with algebraic multigrid method

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

VexCL is a C++ vector expression template library for OpenCL/CUDA/OpenMP

Building Large-Scale AI Applications for Distributed Big Data

The core source repository for the Cherab project.

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.

Insight Toolkit (ITK) -- Official Repository. ITK builds on a proven, spatially-oriented architecture for processing, segmentation, and registration of scientific images in two, three, or more dimensions.

A code generator for array-based code on CPUs and GPUs

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

Owl - OCaml Scientific and Engineering Computing @ http://ocaml.xyz

Kyuubi is a unified multi-tenant JDBC interface for large-scale data processing and analytics, built on top of Apache Spark

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

The MongoDB Spark Connector

A simplified, lightweight ETL Framework based on Apache Spark

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

OpenCL integration for Python, plus shiny features

[HELP REQUESTED] Generalized Additive Models in Python

Learning Apache spark,including code and data .Most part can run local.