369 Open source projects that are alternatives of or similar to Bigtop

A tool for provisioning and managing Apache Hadoop clusters in the cloud. Cloudbreak, as part of the Hortonworks Data Platform, makes it easy to provision, configure and elastically grow HDP clusters on cloud infrastructure. Cloudbreak can be used to provision Hadoop across cloud infrastructure providers including AWS, Azure, GCP and OpenStack.

Data validation library for PySpark 3.0.0

OONI data processing pipeline

🔥 One of the most comprehensive open-source data annotation platform.

Best Practices and Style Guides in BEEVA

an online learning algorithm library for Storm

Drools processor for Apache NiFi

Base types for OnlineStats.

白泽自动化运维系统：配置管理、网络探测、资产管理、业务管理、CMDB、CD、DevOps、作业编排、任务编排等功能,未来将添加监控、报警、日志分析、大数据分析等部分内容

"Byteslice: Pushing the envelop of main memory data processing with a new storage layout" (SIGMOD'15)

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

Stroom is a highly scalable data storage, processing and analysis platform.

Ppts, códigos y videos de las meetups, data science days, videollamadas y workshops. Data Science Research es una organización sin fines de lucro que busca difundir, descentralizar y difundir los conocimientos en Ciencia de Datos e Inteligencia Artificial en el Perú, dando oportunidades a nuevos talentos mediante MeetUps, Workshops y Semilleros …

Mirror of Apache Lens

☁️ nodejs kafka connect connector for Google BigQuery

CrateDB is a distributed SQL database that makes it simple to store and analyze massive amounts of data in real-time.

Win probability predictions for League of Legends matches using neural networks

⚡ Lightning fast density estimation in Julia ⚡

InsightEdge Core

ROOT I/O in pure Python and NumPy.

Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production. Liminal provides a Domain Specific Language to build ML workflows on top of Apache Airflow.

OLAP and ETL of Big Data

Service for automatically managing and cleaning up unreferenced data

A curated list of Open Information Extraction (OIE) resources: papers, code, data, etc.

An open-source, real-time Security Information & Event Management tool based on big data technologies, providing a scalable, advanced security analytics framework.

Alluxio Python client - Access Any Data Source with Python

Mirror of Apache Airavata PHP Gateway

DevOps methodology & roadmap for a devops developer in 2019. Interesting books to learn new technologies.

🔥 Latest computer science e-books。提供最新技术类电子书下载， “我无非就是想卷死各位，或者被各位卷死！”

PredictionIO Similar Product Engine Template (Scala-based parallelized engine)

Bulletproof Apache Spark jobs with fast root cause analysis of failures.

Knowage is the professional open source suite for modern business analytics over traditional sources and big data systems.

Celeborn provides an elastic and high-performance service for shuffle and spilled data.

Efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

Serverless proxy for Spark cluster

A distributed in-memory key-value storage for billions of small objects.

Implementation of the k-means algorithm in PyTorch that works for large datasets

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

PredictionIO PHP SDK

Matlab library for gradient descent algorithms: Version 1.0.1

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster

A crawler and API server for Liquor Control Board of Ontario retail data

Scalable, redundant, and distributed object store for Apache Hadoop

Automatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.

Python library for Bayesian hyper-parameters optimization

Distributed stream processing model and its implementation

Enabling queries on compressed data.

swissgeol.ch gives you insight in geoscientific data - above and below the surface.

Samples to the Oracle Big Data Lite VM

Automile offers a simple, smart, cutting-edge telematics solution for businesses to track and manage their business vehicles.

Mirror of Apache Helix

Mirror of Apache Falcon

The open big data serving engine. https://vespa.ai

Mirror of Apache Apex core

🦘 The Grouparoo Monorepo - open source customer data sync framework

Morpheus brings the leading graph query language, Cypher, onto the leading distributed processing platform, Spark.

Structural Bioinformatics Training Workshop & Hackathon 2018

Mirror of Apache CouchDB Mango