497 Open source projects that are alternatives of or similar to check-engine

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Structural Bioinformatics Training Workshop & Hackathon 2018

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Simple and Distributed Machine Learning

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Fundamentals of Spark with Python (using PySpark), code examples

Demo of PySpark and Jupyter Notebook with the Jupyter Docker Stacks

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster

[NOT MAINTAINED] Predicting Bit coin price using Time series analysis and sentiment analysis of tweets on bitcoin

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

Simple and Distributed Machine Learning

An open-source, real-time Security Information & Event Management tool based on big data technologies, providing a scalable, advanced security analytics framework.

☁️ nodejs kafka connect connector for Google BigQuery

Mirror of Apache Airavata PHP Gateway

A boilerplate project for Azure Big Data PaaS services

Materials for "Machine Learning on Big Data" course

Detect common phrases in large amounts of text using a data-driven approach. Size of discovered phrases can be arbitrary. Can be used in languages other than English

Apache Beam Site

PySpark phonetic and string matching algorithms

Win probability predictions for League of Legends matches using neural networks

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

This project aim is to provide free software to fetch data from plcs (Siemens S7-300/400/1200/1500) and store it. Used stack is completly opensource. I used InfluDB as data storage, so application principle is following Big Data paradigm.

Versatile Data Kit (VDK) is an open source framework that enables anybody with basic SQL or Python knowledge to create their own data pipelines.

基于Vue、three.js、echarts，数据可视化展示项目，包含三维模型导入交互、三维模型标注等功能

Librería para la evaluación de calidad de datos, e interacción con el portal de datos.gov.co

Code for my presentation: Using PySpark to Process Boat Loads of Data

Collection of Databricks and Jupyter Notebooks

A High-Performance Data Science Toolkit for the Earth Sciences

rastercube is a python library for big data analysis of georeferenced time series data (e.g. MODIS NDVI)

Base types for OnlineStats.

ETL jobs for Firefox Telemetry

JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook

🔥 Latest computer science e-books。提供最新技术类电子书下载， “我无非就是想卷死各位，或者被各位卷死！”

Migrated to: https://gitlab.com/Oslandia/osm-data-classification

Bulletproof Apache Spark jobs with fast root cause analysis of failures.

Apache Arrow DataFusion SQL Query Engine

Toolkit for highly memory efficient analysis of single-cell RNA-Seq, scATAC-Seq and CITE-Seq data. Analyze atlas scale datasets with millions of cells on laptop.

"Byteslice: Pushing the envelop of main memory data processing with a new storage layout" (SIGMOD'15)

Celeborn provides an elastic and high-performance service for shuffle and spilled data.

Boilerplate for PySpark on Cloud Kubernetes

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

🔥 One of the most comprehensive open-source data annotation platform.

Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟

MATLAB/Octave library for stochastic optimization algorithms: Version 1.0.20

Apache Spark Data Source for ROOT File Format

A distributed in-memory key-value storage for billions of small objects.

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

InsightEdge Core

A distributed, fast open-source graph database featuring horizontal scalability and high availability

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

Big Data Visualization

DevOps pipeline for Real Time Social/Web Mining

Matlab library for gradient descent algorithms: Version 1.0.1

an online learning algorithm library for Storm

The open-source IATI datastore for IATI data with RESTful web API providing XML, JSON, CSV output. It extracts and parses IATI XML files referenced in the IATI Registry and powered by Apache Solr.

Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production. Liminal provides a Domain Specific Language to build ML workflows on top of Apache Airflow.

Powerful product analytics for data teams, with full control over data & models.