443 Open source projects that are alternatives of or similar to Scanns

An improved implementation of the classical feature selection method: minimum Redundancy and Maximum Relevance (mRMR).

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

A tool for monitoring and tuning Spark jobs for efficiency.

Open-source IoT Platform - Device management, data collection, processing and visualization.

ClickHouse Native Protocol JDBC implementation

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

RSparkling: Use H2O Sparkling Water from R (Spark + R + Machine Learning)

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

A better compressed bitset in Java

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

Word2Vec models with Twitter data using Spark. Blog:

Create clusters of VMs on the cloud and configure them with Ansible.

Boiler plate framework to use Spark and ZIO together.

Interactive and Reactive Data Science using Scala and Spark.

🌐 Interactive Workshop on GeoAnalysis using PySpark

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

Fundamentals of Spark with Python (using PySpark), code examples

ETL Library for Machine Learning - data pipelines, data munging and wrangling

Library for MQL5 (MetaTrader) with Python, Java, Apache Spark, AWS

A simple spark standalone cluster for your testing environment purposses

Apache Spark and Apache Kafka integration example

Distributed scikit-learn meta-estimators in PySpark

something to help you spark

Enabling queries on compressed data.

Spark、Flink等离线任务的调度以及实时任务的监控

Spark structured streaming examples with using of version 3.0.0

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

Template for Spark Projects

Kinesis Connector for Structured Streaming

One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)

Zemberek Türkçe NLP Java Kütüphanesi üzerine REST Docker Sunucu

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Updated repository

dllib is a distributed deep learning library running on Apache Spark

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

尚硅谷大数据Spark-2019版最新 Spark 学习

A pandas-like deferred expression system, with first-class SQL support

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

Code and presentation for Strata Model Serving tutorial

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

A RPC framework leveraging Spark RPC module

blog entries

Apache Spark examples exclusively in Java

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

Spark RDD with Lucene's query and entity linkage capabilities

Model complex data transformation pipelines easily

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

Open-source vector similarity search for Postgres

DataStax Spark Cassandra Connector

scala、spark使用过程中，各种测试用例以及相关资料整理

Realtime calculation distributed system. AKA distributed lodash

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

LearningApacheSpark

Source Code for KNN Matting, CVPR 2012 / TPAMI 2013. MATLAB code ready to run. Simple and robust implementation under 40 lines.

Spark 2.0 Python Machine Learning examples

DataFusion has now been donated to the Apache Arrow project