443 Open source projects that are alternatives of or similar to Scanns

电商用户行为分析大数据平台

Udacity Data Engineering Nano Degree (DEND)

Example project implementing best practices for PySpark ETL jobs and applications.

Avro SerDe for Apache Spark structured APIs.

Models and Pipelines for the Spark NLP library

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

An open-source vector database for embedding similarity search and AI applications.

Statistical Machine Intelligence & Learning Engine

Google Authenticator support for Laravel Spark

The MongoDB Spark Connector

An encrypted data analytics platform

Learning Apache spark,including code and data .Most part can run local.

Webex Bot SDK for Node.js (deprecated in favor of https://github.com/webex/webex-bot-node-framework)

Essential Spark extensions and helper methods ✨😲

Monitor Apache Spark from Jupyter Notebook

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Custom state store providers for Apache Spark

An open source framework for building data analytic applications.

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Data validation and organization of metadata for data frames and database tables

Spark job for dependency links

Cross-platform real-time collaboration client optimized for business and organizations.

Spark Structured Streaming / Kafka / Cassandra / Elastic

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

Visualize data using relative ordering

大数据博客、笔试题、教程、项目、面经的整理

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

Examples for High Performance Spark

A simple Spark-powered ETL framework that just works 🍺

Tools for handling firmwares of DJI products, with focus on quadcopters.

Julia binding for Apache Spark

A Scala feature transformation library for data science and machine learning

ApacheCN 开源组织：公告、介绍、成员、活动、交流方式

Server for the ListenBrainz project

🌿 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、Kafka、jpa、redies、oauth2、swagger、jsp、docker、spring-batch、异常处理、日志输出、多模块开发、多环境打包、缓存cache、爬虫、jwt、GraphQL、dubbo、zookeeper和Async等等📌

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

gann(go-approximate-nearest-neighbor) is a library for Approximate Nearest Neighbor Search written in Go

Generic Data Ingestion & Dispersal Library for Hadoop

Unified SQL Analytics Engine Based on SparkSQL

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

List of Data Science Cheatsheets to rule the world

一个大数据架构师应该掌握的技能

The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

Building Large-Scale AI Applications for Distributed Big Data

Distributed t-SNE via Apache Spark

TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.

"Sentiment analysis" on a live Twitter feed with Apache Spark and Apache Bahir

The Internals of Spark Structured Streaming

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Next generation tool for decentralized exchange and transformation of semi-structured data

Realtime calculation distributed system. AKA distributed lodash

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

LearningApacheSpark

Source Code for KNN Matting, CVPR 2012 / TPAMI 2013. MATLAB code ready to run. Simple and robust implementation under 40 lines.

Spark 2.0 Python Machine Learning examples

DataFusion has now been donated to the Apache Arrow project