399 Open source projects that are alternatives of or similar to spark-http-stream

This package contains a generic implementation of greedy Information Theoretic Feature Selection (FS) methods. The implementation is based on the common theoretic framework presented by Gavin Brown. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided.

Scalable genomic data analysis.

Code Library for My Blog

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

Example project implementing best practices for PySpark ETL jobs and applications.

MLOps Platform

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

pyspark🍒🥭 is delicious，just eat it!😋😋

DataFusion has now been donated to the Apache Arrow project

UC Berkeley team's submission for RecSys Challenge 2018

The MongoDB Spark Connector

Spark Streaming监控平台，支持任务部署与告警、自启动

Learning Apache spark,including code and data .Most part can run local.

k-Nearest Neighbors algorithm on Spark

A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.

Elassandra = Elasticsearch + Apache Cassandra

Real Time Analytics and Data Pipelines based on Spark Streaming

low-level helpers for Apache Spark libraries and tests

Geo Spatial Data Analytics on Spark

Spark RDD with Lucene's query and entity linkage capabilities

编程电子书，电子书，编程书籍，包括C，C#，Docker，Elasticsearch，Git，Hadoop，HeadFirst，Java，Javascript，jvm，Kafka，Linux，Maven，MongoDB，MyBatis，MySQL，Netty，Nginx，Python，RabbitMQ，Redis，Scala，Solr，Spark，Spring，SpringBoot，SpringCloud，TCPIP，Tomcat，Zookeeper，人工智能，大数据类，并发编程，数据库类，数据挖掘，新面试题，架构设计，算法系列，计算机类，设计模式，软件测试，重构优化，等更多分类

Simple and Distributed Machine Learning

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

大数据博客、笔试题、教程、项目、面经的整理

Collection of different demo applications using Apache Spark

Examples for High Performance Spark

Data science and Big Data with Python

Tools for handling firmwares of DJI products, with focus on quadcopters.

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

A Scala feature transformation library for data science and machine learning

Distributed Deep learning with Keras & Spark

Server for the ListenBrainz project

Some class materials for a data processing course using PySpark

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Production Ready Data Integration Product, documentation：

Generic Data Ingestion & Dispersal Library for Hadoop

Realtime calculation distributed system. AKA distributed lodash

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Two-day workshop that covers how to use R to interact databases and Spark

一个大数据架构师应该掌握的技能

A Robinhood style COVID-19 🦠 Android tracking app for the US. Open source and built with Kotlin.

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

A distributed data processing framework in Haskell.

Building Large-Scale AI Applications for Distributed Big Data

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

Machine Learning Platform and Recommendation Engine built on Kubernetes

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

dllib is a distributed deep learning library running on Apache Spark

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

A library that provides useful extensions to Apache Spark and PySpark.

人生苦短 我用Python

Python clone of Spark, a MapReduce alike framework in Python

Fast, Scientific and Numerical Computing for the JVM (NDArrays)