200 Open source projects that are alternatives of or similar to Quinn

A tool for building feature stores.

Cloud-based SQL engine using SPARK where data is accessible as JDBC/ODBC data source via Spark ThriftServer.

HandySpark - bringing pandas-like capabilities to Spark dataframes

Apache Zeppelin notebooks for Recommendation Engines using Keras and Machine Learning on Apache Spark

pyspark🍒🥭 is delicious，just eat it!😋😋

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Training models with Apache Spark, PySpark for Titanic Kaggle competition

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

Demo of PySpark and Jupyter Notebook with the Jupyter Docker Stacks

A library on top of either pex or conda-pack to make your Python code easily available on a cluster

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

R interface for Apache Spark

Spark structured streaming examples with using of version 3.0.0

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

When Apache Pulsar meets Apache Spark

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

Process Common Crawl data with Python and Spark

Streaming System 相关的论文读物

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Haskell on Apache Spark.

Isolation Forest on Spark

This is a repo documenting the best practices in PySpark.

[NOT MAINTAINED] Predicting Bit coin price using Time series analysis and sentiment analysis of tweets on bitcoin

A list about Apache Kafka

Simple windows desktop application for viewing & querying Apache Parquet files

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.

A framework for writing Spark 2.x applications in a pretty way

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

Open source platform for the machine learning lifecycle

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray

A Spark Atlas connector to track data lineage in Apache Atlas

Apache Spark on AWS Lambda

A library that provides useful extensions to Apache Spark and PySpark.

A visual ETL development and debugging tool for big data

Interactive and Reactive Data Science using Scala and Spark.

🌐 Interactive Workshop on GeoAnalysis using PySpark

🏐 Apache Parquet for modern .NET

Profile and monitor your ML data pipeline end-to-end

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

A curated list of Pulsar tools, integrations and resources.

Automatically setup a productive development environment with Ansible on macOS

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

PySpark + Scikit-learn = Sparkit-learn

Simple demonstration of how to build a complex real time machine learning visualization tool.

Natural Korean Processor for Apache Spark

Use the TPC-DS benchmark to test Spark SQL performance

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

(Deprecated) Scikit-learn integration package for Apache Spark

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

🎼 Docker compose files for various kafka stacks

The Internals of Apache Spark

Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time

Apache Spark in your IDE with gradle

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

BERT, AWS RDS, AWS Forecast, EMR Spark Cluster, Hive, Serverless, Google Assistant + Raspberry Pi, Infrared, Google Cloud Platform Natural Language, Anomaly detection, Tensorflow, Mathematics

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

Map Reduce Implementation of Connected Component on Apache Spark

Some class materials for a data processing course using PySpark