GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → mjhea0 → flask-spark-docker

mjhea0 / flask-spark-docker

Licence: MIT license
Just a boilerplate for PySpark and Flask

Programming Languages

python
139335 projects - #7 most used programming language
Dockerfile
14818 projects
HTML
75241 projects
javascript
184084 projects - #8 most used programming language
CSS
56736 projects

Labels

dockerflasksparkpysparkredis-queue

Projects that are alternatives of or similar to flask-spark-docker

Gimel
Big Data Processing Framework - Unified Data API or SQL on Any Storage
Stars: ✭ 216 (+575%)
Mutual labels:  pyspark
pyspark-cassandra
pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4
Stars: ✭ 70 (+118.75%)
Mutual labels:  pyspark
learn-by-examples
Real-world Spark pipelines examples
Stars: ✭ 84 (+162.5%)
Mutual labels:  pyspark
Morphl Community Edition
MorphL Community Edition uses big data and machine learning to predict user behaviors in digital products and services with the end goal of increasing KPIs (click-through rates, conversion rates, etc.) through personalization
Stars: ✭ 253 (+690.63%)
Mutual labels:  pyspark
arena
An interactive UI dashboard for Bee, Bull and BullMQ packages
Stars: ✭ 755 (+2259.38%)
Mutual labels:  redis-queue
qless-php
PHP Bindings for qless
Stars: ✭ 25 (-21.87%)
Mutual labels:  redis-queue
Spark Practice
Apache Spark (PySpark) Practice on Real Data
Stars: ✭ 200 (+525%)
Mutual labels:  pyspark
pyspark-algorithms
PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2
Stars: ✭ 72 (+125%)
Mutual labels:  pyspark
spark3D
Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …
Stars: ✭ 23 (-28.12%)
Mutual labels:  pyspark
soda-spark
Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
Stars: ✭ 58 (+81.25%)
Mutual labels:  pyspark
spark-dgraph-connector
A connector for Apache Spark and PySpark to Dgraph databases.
Stars: ✭ 36 (+12.5%)
Mutual labels:  pyspark
optimus
🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
Stars: ✭ 1,351 (+4121.88%)
Mutual labels:  pyspark
core
Simple JSON-based messaging queue for inter service communication
Stars: ✭ 28 (-12.5%)
Mutual labels:  redis-queue
Quinn
pyspark methods to enhance developer productivity 📣 👯 🎉
Stars: ✭ 217 (+578.13%)
Mutual labels:  pyspark
spark-twitter-sentiment-analysis
Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
Stars: ✭ 55 (+71.88%)
Mutual labels:  pyspark
Mmlspark
Simple and Distributed Machine Learning
Stars: ✭ 2,899 (+8959.38%)
Mutual labels:  pyspark
isarn-sketches-spark
Routines and data structures for using isarn-sketches idiomatically in Apache Spark
Stars: ✭ 28 (-12.5%)
Mutual labels:  pyspark
OSCI
Open Source Contributor Index
Stars: ✭ 107 (+234.38%)
Mutual labels:  pyspark
kafka-twitter-spark-streaming
Counting Tweets Per User in Real-Time
Stars: ✭ 38 (+18.75%)
Mutual labels:  pyspark
jgit-spark-connector
jgit-spark-connector is a library for running scalable data retrieval pipelines that process any number of Git repositories for source code analysis.
Stars: ✭ 71 (+121.88%)
Mutual labels:  pyspark
View All Similar Projects ➔

Flask + Redis Queue + PySpark + Docker

Example of how to handle long-running Spark processes with Flask, Redis Queue, PySpark, and Docker

Quick Start

Spin up the containers:

$ docker-compose up -d --build

Open your browser to http://localhost:5009

Example

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].