415 Open source projects that are alternatives of or similar to Spark-PMoF

Identifies and collects data on cc-licensed content across web crawl data and public apis.

Spark, Spark Streaming and Spark SQL unit testing strategies

Big Compute Learning Labs

Java开发者或者大数据开发者面试知识点整理

Visualize column-level data lineage in Spark SQL

Apache Spark (PySpark) Practice on Real Data

DaRPC: Data Center Remote Procedure Call

A scalable nearest neighbor search library in Apache Spark

ksmbd kernel server(SMB/CIFS server)

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs

Passive Disaggregated Persistent Memory at USENIX ATC 2020.

A better compressed bitset in Java

Apache Spark docker container image (Standalone mode)

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

Automatic library-wide shuffle for mpd.

Write your Spark data to Kafka seamlessly

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

Firely's open source FHIR server

Framework providing operating system abstractions and a range of shared networking (RDMA, TCP/IP) and memory services to common modern heterogeneous platforms.

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

spark on kubernetes

Spark Structured Streaming / Kafka / Cassandra / Elastic

Transpose: SIMD Integer+Floating Point Compression Filter

GeoTrellis for PySpark

Open-source distribute workflow schedule tools, also support streaming task.

Spark、Flink等离线任务的调度以及实时任务的监控

REST job server for Apache Spark

Big Data Ecosystem Docker

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Simple and beautiful card component with an elegant spark line, for VueJS.

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)

Content for architecting a data science platform for products using Luigi, Spark & Flask.

Resources for Spark AR

A Clojure dataframe library that runs on Spark

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Monitor Apache Spark from Jupyter Notebook

Online search advertisement platform & Realtime Campaign Monitoring [Maybe Deprecated]

Julia binding for Apache Spark

Python clone of Spark, a MapReduce alike framework in Python

Distributed t-SNE via Apache Spark

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

Fundamentals of Spark with Python (using PySpark), code examples

人生苦短 我用Python

Updated repository

☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs

DataStax Spark Cassandra Connector

Spark functions to run popular phonetic and string matching algorithms

Fast, Scientific and Numerical Computing for the JVM (NDArrays)

Installations for Data Science. Anaconda, RStudio, Spark, TensorFlow, AWS (Amazon Web Services).

Geospatial Raster support for Spark DataFrames

Apache Spark in your IDE with gradle

Ruby wrapper for Apache Spark

▁▂▄▆▇█▇▆▄▂▁

基于Spark2.2新闻网大数据实时系统项目

🎼 Docker compose files for various kafka stacks

ACID Data Source for Apache Spark based on Hive ACID

low-level helpers for Apache Spark libraries and tests

No description or website provided.