488 Open source projects that are alternatives of or similar to Spark Fast Tests

Firely's open source FHIR server

Apache Spark Connector for Azure Cosmos DB

Spark, Spark Streaming and Spark SQL unit testing strategies

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

HandySpark - bringing pandas-like capabilities to Spark dataframes

Big Data Processing Framework - Unified Data API or SQL on Any Storage

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

Installations for Data Science. Anaconda, RStudio, Spark, TensorFlow, AWS (Amazon Web Services).

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Apache Spark (PySpark) Practice on Real Data

A better compressed bitset in Java

Monitor Apache Spark from Jupyter Notebook

A Spark library for Amazon SageMaker.

Write your Spark data to Kafka seamlessly

☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs

Vividus is all in one test automation tool

MLOps Platform

Isolation Forest on Spark

Book recommender system using collaborative filtering based on Spark

Profile and monitor your ML data pipeline end-to-end

Java开发者或者大数据开发者面试知识点整理

An open-source toolkit for large-scale genomic analysis

▁▂▄▆▇█▇▆▄▂▁

DataGene - Identify How Similar TS Datasets Are to One Another (by @firmai)

A scalable nearest neighbor search library in Apache Spark

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

Compile-time Language Integrated Queries for Scala

Ruby wrapper for Apache Spark

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

基于Docker构建的Hadoop开发测试环境，包含Hadoop，Hive，HBase，Spark

Unified SQL Analytics Engine Based on SparkSQL

A Spark plugin for reading Excel files via Apache POI

A RPC framework leveraging Spark RPC module

Python clone of Spark, a MapReduce alike framework in Python

State of the Art Natural Language Processing

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

The Internals of Spark SQL

Spark Structured Streaming / Kafka / Cassandra / Elastic

Vim plugin: Testing framework for Vim script

GeoTrellis for PySpark

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Spark、Flink等离线任务的调度以及实时任务的监控

k-Nearest Neighbors algorithm on Spark

Big Data Ecosystem Docker

Applying Data Science and Machine Learning to Solve Real World Business Problems

Simple and beautiful card component with an elegant spark line, for VueJS.

Simple and Distributed Machine Learning

Content for architecting a data science platform for products using Luigi, Spark & Flask.

Human-friendly unit testing for C++11

A Clojure dataframe library that runs on Spark

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

LearningApacheSpark

Apache Spark™ and Scala Workshops

Realtime calculation distributed system. AKA distributed lodash

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

recheck for web apps – change comparison tool with local Golden Masters, Git-like ignore syntax and "Unbreakable Selenium" tests.

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs