526 Open source projects that are alternatives of or similar to Sparklint

Qubole Sparklens tool for performance tuning Apache Spark

A Data Engineering & Machine Learning Knowledge Hub

UC Berkeley team's submission for RecSys Challenge 2018

KInspector is an application for analyzing health, performance and security of your Kentico solution.

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Flexible HTTP command line stress tester for websites and web services

Minikube for big data with Scala and Spark

Create clusters of VMs on the cloud and configure them with Ansible.

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

A compiler for automatically re-targeting sequential Java code to Apache Spark.

Comparing Database performance with Django ORM

DEPRECATED StackImpact Go Profiler - Production-Grade Performance Profiler: CPU, memory allocations, blocking calls, errors, metrics, and more

Kylo integration with PDND (previously DAF).

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

Developing Spark External Data Sources using the V2 API

The Hunting ELK

IGUANA is a benchmark execution framework for querying HTTP endpoints and CLI Applications such as Triple Stores. Contact: [email protected]

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

blog entries

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

A library that provides useful extensions to Apache Spark and PySpark.

Interactive and Reactive Data Science using Scala and Spark.

Profile Photo Camera support for Laravel Spark

improved go tool trace goroutine analysis

Type System for Data Analysis in Python

One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)

Spark RDD to read, write and delete from HBase

spark structured streaming via HTTP communication

Data Lineage Tracking And Visualization Solution

A Tool for Detecting Performance Bugs in Rails Applications

ETL Library for Machine Learning - data pipelines, data munging and wrangling

dllib is a distributed deep learning library running on Apache Spark

酷玩 Spark: Spark 源代码解析、Spark 类库等

尚硅谷大数据Spark-2019版最新 Spark 学习

Single header C++ logging library. It is extremely powerful, extendable, light-weight, fast performing, thread and type safe and consists of many built-in features. It provides ability to write logs in your own customized format. It also provide support for logging your classes, third-party libraries, STL and third-party containers etc.

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

A curated list of awesome resources related to the Ada and SPARK programming language

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

A simple spark standalone cluster for your testing environment purposses

A Robinhood style COVID-19 🦠 Android tracking app for the US. Open source and built with Kotlin.

Fair job scheduler on Kubernetes and Mesos for batch workloads and Spark

Benchmark your application on CI

Distributed scikit-learn meta-estimators in PySpark

🤖⚡ | The most POWERFUL multipurpose chat/meme bot that will boost the activity in your server.

Connect Spark to HBase for reading and writing data with ease

Model complex data transformation pipelines easily

Enabling queries on compressed data.

A complete (distributed) BigData stack, running in containers

Simple framework agnostic UI router for SPAs

Trace memory allocations and collect stats

Spark structured streaming examples with using of version 3.0.0

HL7 Apache Spark Datasource

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

Collection of different demo applications using Apache Spark

Template for Spark Projects

Frontend Wingman, Learn frontend faster!

ClickHouse Native Protocol JDBC implementation

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.