1035 Open source projects that are alternatives of or similar to Sparkrdma

A book about running Elasticsearch

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

Apache CouchDB

Axibase Time Series Database Documentation

Easily make RESTful web services for time series reporting with Big Data analytics engines like Druid and SQL Databases.

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

CrateDB is a distributed SQL database that makes it simple to store and analyze massive amounts of data in real-time.

Hazelcast IMDG C++ Client

Apache Flink is an open source project of The Apache Software Foundation (ASF). The Apache Flink project originated from the Stratosphere research project.

🐳 Tool to automate data quality checks on data pipelines

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

Apache Flink shaded artifacts repository

Distributed, Versioned, Image-oriented Dataservice

Simple and beautiful card component with an elegant spark line, for VueJS.

Relation Extraction using Deep learning(CNN)

Example project implementing best practices for PySpark ETL jobs and applications.

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

Open-source IoT Platform - Device management, data collection, processing and visualization.

This package contains a generic implementation of greedy Information Theoretic Feature Selection (FS) methods. The implementation is based on the common theoretic framework presented by Gavin Brown. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided.

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.

Code generator for fast log file parsers

Distributed t-SNE via Apache Spark

ETL Library for Machine Learning - data pipelines, data munging and wrangling

Word2Vec models with Twitter data using Spark. Blog:

hadoop-mini-clusters provides an easy way to test Hadoop projects directly in your IDE

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

🌐 Interactive Workshop on GeoAnalysis using PySpark

Facebook's Hive UDFs

Career Resources for Data Science, Machine Learning, Big Data and Business Analytics Career Repository

A cohesive & pragmatic framework of FP centric Scala libraries

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

The Accelerator is a tool for fast and reproducible processing of large amounts of data.

Tree diagrams with JavaScript 🌲 📈

Intel® Scalable Dataframe Compiler for Pandas*

A graphical user interface for annotating and editing events detected in long-term acoustic monitoring data

Convert and analyze large data sets at light speed, on Mac and iOS.

Template for Spark Projects

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)

something to help you spark

Boiler plate framework to use Spark and ZIO together.

🎓 Jupyter notebooks from UFC data science course

🍣100本 Java电子书 技术书籍PDF(以下载阅读为荣，以点赞收藏为耻)

Kylo integration with PDND (previously DAF).

State of the Art Natural Language Processing

UC Berkeley team's submission for RecSys Challenge 2018

VerticaPy is a Python library that exposes sci-kit like functionality to conduct data science projects on data stored in Vertica, thus taking advantage Vertica’s speed and built-in analytics and machine learning capabilities.

A project to help people stand in line at the market as little as possible

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

Apache Spark and Apache Kafka integration example

PredictionIO Python SDK

A better compressed bitset in Java

☕️ Java 基础 👫 面向对象思想✏️ 算法 📝 操作系统 ☁️ 网络 💾 数据库 🙊 Spring 💡 系统架构🐘大数据

Node.js bindings for Apache Spark DataFrame APIs

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

基于wifi抓取信息的大数据查询分析系统

DataFusion has now been donated to the Apache Arrow project

HBase客户端数据管理软件

spark summit 2017 SanFrancisco