456 Open source projects that are alternatives of or similar to spark-extension

MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.

A Spark SQL extension which provides SQL Standard Authorization for Apache Spark

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

Code examples for my blog posts

Efficient variant-call data storage and retrieval library using the TileDB storage library.

A repository to keep track of all the code that I end up writing for my blog posts.

C# and F# language binding and extensions to Apache Spark

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

HL7 Apache Spark Datasource

A luigi powered analytics / warehouse stack

A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.

Coursera's big data course with Scala and Spark

Código para workshops Spark com ambiente de desenvolvimento em docker

深圳地铁大数据客流分析系统🚇🚄🌟

Apache Spark on AWS Lambda

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Implementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters

R interface for Apache Spark

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等

Koalas: pandas API on Apache Spark

CTR prediction model based on spark(LR, GBDT, DNN)

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

A parallel implementation of word2vec based on Spark

Scalable genomic data analysis.

An encrypted data analytics platform

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

Spark Structured Streaming / Kafka / Cassandra / Elastic

Big Data for Data Engineers Coursera Specialization from Yandex

A daily digest of the articles or videos I've found interesting, that I want to share with you.

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

A Jupyter notebook using some standard techniques for data science and data engineering to analyze data for the 2017 flooding in Houston, TX.

DataFusion has now been donated to the Apache Arrow project

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

The MongoDB Spark Connector

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Learning Apache spark,including code and data .Most part can run local.

A robust, and flexible open source User & Entity Behavior Analytics (UEBA) framework used for Security Analytics. Developed with luv by Data Scientists & Security Analysts from the Cyber Security Industry. [PRE-ALPHA]

A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.

Framework of vectorized and distributed data analytics

Real Time Analytics and Data Pipelines based on Spark Streaming

Collaborate on privacy-preserving policy for data science projects in Pandas and Apache Spark

Geo Spatial Data Analytics on Spark

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

编程电子书，电子书，编程书籍，包括C，C#，Docker，Elasticsearch，Git，Hadoop，HeadFirst，Java，Javascript，jvm，Kafka，Linux，Maven，MongoDB，MyBatis，MySQL，Netty，Nginx，Python，RabbitMQ，Redis，Scala，Solr，Spark，Spring，SpringBoot，SpringCloud，TCPIP，Tomcat，Zookeeper，人工智能，大数据类，并发编程，数据库类，数据挖掘，新面试题，架构设计，算法系列，计算机类，设计模式，软件测试，重构优化，等更多分类

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

四川大学拓思爱诺用户session行为数据离线分析项目

An improved implementation of the classical feature selection method: minimum Redundancy and Maximum Relevance (mRMR).

This package contains a generic implementation of greedy Information Theoretic Feature Selection (FS) methods. The implementation is based on the common theoretic framework presented by Gavin Brown. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided.

A complete (distributed) BigData stack, running in containers

Asynchronous actions for PySpark

Writing application logic for Spark jobs that can be unit-tested without a SparkContext

Apache Spark docker container image (Standalone mode)

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc