472 Open source projects that are alternatives of or similar to Net.jgp.labs.spark

hadoop各组件使用，持续更新

Expressive types for Spark.

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

Modin: Speed up your Pandas workflows by changing a single line of code

The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to show how to play with apache spark streaming, kafka,mongo, spark machine learning algorithms.

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

Training models with Apache Spark, PySpark for Titanic Kaggle competition

Clean APIs for data cleaning. Python implementation of R package Janitor

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

Example project implementing best practices for PySpark ETL jobs and applications.

MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

This is a based on playframwork for submit spark app

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

A big data platform for analyzing web access logs

Easy pipelines for pandas DataFrames.

Efficient variant-call data storage and retrieval library using the TileDB storage library.

Alluxio, data orchestration for analytics and machine learning in the cloud

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

一个大数据架构师应该掌握的技能

High performance HBase / Spark SQL engine

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Query processing and transformation of array-backed data tables.

A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.

Technical Analysis Indicators - Pandas TA is an easy to use Python 3 Pandas Extension with 130+ Indicators

Real Time Analytics and Data Pipelines based on Spark Streaming

A simple Spark TDD example

Geo Spatial Data Analytics on Spark

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

Data validation and organization of metadata for data frames and database tables

Fill missing values in Pandas DataFrames using Restricted Boltzmann Machines

Cross-platform real-time collaboration client optimized for business and organizations.

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

A free tutorial for Apache Spark.

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Spark examples

Web UI for Trino, Presto, Hive, Elasticsearch, SparkSQL

Moonbox is a DVtaaS (Data Virtualization as a Service) Platform

Jupyter magics and kernels for working with remote Spark clusters

Scala examples for learning to use Spark

Coursera's big data course with Scala and Spark

Haskell on Apache Spark.

Natural Korean Processor for Apache Spark

A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.

C++ DataFrame for statistical, Financial, and ML analysis -- in modern C++ using native types, continuous memory storage, and no pointers are involved

Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.

MapReduce, Spark, Java, and Scala for Data Algorithms Book

Java全栈知识架构体系总结

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Iceberg is a table format for large, slow-moving tabular data

Apache Spark Connector for Azure Kusto

A curated list of amazingly awesome Cybersecurity datasets

Apache Spark - A unified analytics engine for large-scale data processing

R interface for Apache Spark

A Flexible and Powerful Parameter Server for large-scale machine learning

When Apache Pulsar meets Apache Spark