458 Open source projects that are alternatives of or similar to Eat_pyspark_in_10_days

Code examples for my blog posts

A Flexible and Powerful Parameter Server for large-scale machine learning

Implementation of Fellegi-Sunter's canonical model of record linkage in Apache Spark, including EM algorithm to estimate parameters

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

A Jupyter notebook using some standard techniques for data science and data engineering to analyze data for the 2017 flooding in Houston, TX.

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

Machine Learning Course @ Santa Clara University

hadoop各组件使用，持续更新

This repo contains commands that data engineers use in day to day work.

Elassandra = Elasticsearch + Apache Cassandra

No description or website provided.

Expressive types for Spark.

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

A Data Engineering & Machine Learning Knowledge Hub

Data validation library for PySpark 3.0.0

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

🔧 Use dplyr to analyze Big Data 🐘

High performance HBase / Spark SQL engine

Distributed scikit-learn meta-estimators in PySpark

Boilerplate for PySpark on Cloud Kubernetes

电商用户行为分析大数据平台

Library for MQL5 (MetaTrader) with Python, Java, Apache Spark, AWS

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

A cohesive & pragmatic framework of FP centric Scala libraries

Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Just a boilerplate for PySpark and Flask

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

PySpark Code for Hands-on Learners

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

Alluxio, data orchestration for analytics and machine learning in the cloud

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Zemberek Türkçe NLP Java Kütüphanesi üzerine REST Docker Sunucu

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …

Essential Spark extensions and helper methods ✨😲

extremely distributed machine learning

Apache Spark Website

Apache Spark - A unified analytics engine for large-scale data processing

Enabling queries on compressed data.

Koalas: pandas API on Apache Spark

Training of Locally Optimized Product Quantization (LOPQ) models for approximate nearest neighbor search of high dimensional data in Python and Spark.

A daily digest of the articles or videos I've found interesting, that I want to share with you.

Code examples on Apache Spark using python

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

An open source framework for building data analytic applications.

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

Udacity Data Engineering Nano Degree (DEND)

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

Spark structured streaming examples with using of version 3.0.0

Profile Photo Camera support for Laravel Spark

type-class based data cleansing library for Apache Spark SQL

A Time Series Library for Apache Spark