108 Open source projects that are alternatives of or similar to Azure-Databricks-NYC-Taxi-Workshop

Collection of Databricks and Jupyter Notebooks

ETL jobs for Firefox Telemetry

Counting Tweets Per User in Real-Time

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Just a boilerplate for PySpark and Flask

Detect common phrases in large amounts of text using a data-driven approach. Size of discovered phrases can be arbitrary. Can be used in languages other than English

GitHub Action that allows you to register models to your Azure Machine Learning Workspace.

No description or website provided.

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

Código para workshops Spark com ambiente de desenvolvimento em docker

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Anovos - An Open Source Library for Scalable feature engineering Using Apache-Spark

GitHub Action that allows you to deploy machine learning models in Azure Machine Learning.

Open Source Contributor Index

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…

Real-world Spark pipelines examples

A sample Azure Machine Learning project for Transfer Learning-based custom image recognition by utilizing Keras.

jgit-spark-connector is a library for running scalable data retrieval pipelines that process any number of Git repositories for source code analysis.

Deploying a Batch Scoring Pipeline for Python Models

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …

PySpark phonetic and string matching algorithms

MorphL Community Edition uses big data and machine learning to predict user behaviors in digital products and services with the end goal of increasing KPIs (click-through rates, conversion rates, etc.) through personalization

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

Code for my presentation: Using PySpark to Process Boat Loads of Data

Apache Spark (PySpark) Practice on Real Data

Isolation Forest on Spark

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Simple and Distributed Machine Learning

This repository contains the code for the blogpost: How to Develop a Currency Detection Model using Azure Machine Learning

This repo contains commands that data engineers use in day to day work.

Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution

JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook

PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2

Distributed least squares approximation (dlsa) implemented with Apache Spark

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

Boilerplate for PySpark on Cloud Kubernetes

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

GitHub Action that allows you to create or connect to your Azure Machine Learning Workspace.

Microsoft buduje i tworzy Polską Dolinę Cyfrową. W ramach tej inicjatywy podjęliśmy się wyzwania zbudowania chmurowych kompetencji wśród 150tys osób w Polsce. Jednym z elementów tej inicjatywy jest dedykowany kurs na studiach inzynierskich i magisterskich na Politechnice Warszawskiej poświęcony chmurze obliczeniowej oraz sztucznej inteligencji.

Apache Spark Connector for Azure Cosmos DB

Using Azure Databricks (Spark) for ML, this is the //build 2019 repository with homework examples, code and notebooks

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster

pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4

BentoML Example Projects 🎨

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

A lightweight data processing framework for Apache Spark

A connector for Apache Spark and PySpark to Dgraph databases.

GitHub Action that allows you to attach, create and scale Azure Machine Learning compute resources.

pyspark methods to enhance developer productivity 📣 👯 🎉

Machine Learning Course @ Santa Clara University

Simple and Distributed Machine Learning

Azure Machine Learning Cheat Sheets

State of the Art Natural Language Processing

Apache Spark for data engineers

Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

Generate beautiful documentation for your data pipelines in markdown format

Data validation library for PySpark 3.0.0

This is a place to put s2i images and utilities for spark application builders for openshift