519 Open source projects that are alternatives of or similar to DataEngineering

Apache Spark (PySpark) Practice on Real Data

dbt-sugar is a CLI tool that allows users of dbt to have fun and ease performing actions around dbt models

Isolation Forest on Spark

tsParticles website templates collection

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

An Elasticsearch client tailored to data science workflows.

LearningApacheSpark

Created with CodeSandbox

Process Common Crawl data with Python and Spark

Embedded Lisp

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…

pyspark🍒🥭 is delicious，just eat it!😋😋

A Real-Time Presentation Application Powered by Phoenix LiveView

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

A React native common components kit and helper methods,find the package at this link https://www.npmjs.com/package/frontatish

Relation Extraction using Deep learning(CNN)

PySpark phonetic and string matching algorithms

PySpark Code for Hands-on Learners

AWS EKS - kubernetes project

Spark 2.0 Python Machine Learning examples

Python package for Customizable Data Preprocessing Pipelines

🌐 Interactive Workshop on GeoAnalysis using PySpark

Login Register Auth App by Delicia Fernandes using Google and Facebook sign in.

A curated list of awesome Apache Spark packages and resources.

👨‍💻 Repo contains my solutions to coding interview problems on various platforms. Will later convert into a React based web app for personal revision.

Jupyter magics and kernels for working with remote Spark clusters

A step by step guide to help people make their first Pull Request

Training models with Apache Spark, PySpark for Titanic Kaggle competition

Amazon EKS Deep Dive 2019

A simple Spark TDD example

A repository to share command line games. An opportunity to start and learn about open source code contributions flow.

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

An open-source app that helps in connecting patients and plasma donors. This is a beginner-friendly repository that helps you learn the basics of android development, git, and GitHub. Happy Hacktober!

This is a repo documenting the best practices in PySpark.

Data validation library for PySpark 3.0.0

A boilerplate for writing PySpark Jobs

PR your joke if you know good ( or horrible ) js joke . I will post it on coding valley's insta page.

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook

Structural Bioinformatics Training Workshop & Hackathon 2018

Code for my presentation: Using PySpark to Process Boat Loads of Data

A library that provides useful extensions to Apache Spark and PySpark.

Here are some of the solutions to HackerRank questions.

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

🎨 Home Assistant soft UI light theme, with help from @JuanMTech, @thomasloven, and @N-l1.

🎼 Docker compose files for various kafka stacks

Just A Rather Very Intelligent System

Some class materials for a data processing course using PySpark

Quickly spin up an AWS EKS Kubernetes cluster using AWS CloudFormation

An Azure Databricks workshop leveraging the New York Taxi and Limousine Commission Trip Records dataset

Transliterate español (spanish) spelling to andaluz proposals using javascript

This repository contains Leetcode Challenge Submissions.

Arduino on TinkerCad

Instant Kubernetes-Native Application Observability

No description or website provided.

No description or website provided.

Traverser is a Java library that helps software engineers implement advanced iteration of a data structure.

No description or website provided.

Short explanations and implementations of different algorithms in multiple languages

My ongoing effort to learn how to make Ray Tracers