3020 Open source projects that are alternatives of or similar to Udacity Data Engineering Projects

step by step guide for aws mini labs. Currently maintained on : https://github.com/Cloud-Yeti/aws-labs Youtube playlist for labs:

Projects done in the Data Engineering Nanodegree by Udacity.com

Personal Data Engineering Projects

A community AWS SDK for Perl Programmers

Database migrations. CLI and Golang library.

A Pi Zero and Motion based webcamera that forwards images to Amazon Web Services for Image Processing

Cluster Lifecycle Manager (CLM) to provision and update multiple Kubernetes clusters

Records actions made in the AWS Management Console and outputs the equivalent CLI/SDK commands and CloudFormation/Terraform templates.

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

A Data Engineering & Machine Learning Knowledge Hub

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

☁️ Deploy to Amazon aws on a virtual private cloud with elastic beanstalk

Security Monkey monitors AWS, GCP, OpenStack, and GitHub orgs for assets and their changes over time.

🎦 🇧🇷 Arquivos do curso "DevOps: AWS com Terraform Automatizando sua infraestrutura" publicado na Udemy. Você pode me ajudar comprando o curso utilizando o link abaixo.

Build better AWS infrastructure

Saves up to 90% of AWS EC2 costs by automating the use of spot instances on existing AutoScaling groups. Installs in minutes using CloudFormation or Terraform. Convenient to deploy at scale using StackSets. Uses tagging to avoid launch configuration changes. Automated spot termination handling. Reliable fallback to on-demand instances.

Database migrations. CLI and Golang library.

Udacity Data Engineering Nano Degree (DEND)

A cloudonaut.io project. Engineered by widdix.

Real Time Twitter Sentiment Analysis Product

A simple AMI and CloudFormation for launching Kubernetes on AWS

CIM takes the pain out of Infrastructure as Code and CloudFormation

Terraform module to deploy Apache Druid in Kubernetes

Zero-abstraction Postgres for TypeScript: a non-ORM database library

An E-commerce app built using MERN stack. It has 4 social login options and implements email verification as well. Stripe and Paypal payment gateways are implemented.

Saves up to 90% of AWS EC2 costs by automating the use of spot instances on existing AutoScaling groups. Installs in minutes using CloudFormation or Terraform. Convenient to deploy at scale using StackSets. Uses tagging to avoid launch configuration changes. Automated spot termination handling. Reliable fallback to on-demand instances.

Astro allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.

Automatic re-connection support for PostgreSQL.

Ansible playbook collection that have been written for Ubuntu. Some of the playbooks are Elasticsearch, Mesos, AWS, MySql, Sensu, Nginx etc..

📦📦➡️🏛️ Provision a library of R packages

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

A toolkit for creating and managing declarative, self-healing infrastructure.

Deploys resources to AWS using maven

Cloudformation templates for deploying Airflow in ECS

Serverless Data Pipeline powered by Kinesis Firehose, API Gateway, Lambda, S3, and Athena

Trackit helps you understand and improve your use of AWS

My handmade cheat-sheets for different AWS services.

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

A template for NodeJS backend projects

TensorBase BE is building a high performance, cloud neutral bigdata warehouse for SMEs fully in Rust.

AWS & Terraform Rocket Start Guide

A visual approach to serverless development. Think. Build. Repeat.

Simple Tool to deploy Cloudformation Templates

Punic is a remote cache CLI built for Carthage and Apple .xcframework

Example of an ETL Pipeline using Airflow

A React web application to query and share any PostgreSQL database.

Library and CLI tool for analysing CloudFormation templates and check them for security compliance.

A curated list of resources and projects for working with AWS CloudFormation.

PostgreSQL High-Availability Cluster (based on "Patroni" and "DCS(etcd)"). Automating deployment with Ansible.

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Lightweight, simple structured NoSQL database for Android

Amazon Simple Storage Service (S3) API Client

Starter Project with Authentication with Gatsby & AWS Amplify

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Automatically tag AWS resources on creation, for cost assignment

A hands on repo with multiple demonstrations on AWS 🎓

Simple Rails & AWS Lambda Integration 🐑🛤

An open source platform for managing and analyzing biomedical big data

The official AWS SDK for Ruby.