7598 Open source projects that are alternatives of or similar to Data Engineering Nanodegree

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Personal Data Engineering Projects

Udacity Data Engineering Nano Degree (DEND)

A collection of the latest AWS Security workshops

Compile-time Language Integrated Queries for Scala

Deploy and scale serverless machine learning app - in 4 steps.

Database migrations. CLI and Golang library.

📝 A compilation of everything that I learn; Computer Science, Software Development, Engineering, Math, and Coding in General. Read the rendered results here ->

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

Source code accompanying book: Data Science on the Google Cloud Platform, Valliappa Lakshmanan, O'Reilly 2017

AWS Retail Demo Store is a sample retail web application and workshop platform demonstrating how AWS infrastructure and services can be used to build compelling customer experiences for eCommerce, retail, and digital marketing use-cases

LabNotebook is a tool that allows you to flexibly monitor, record, save, and query all your machine learning experiments.

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

A package for managing PostgreSQL connections at SERVERLESS scale

Pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Automatic instrumentation for 3rd-party libraries in Java applications with OpenTracing.

🐳📊🤓Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & API Star)

Quilt is a self-organizing data hub for S3

[Book-2019] Pragmatic AI: An Introduction to Cloud-based Machine Learning

Enterprise-grade, production-hardened, serverless data lake on AWS

Serverless Platform for the stateful services

Web-based SQL editor run in your own private cloud. Supports MySQL, Postgres, SQL Server, Vertica, Crate, ClickHouse, Trino, Presto, SAP HANA, Cassandra, Snowflake, BigQuery, SQLite, and more with ODBC

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

Ansible playbook to deploy distributed technologies

Database migrations. CLI and Golang library.

🐍💻📊 All material from the PyCon.DE 2018 Talk "Beyond Jupyter Notebooks - Building your own data science platform with Python & Docker" (incl. Slides, Video, Udemy MOOC & other References)

SQLCell is a magic function for the Jupyter Notebook that executes raw, parallel, parameterized SQL queries with the ability to accept Python values as parameters and assign output data to Python variables while concurrently running Python code. And *much* more.

Julia Project web site (Old)

🛠 All-in-one web-based IDE specialized for machine learning and data science.

A collection of Pyomo examples

Example multi-region AWS Terraform application

Terraform module to create an Elastic Kubernetes (EKS) cluster and associated worker instances on AWS

Tools for Sensor Fusion processing.

Source code to accompany my paper "Poetic sound similarity vectors using phonetic features"

Feature selector is a tool for dimensionality reduction of machine learning datasets

基于v2版本的deeplab,使用VGG16模型，在VOC2012，Pascal-context，NYU-v2等多个数据集上进行训练

Deploying and managing production-grade etcd clusters on cloud providers: failure recovery, disaster recovery, backups and resizing.

Various math-related things in Python code

Face Depixelizer based on "PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models" repository.

🇰🇷PyTorch에서 제공하는 튜토리얼의 한국어 번역을 위한 저장소입니다. (Translate PyTorch tutorials in Korean🇰🇷)

python，机器学习笔记，machine learning，nlp

Scenarios, tutorials and demos for Autonomous Driving

Time Series Forecasting Best Practices & Examples

🌎 machine learning tutorials (mainly in Python3)

Fork of django-postgres that focuses on maintaining and improving support for Postgres SQL Views.

C/C++/Python based computer vision models using OpenPose, OpenCV, DLIB, Keras and Tensorflow libraries. Object Detection, Tracking, Face Recognition, Gesture, Emotion and Posture Recognition

Example Docker setup for a Django app behind an Nginx proxy with Celery workers

Training a Neural Network to Detect Gestures and Control Smart Home Devices with OpenCV in Python

https://www.udemy.com/python-for-finance-and-trading-algorithms/

GitHub Link Card Creator lets you generate GitHub images has links to repositories.

Notes & exercise solutions of Part I from the book: "Hands-On ML with Scikit-Learn, Keras & TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems" by Aurelien Geron

Notebooks for upcoming fastai book (draft / incomplete)

Main code for Parcels (Probably A Really Computationally Efficient Lagrangian Simulator)

A Portfolio of my Data Science Projects

A Practical Guide to Deep Learning with TensorFlow 2.0 and Keras materials for Frontend Masters course

Implementation code for the paper "Generating Natural Language Adversarial Examples"