Udacity Data Engineering ProjectsFew projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
Stars: ✭ 458 (+2190%)
trackitTrackit helps you understand and improve your use of AWS
Stars: ✭ 91 (+355%)
Ansible PlaybooksAnsible playbook collection that have been written for Ubuntu. Some of the playbooks are Elasticsearch, Mesos, AWS, MySql, Sensu, Nginx etc..
Stars: ✭ 429 (+2045%)
Security monkeySecurity Monkey monitors AWS, GCP, OpenStack, and GitHub orgs for assets and their changes over time.
Stars: ✭ 4,244 (+21120%)
cloud-cheat-sheetsMy handmade cheat-sheets for different AWS services.
Stars: ✭ 63 (+215%)
Curso Aws Com Terraform🎦 🇧🇷 Arquivos do curso "DevOps: AWS com Terraform Automatizando sua infraestrutura" publicado na Udemy. Você pode me ajudar comprando o curso utilizando o link abaixo.
Stars: ✭ 62 (+210%)
awesome-aws-researchA curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources for Academic Researchers new to AWS
Stars: ✭ 41 (+105%)
Aws Labsstep by step guide for aws mini labs. Currently maintained on : https://github.com/Cloud-Yeti/aws-labs Youtube playlist for labs:
Stars: ✭ 153 (+665%)
Spark Jupyter AwsA guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support
Stars: ✭ 259 (+1195%)
Aws Deployment Guide☁️ Deploy to Amazon aws on a virtual private cloud with elastic beanstalk
Stars: ✭ 89 (+345%)
Aws Csa Notes 2018My AWS Certified Solutions Architect Associate Study Notes!
Stars: ✭ 167 (+735%)
Docker AirflowRepo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializing GCP while container booting. https://abhioncbr.github.io/docker-airflow/
Stars: ✭ 29 (+45%)
multer-sharp-s3Multer Sharp S3 is streaming multer storage engine permit to transform / resize the image and upload to AWS S3.
Stars: ✭ 54 (+170%)
pipelinePipelineAI Kubeflow Distribution
Stars: ✭ 4,154 (+20670%)
simple-file-uploaderA file uploader written using HTML5 and Node.js. It can upload both to a local directory on the server or to an AWS S3 server.
Stars: ✭ 85 (+325%)
nexradawsThis python package is designed to provide query and download capabilities to the NEXRAD archive available on Amazon Web Services (AWS). https://aws.amazon.com/public-datasets/nexrad/
Stars: ✭ 32 (+60%)
bring-your-own-data-labsBring your own data Labs: Build a serverless data pipeline based on your own data
Stars: ✭ 40 (+100%)
backmeupBackMeUp: An automated MySQL / MariaDB databases and files backup solution on *nix Machines using Amazon S3, WebDAV (ownCloud / NextCloud etc.), Google Drive and Dropbox.
Stars: ✭ 80 (+300%)
ami-specAcceptance testing your AMIs
Stars: ✭ 47 (+135%)
trackit2-homeTrackIt helps you to optimize your AWS cloud
Stars: ✭ 46 (+130%)
static-aws-deployA tool for deploying files to an AWS S3 bucket with configurable headers and invalidating AWS Cloudfront Objects.
Stars: ✭ 27 (+35%)
Insight-GDELT-FeedA way for home buyers to know about factors affecting a state
Stars: ✭ 43 (+115%)
airflow-dbt-pythonA collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.
Stars: ✭ 111 (+455%)
kedro-airflow-k8sKedro Plugin to support running pipelines on Kubernetes using Airflow.
Stars: ✭ 22 (+10%)
AirflowETLBlog post on ETL pipelines with Airflow
Stars: ✭ 20 (+0%)
incremental trainingRepo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'
Stars: ✭ 110 (+450%)
aircan💨🥫 A Data Factory system for running data processing pipelines built on AirFlow and tailored to CKAN. Includes evolution of DataPusher and Xloader for loading data to DataStore.
Stars: ✭ 24 (+20%)
sigilAWS SSM Session manager client
Stars: ✭ 67 (+235%)
ExDeMonA general purpose metrics monitor implemented with Apache Spark. Kafka source, Elastic sink, aggregate metrics, different analysis, notifications, actions, live configuration update, missing metrics, ...
Stars: ✭ 19 (-5%)
amazon-cloudwatch-auto-alarmsAutomatically create and configure Amazon CloudWatch alarms for EC2 instances, RDS, and AWS Lambda using tags for standard and custom CloudWatch Metrics.
Stars: ✭ 52 (+160%)
akka-persistence-s3akka-persistence journal/snapshot plugin for AWS S3(support aws sdk for java v2)
Stars: ✭ 19 (-5%)
amigen7Set of tools to provide automation of tasks for creating STIG-partitioned EL7 AMIs
Stars: ✭ 33 (+65%)
termscp🖥 A feature rich terminal UI file transfer and explorer with support for SCP/SFTP/FTP/S3
Stars: ✭ 707 (+3435%)
ossperfA lightweight tool for analyzing the performance and data integrity of object-based storage services
Stars: ✭ 67 (+235%)
ec2detailsAPI providing AWS EC2 Instance Type Data
Stars: ✭ 37 (+85%)
kedro-airflowKedro-Airflow makes it easy to deploy Kedro projects to Airflow.
Stars: ✭ 121 (+505%)
Example Airflow DagsExample DAGs using hooks and operators from Airflow Plugins
Stars: ✭ 243 (+1115%)
PaperboyA web frontend for scheduling Jupyter notebook reports
Stars: ✭ 221 (+1005%)
Spark ALS基于spark-ml,spark-mllib,spark-streaming的推荐算法实现
Stars: ✭ 89 (+345%)
gingerServerless framework for Go runtime.
Stars: ✭ 16 (-20%)
Soda SqlMetric collection, data testing and monitoring for SQL accessible data
Stars: ✭ 173 (+765%)
image-uploaderJavaScript Image Uploader Library for use with Amazon S3
Stars: ✭ 19 (-5%)
Airflow TestingAirflow Unit Tests and Integration Tests
Stars: ✭ 175 (+775%)
s3 uploaderMultithreaded recursive directory upload to S3 using FOG
Stars: ✭ 36 (+80%)
s3-fuzzer🔐 A concurrent, command-line AWS S3 Fuzzer. Written in Go.
Stars: ✭ 43 (+115%)
fdp-modelserverAn umbrella project for multiple implementations of model serving
Stars: ✭ 47 (+135%)
Airflow ExporterAirflow plugin to export dag and task based metrics to Prometheus.
Stars: ✭ 161 (+705%)
Data Science Stack Cookiecutter🐳📊🤓Cookiecutter template to launch an awesome dockerized Data Science toolstack (incl. Jupyster, Superset, Postgres, Minio, AirFlow & API Star)
Stars: ✭ 153 (+665%)
lessGo serverless website on AWS Lambda.
Stars: ✭ 22 (+10%)
Airflow ChartA Helm chart to install Apache Airflow on Kubernetes
Stars: ✭ 137 (+585%)