All Projects → miqdigital → aws-utils

miqdigital / aws-utils

Licence: GPL-3.0 license
This repository provides utilities which are used at MiQ.

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to aws-utils

docker base images
Vlad's Base Images for Docker
Stars: ✭ 61 (+205%)
Mutual labels:  backup, s3, aws-cli
Duplicacy Autobackup
💾 Painless automated backups to multiple storage providers with Docker and duplicacy.
Stars: ✭ 214 (+970%)
Mutual labels:  backup, s3
Walrus
🔥 Fast, Secure and Reliable System Backup, Set up in Minutes.
Stars: ✭ 197 (+885%)
Mutual labels:  backup, s3
aws-tag-sched-ops
Retired, please see https://github.com/sqlxpert/lights-off-aws
Stars: ✭ 24 (+20%)
Mutual labels:  backup, ami
Wal G
Archival and Restoration for Postgres
Stars: ✭ 1,974 (+9770%)
Mutual labels:  backup, s3
Docker S3 Volume
Docker container with a data volume from s3.
Stars: ✭ 166 (+730%)
Mutual labels:  backup, s3
mindav
A self-hosted file backup server which bridges WebDAV protocol with @minio written in @totoval. Webdav ❤️ Minio
Stars: ✭ 64 (+220%)
Mutual labels:  backup, s3
S3cmd
Official s3cmd repo -- Command line tool for managing Amazon S3 and CloudFront services
Stars: ✭ 3,767 (+18735%)
Mutual labels:  backup, s3
awesome-storage
A curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.
Stars: ✭ 324 (+1520%)
Mutual labels:  backup, s3
backup-suite
Backup database, static files and config to AWS S3 with Cronjob
Stars: ✭ 32 (+60%)
Mutual labels:  backup, s3
terraform-aws-efs-backup
Terraform module designed to easily backup EFS filesystems to S3 using DataPipeline
Stars: ✭ 40 (+100%)
Mutual labels:  backup, s3
Pgbackrest
Reliable PostgreSQL Backup & Restore
Stars: ✭ 766 (+3730%)
Mutual labels:  backup, s3
Backup
Easy full stack backup operations on UNIX-like systems.
Stars: ✭ 4,682 (+23310%)
Mutual labels:  backup, s3
Git S3 Push
Deploy your git repo to an S3 bucket
Stars: ✭ 182 (+810%)
Mutual labels:  backup, s3
Clickhouse Backup
Tool for easy ClickHouse backup and restore with cloud storages support
Stars: ✭ 359 (+1695%)
Mutual labels:  backup, s3
backup-repository
Backup storage for E2E GPG-encrypted files, with multi-user, quotas, versioning, using a object storage (S3/Min.io/GCS etc.) and deployed on Kubernetes or standalone.
Stars: ✭ 21 (+5%)
Mutual labels:  backup, s3
minback-postgres
A container which provides the ability to backup a PostgreSQL database to Minio on demand
Stars: ✭ 18 (-10%)
Mutual labels:  backup, s3
Burry.sh
Cloud Native Infrastructure BackUp & RecoveRY
Stars: ✭ 260 (+1200%)
Mutual labels:  backup, s3
Wal E
Continuous Archiving for Postgres
Stars: ✭ 3,313 (+16465%)
Mutual labels:  backup, s3
s3cli
Command line tool for S3
Stars: ✭ 21 (+5%)
Mutual labels:  s3, aws-cli

Introduction

This repository provides utilities which are used at MiQ. MiQ has been using AWS tech stack as it's the backbone and has been using many utilities to help scale their product.


Available Executors

S3 Select Executor

This utility provides a set of python scripts to effectively run S3 Select commands on the AWS S3 files. Used for validation and ad hoc filtering. Documentation

AMI Backup Executor

This function is for creating AMI as a backup for required instance and delete older AMI's based on the retention period we provide. Every AMI and EBS Snapshots created will inherit all tags from instance

RDS Disaster Recovery

The scripts present can be used to setup disaster recovery for RDS in AWS. It creates a manual snapshot of the current db present in production(source) region, then copies that snapshot to the DR(destination) region and if the disaster occurs db can be restored from the snapshots present in the DR region.

Route53 Entry Creation

The script present automates the process of creating/modifying the AWS Route 53 entries via a python script using Boto3(Amazon Web Services SDK for Python)


Contribution

We are happy to accept the changes that you think can help the utilities grow.

Here are some things to note:

  • Raise a ticket for any requirement
  • Discuss the implementation requirement or bug fix with the team members
  • Fork the repository and solve the issue in one single commit
  • Raise a PR regarding the same issue and attach the required documentation or provide a more detailed overview of the changes
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].